-- Logs begin at Tue 2022-03-08 11:02:03 UTC, end at Tue 2022-03-08 12:20:02 UTC. -- Mar 08 11:40:10.528066 dv-cinder-830087-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 08 11:40:10.535660 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 08 11:40:10.537700 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 8 11:40:10 2022] *** Mar 08 11:40:10.537700 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 08 11:40:10.537700 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 08 11:40:10.537700 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: nodename: dv-cinder-830087-2-iscsi Mar 08 11:40:10.537700 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: machine: x86_64 Mar 08 11:40:10.537700 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: clock source: unix Mar 08 11:40:10.537700 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: pcre jit disabled Mar 08 11:40:10.537700 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: detected number of CPU cores: 4 Mar 08 11:40:10.538232 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: current working directory: / Mar 08 11:40:10.538232 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: detected binary path: /usr/bin/uwsgi-core Mar 08 11:40:10.538232 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: your processes number limit is 47680 Mar 08 11:40:10.538232 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: your memory page size is 4096 bytes Mar 08 11:40:10.538232 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: detected max file descriptor number: 2048 Mar 08 11:40:10.538232 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: lock engine: pthread robust mutexes Mar 08 11:40:10.538232 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: thunder lock: enabled Mar 08 11:40:10.538232 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 08 11:40:10.538232 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 08 11:40:10.584403 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: Python main interpreter initialized at 0x5593ffaff9c0 Mar 08 11:40:10.584403 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: python threads support enabled Mar 08 11:40:10.584403 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: your server socket listen backlog is limited to 100 connections Mar 08 11:40:10.584403 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: your mercy for graceful operations on workers is 90 seconds Mar 08 11:40:10.584791 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: mapped 403077 bytes (393 KB) for 2 cores Mar 08 11:40:10.584866 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: *** Operational MODE: preforking *** Mar 08 11:40:10.585129 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: *** uWSGI is running in multiple interpreter mode *** Mar 08 11:40:10.585129 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: spawned uWSGI master process (pid: 86134) Mar 08 11:40:10.585334 dv-cinder-830087-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 08 11:40:10.585907 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: spawned uWSGI worker 1 (pid: 86144, cores: 1) Mar 08 11:40:10.586245 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: spawned uWSGI worker 2 (pid: 86145, cores: 1) Mar 08 11:40:10.586404 dv-cinder-830087-2-iscsi devstack@keystone.service[86134]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 08 11:40:16.428982 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 11:40:16.428982 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: from cryptography.utils import int_from_bytes Mar 08 11:40:16.429759 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 11:40:16.429759 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: from cryptography.utils import int_from_bytes Mar 08 11:40:16.429868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 11:40:16.429868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: from cryptography.utils import int_from_bytes Mar 08 11:40:16.429868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 11:40:16.429868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: from cryptography.utils import int_from_bytes Mar 08 11:40:16.475183 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 11:40:16.475333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 11:40:16.475486 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] command line args: [] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 11:40:16.475779 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 11:40:16.475956 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ================================================================================ {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 11:40:16.476209 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] admin_token = **** {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.476337 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 11:40:16.476457 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] config_dir = [] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.476536 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 11:40:16.476643 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.476733 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] command line args: [] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 11:40:16.476810 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] config_source = [] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.476972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 11:40:16.477056 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] debug = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.477153 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ================================================================================ {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 11:40:16.477241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.477421 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] admin_token = **** {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.477558 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.477649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] config_dir = [] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.477717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.477824 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.477934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.478011 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] config_source = [] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.478170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] debug = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.478249 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.478428 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.478632 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] list_limit = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.478632 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] log_config_append = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.478941 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.479041 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.479143 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.479256 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] log_dir = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.479353 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.479476 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] log_file = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.479476 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.479737 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.479856 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.479983 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] list_limit = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.479983 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] log_config_append = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.480204 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.480324 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.480438 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.480579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] log_dir = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.480703 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.480826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] log_file = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.480942 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.481057 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.481176 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.481291 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.481411 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.481517 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.481629 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.481747 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.481870 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.482042 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.482161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.482280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.482396 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.482509 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.482623 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.482743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.482865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.482986 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.483097 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.483217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.483217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.483217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.483569 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.483569 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] publish_errors = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.483776 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.483897 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.484011 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.484125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.484237 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.484350 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.484350 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.484576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.484692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.484811 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] publish_errors = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.484931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] standard_threads = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.485056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.485257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.485386 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.485508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.485632 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.485747 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.485747 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] use_journal = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.485958 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.486071 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] use_json = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.486185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.486307 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] use_stderr = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.486422 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] standard_threads = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.486534 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] use_syslog = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.486723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.486842 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.486962 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.487092 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.487209 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.487328 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.487443 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] use_journal = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.487443 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] use_json = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.487692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.487819 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] use_stderr = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.487941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.488056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] use_syslog = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.488169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.488283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 11:40:16.488395 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.488516 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.488631 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.488751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.488871 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.488985 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.489097 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.489223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.489339 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.489458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.489572 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.489684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.489802 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.489924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.490039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.490152 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.490264 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.490378 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.490497 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.490696 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.490813 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.490927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.491050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.491164 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.491276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.491398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.491513 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.491646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.491759 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.491871 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.491983 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.492113 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.492229 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.492348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.492463 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.492585 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.492700 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.492821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.492936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.493048 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.493161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.493280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.493405 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.493520 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.493633 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.493745 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.493857 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.493970 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.494094 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.494215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.494329 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.494442 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.494555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.494651 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.494770 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.494885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.494981 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.495080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.495175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.495279 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.495383 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.495480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.495597 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.495695 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.495788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.495881 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.495991 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.496146 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.496271 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.496395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.496511 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.496633 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.496757 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.496872 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.496986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.497111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.497226 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.497346 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.497468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.497573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.497686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.497799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.497912 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.498026 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.498147 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.498260 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.498382 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.498496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.498603 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.498722 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.498844 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.499007 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.499113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.499225 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.499344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.499448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.499574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.499703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.499834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.499990 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.500098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.500210 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.500323 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.500323 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.500550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.500663 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.500776 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.500890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.501010 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.501134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.501257 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.501372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.501485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.501599 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.501721 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.501844 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.501960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.502079 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.502194 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.502307 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.502420 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.502608 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.502725 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.502839 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.502960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.503075 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.503195 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.503318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.503442 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.503636 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.503767 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.503884 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.503999 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.504122 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.504243 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.504358 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.504471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.504585 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.504698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.504820 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.504935 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.505050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.505170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.505290 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.505411 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.505542 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.505666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.505790 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.505905 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.506020 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.506135 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.506255 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.506371 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.506494 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.506617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.506732 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.506847 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.506961 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.507075 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.507203 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.507319 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.507434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.507562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.507679 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.507804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.507929 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.508046 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.508160 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.508274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.508388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.508502 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.508625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.508741 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.508855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.508975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.509091 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.509213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.509330 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.509444 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.509564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.510160 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.510276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.510398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.510515 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.510629 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.510744 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.510858 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.510979 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.511159 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.511281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.511396 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.511510 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.511642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.511756 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.511883 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.512000 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.512115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.512241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] auth.external = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.512363 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.512481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.512604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.512720 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.512720 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.512942 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.513064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] auth.password = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.513178 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.513300 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] auth.token = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.513417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.513562 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.513688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.513805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.513919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] auth.external = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.514034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.514148 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.514271 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.514388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.514505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.514620 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.514734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.514849 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] auth.password = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.514971 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.515088 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] auth.token = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.515214 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] credential.caching = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.515337 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.515453 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.515610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.515740 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.515864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.515980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.516102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.516225 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.516341 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.516529 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.516649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.516765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.516888 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.517004 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.517119 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] credential.caching = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.517243 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.517360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.517476 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.517592 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.517709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.517824 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.517948 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.518065 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.518180 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.518295 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.518410 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.518532 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.518657 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.518774 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.518890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.519005 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.519120 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] federation.caching = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.519243 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.519368 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.519484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.519627 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.519753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.519869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.519983 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.520109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.520109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.520328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.520443 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.520567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.520798 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.520928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.521046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.521161 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] federation.caching = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.521276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.521391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.521505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.521629 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.521745 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.521868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.521984 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity.caching = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.522099 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.522221 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.522337 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.522452 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.522573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.522689 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.522804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.522928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.523044 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.523159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.523273 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.523388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.523561 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.523696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.523814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.523930 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.524045 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity.caching = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.524159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.524273 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.524396 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.524513 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.524628 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.524743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.524858 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.524974 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.525101 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.525218 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.525983 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.526184 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.526373 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.526498 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.526625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.526743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.526858 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.526974 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.527090 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.527205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.527328 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.527445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.527588 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.527715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.527832 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.527947 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.528072 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.528198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.528315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.528430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.528545 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.528660 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.528784 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.528901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.529016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.529131 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.529253 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.529376 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.529501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.529617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.529732 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.529846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.529950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.530063 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.530188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.530305 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.530420 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.530535 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.530649 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.530764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.530887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.531004 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.531118 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.531233 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.531348 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.531463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.531891 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.531891 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.532097 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.532212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.532329 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.532444 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.532568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.532684 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.532799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.532914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.533028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.533142 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.533266 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.533384 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.533499 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.533613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.533727 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.533851 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.533967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.534082 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.534196 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.534311 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.534426 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.534553 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.534669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.534784 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.534899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.535013 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.535128 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.535256 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.535382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.535510 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.535685 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.535801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.535917 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.536048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.536165 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.536280 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.536395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.536511 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.536626 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.536750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.536867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.536982 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.537097 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.537212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.537327 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.537450 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.537568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.537683 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.537799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.537914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.538028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.538155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.538273 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.538377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.538490 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.538605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.538720 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.538844 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.538960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.539075 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.539189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.539304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.539418 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.539563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.539685 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.539801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.539916 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.540030 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.540145 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.540335 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.540454 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.540569 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.540684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.540799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.540938 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.541064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.541182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.541297 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.541412 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.541527 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.541642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.541766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.541883 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.541999 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.542114 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.542229 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.542344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.542467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.542584 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.542699 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.542814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.542929 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.543043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.543168 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.543284 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.543400 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.543587 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.543706 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.543706 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] resource.caching = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.543937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.543937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.544156 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.544156 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.544373 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.544487 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.544616 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.544732 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.544847 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.544962 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.545076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.545194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.545321 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.545437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.545552 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.545667 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.545781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.545895 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.546020 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.546136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] role.caching = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.546251 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] resource.caching = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.546366 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] role.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.546480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.546594 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.546717 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.546833 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.546948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.547064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.547179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.547298 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.547423 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.547563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.547682 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.547797 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.547912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.548037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.548159 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.548275 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.548389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.548504 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.548617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] role.caching = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.548740 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.548856 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] role.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.548970 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.549086 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.549200 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.549315 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.549438 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.549554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.549671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.549786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.549901 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.550015 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.550140 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.550257 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.550373 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.550488 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.550603 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.550718 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.550842 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.550958 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.551073 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.551189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.551304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.551418 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.551595 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.551714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.551829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.551943 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.552058 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.552172 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.552301 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.552418 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.552534 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.552648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.552762 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.552877 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.553002 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.553119 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.553234 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.553350 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.553464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.553586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.553703 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.553817 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.553932 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.553932 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.554148 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.554272 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] token.caching = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.554389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.554504 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.554618 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.554732 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.554846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.554970 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.555090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.555206 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.555321 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.555437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.555567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.555698 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.555815 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.555930 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.556044 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.556159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.556274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.556397 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.556536 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.556653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.556768 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.556883 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.556998 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] token.caching = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.557113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.557212 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.557307 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.557402 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.557498 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.557594 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.557698 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.557796 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.557892 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.557987 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.558083 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.558178 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.558290 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.connection = **** {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.558379 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.558461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.558534 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.558605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.558723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.558838 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.558961 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.559078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.559192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.559306 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.559420 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.559582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.559715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.559832 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.559947 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.560062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.560176 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.560291 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.560481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.560600 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.560716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.560832 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.560832 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.561047 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.connection = **** {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.561175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.561175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.561411 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.561527 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.561643 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.561759 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.561874 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.561990 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.562121 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.562239 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.562354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.562470 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 11:40:16.562586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.562586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.562586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.562586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.562586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.562586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.562586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.562586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.562586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.563560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.563560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.563560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.563560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 11:40:16.563560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 11:40:16.591988 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.592214 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.592437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.593813 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.594050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.594279 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.600882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.602773 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.629265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.629490 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.630752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.630986 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.684530 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.684773 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.734494 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.734671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.735093 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.735330 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.802543 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.802681 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.802836 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.802919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.802994 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.803067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.803189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.803272 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.803412 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.803496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.803640 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.803721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.828653 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.828888 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.828982 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.829108 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.829192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.829332 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.829422 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.829557 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.829640 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.829768 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.829850 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.829978 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.830068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.830189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.841795 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.841953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.855172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.855303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.855384 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.855461 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.855646 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.855737 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.855865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.855948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.856082 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.856165 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.856293 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.856376 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.856503 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.856587 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 11:40:16.873427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.873631 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 11:40:16.873965 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.874167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 11:40:16.874249 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.874390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 11:40:16.874472 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.874679 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.874768 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.874912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 11:40:16.874994 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.875170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.875250 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.875440 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.875726 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.875986 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.885890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.886165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.886432 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.886712 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.887252 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.887551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.887827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.888111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.894634 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.896107 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.897864 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.898142 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.898529 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.898810 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.899093 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.899319 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.899400 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.899629 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.899713 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.899904 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.900026 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.900174 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.900846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.900951 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.901140 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.901238 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.901404 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.901676 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.901952 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.902250 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.902529 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.902801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.928106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.929672 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.929786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.929948 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.931366 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.932205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.935184 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.935464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.935766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.937398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.937680 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.937960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.942831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.943114 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.945092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.945381 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.947652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.947936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.948213 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.948489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.948761 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.949031 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.949298 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.949560 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.950045 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.950331 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.950615 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.950900 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.951176 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.951454 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.951751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.952020 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.968429 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.968700 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.970879 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.971156 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.973155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.975674 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.976879 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.977173 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.979984 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.980280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.982767 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.985245 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.986451 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.988919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:16.990018 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.990313 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.990602 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.990883 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.991155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.991435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.992519 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.992819 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.993102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.993383 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.993663 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:16.993974 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.010295 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.010573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.015438 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.015438 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.015598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.015598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.015598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.015598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.018726 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.020387 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.020671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.021415 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.023236 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.023515 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.023660 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.023957 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.024235 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.024511 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.024779 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.027101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.027377 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.027684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.027972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.028261 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.038955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.039231 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.039506 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.039810 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.040085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.040361 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.040627 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.042714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.042994 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.043279 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.043586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.043870 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.044147 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.044433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.060067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.063225 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.063712 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.066459 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.066915 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.068028 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.069613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.069889 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.070178 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.070306 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.071782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.073835 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.074116 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.074420 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.179830 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.181416 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.185369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.185590 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.185731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.185927 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.186203 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.187037 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.190214 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.190505 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.190790 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.191072 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.195190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.195473 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.195768 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.201501 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.201814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.202098 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.203964 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.204247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.204527 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.204800 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.205167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.205437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.205728 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.205998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.206275 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.206652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.206932 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.207196 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.207468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.207800 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.210743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 11:40:17.211030 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.211313 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.211613 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.211888 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.212197 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.212484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.213423 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.213891 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.214515 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.214999 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.215474 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.215953 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.216242 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 11:40:17.245817 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5593ffaff9c0 pid: 86144 (default app) Mar 08 11:40:17.249228 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bbf13-a1d6-42cb-bc16-050705a4635a None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:17.249520 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bbf13-a1d6-42cb-bc16-050705a4635a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:17.249796 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bbf13-a1d6-42cb-bc16-050705a4635a None None] PATH_INFO: `/v3` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:17.253973 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Tue Mar 8 11:40:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:17.254872 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5593ffaff9c0 pid: 86145 (default app) Mar 08 11:40:26.441616 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d53df-d586-4b8e-bb81-6d36cbaa3d48 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:26.442173 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d53df-d586-4b8e-bb81-6d36cbaa3d48 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:26.442173 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d53df-d586-4b8e-bb81-6d36cbaa3d48 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:26.444318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:26.452087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac3aa7-d368-4d53-969b-0d0face7c72d None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:26.452484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac3aa7-d368-4d53-969b-0d0face7c72d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:26.452642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac3aa7-d368-4d53-969b-0d0face7c72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:26.482524 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG oslo_db.sqlalchemy.engines [None req-57ac3aa7-d368-4d53-969b-0d0face7c72d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 11:40:26.667468 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG passlib.handlers.bcrypt [None req-57ac3aa7-d368-4d53-969b-0d0face7c72d None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86145) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 08 11:40:26.667915 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG passlib.handlers.bcrypt [None req-57ac3aa7-d368-4d53-969b-0d0face7c72d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86145) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 08 11:40:26.723035 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-57ac3aa7-d368-4d53-969b-0d0face7c72d None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:26.724620 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-57ac3aa7-d368-4d53-969b-0d0face7c72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:26.844034 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1/3] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Mar 08 11:40:26.985612 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d53df-d586-4b8e-bb81-6d36cbaa3d48 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:27.018731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG oslo_db.sqlalchemy.engines [None req-fa0d53df-d586-4b8e-bb81-6d36cbaa3d48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86144) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 11:40:27.144813 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d53df-d586-4b8e-bb81-6d36cbaa3d48 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:27.160843 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd3990-c809-478d-b935-cd259d2bad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:27.160843 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd3990-c809-478d-b935-cd259d2bad1d admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:27.160843 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd3990-c809-478d-b935-cd259d2bad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:27.160843 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd3990-c809-478d-b935-cd259d2bad1d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:27.161187 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd3990-c809-478d-b935-cd259d2bad1d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:27.223234 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.common.rbac_enforcer.enforcer [None req-74cd3990-c809-478d-b935-cd259d2bad1d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 08 11:40:27.223610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd3990-c809-478d-b935-cd259d2bad1d admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:27.234361 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 3/4] 10.222.0.52 () {58 vars in 1324 bytes} [Tue Mar 8 11:40:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 11:40:27.240374 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac3aa7-d368-4d53-969b-0d0face7c72d None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:27.259738 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac3aa7-d368-4d53-969b-0d0face7c72d None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:27.264817 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f474ae-4696-4ace-a52c-f7b9e7bf951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:27.266039 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f474ae-4696-4ace-a52c-f7b9e7bf951c admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:27.266324 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f474ae-4696-4ace-a52c-f7b9e7bf951c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:27.266600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f474ae-4696-4ace-a52c-f7b9e7bf951c admin admin] PATH_INFO: `/v3/projects/675cf84704734f5798e386951dca511b` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:27.268268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f474ae-4696-4ace-a52c-f7b9e7bf951c admin admin] RBAC: Authorizing `identity:get_project(project_id=675cf84704734f5798e386951dca511b)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:27.320421 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.common.rbac_enforcer.enforcer [None req-81f474ae-4696-4ace-a52c-f7b9e7bf951c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 08 11:40:27.320758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f474ae-4696-4ace-a52c-f7b9e7bf951c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:27.325517 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 2/5] 10.222.0.52 () {56 vars in 1207 bytes} [Tue Mar 8 11:40:27 2022] GET /identity/v3/projects/675cf84704734f5798e386951dca511b => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:29.756280 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22ec06-056f-4690-b842-1927cc2e1931 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:29.756808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22ec06-056f-4690-b842-1927cc2e1931 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:29.756808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22ec06-056f-4690-b842-1927cc2e1931 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:29.761563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 4/6] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:29.766924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1bf0f-c0a3-472f-923d-bf76fde1dfbc None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:29.767391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1bf0f-c0a3-472f-923d-bf76fde1dfbc None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:29.767485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1bf0f-c0a3-472f-923d-bf76fde1dfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:29.786430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-fef1bf0f-c0a3-472f-923d-bf76fde1dfbc None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:29.787964 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-fef1bf0f-c0a3-472f-923d-bf76fde1dfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:29.796519 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 3/7] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Mar 08 11:40:29.820214 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22ec06-056f-4690-b842-1927cc2e1931 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:29.834308 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22ec06-056f-4690-b842-1927cc2e1931 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:29.839323 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069671f5-4617-49ca-a305-372040e1e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:29.839995 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069671f5-4617-49ca-a305-372040e1e5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:29.840284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069671f5-4617-49ca-a305-372040e1e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:29.840561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069671f5-4617-49ca-a305-372040e1e5e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:29.848257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069671f5-4617-49ca-a305-372040e1e5e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:29.850033 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069671f5-4617-49ca-a305-372040e1e5e5 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:29.859386 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 5/8] 10.222.0.52 () {58 vars in 1324 bytes} [Tue Mar 8 11:40:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 11:40:29.864952 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1bf0f-c0a3-472f-923d-bf76fde1dfbc None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:29.873933 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1bf0f-c0a3-472f-923d-bf76fde1dfbc None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:29.878303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfb149-f4ed-4e0e-acbe-693859147b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:29.879165 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfb149-f4ed-4e0e-acbe-693859147b58 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:29.879452 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfb149-f4ed-4e0e-acbe-693859147b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:29.879777 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfb149-f4ed-4e0e-acbe-693859147b58 admin admin] PATH_INFO: `/v3/users/06642583007748d2a52d59e585d12052` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:29.881171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfb149-f4ed-4e0e-acbe-693859147b58 admin admin] RBAC: Authorizing `identity:get_user(user_id=06642583007748d2a52d59e585d12052)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:29.882999 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfb149-f4ed-4e0e-acbe-693859147b58 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:29.885223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 4/9] 10.222.0.52 () {56 vars in 1198 bytes} [Tue Mar 8 11:40:29 2022] GET /identity/v3/users/06642583007748d2a52d59e585d12052 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:32.229421 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694e1b3-14a8-48a1-bc96-c95300f68a82 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:32.229939 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694e1b3-14a8-48a1-bc96-c95300f68a82 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:32.230030 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694e1b3-14a8-48a1-bc96-c95300f68a82 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:32.231937 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:40:32.236921 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedee6be-0043-4246-8e91-03766cf7488a None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:32.237311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedee6be-0043-4246-8e91-03766cf7488a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:32.237479 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedee6be-0043-4246-8e91-03766cf7488a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:32.254601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-bedee6be-0043-4246-8e91-03766cf7488a None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:32.255804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-bedee6be-0043-4246-8e91-03766cf7488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:32.264716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255371a9-93ff-4fc5-84cd-2dadbb5cb729 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:32.265088 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255371a9-93ff-4fc5-84cd-2dadbb5cb729 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:32.265374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255371a9-93ff-4fc5-84cd-2dadbb5cb729 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:32.267120 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 7/11] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:32.272328 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aeb67c-23a5-4c9c-bbaf-295777fb49b8 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:32.272620 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aeb67c-23a5-4c9c-bbaf-295777fb49b8 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:32.272901 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aeb67c-23a5-4c9c-bbaf-295777fb49b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:32.314825 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG passlib.handlers.bcrypt [None req-87aeb67c-23a5-4c9c-bbaf-295777fb49b8 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86144) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 08 11:40:32.315250 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG passlib.handlers.bcrypt [None req-87aeb67c-23a5-4c9c-bbaf-295777fb49b8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86144) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 08 11:40:32.332326 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 5/12] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:32.356192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedee6be-0043-4246-8e91-03766cf7488a None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:32.361912 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-87aeb67c-23a5-4c9c-bbaf-295777fb49b8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:32.363546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-87aeb67c-23a5-4c9c-bbaf-295777fb49b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:32.451435 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedee6be-0043-4246-8e91-03766cf7488a None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:32.459490 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 8/13] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:40:32.482250 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aeb67c-23a5-4c9c-bbaf-295777fb49b8 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:32.483171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d664f-e909-4dc6-956b-7a48c52651cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:32.484010 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d664f-e909-4dc6-956b-7a48c52651cf None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:32.484304 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d664f-e909-4dc6-956b-7a48c52651cf None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:32.484578 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d664f-e909-4dc6-956b-7a48c52651cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:32.496194 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d664f-e909-4dc6-956b-7a48c52651cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:40:32.503035 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-817d664f-e909-4dc6-956b-7a48c52651cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:40:32.504275 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 6/14] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:40:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:40:32.510118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d664f-e909-4dc6-956b-7a48c52651cf None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:32.577355 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aeb67c-23a5-4c9c-bbaf-295777fb49b8 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:32.604483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d664f-e909-4dc6-956b-7a48c52651cf None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:32.609578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01623a56-dcb7-447d-8079-e0097f574c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:32.610474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01623a56-dcb7-447d-8079-e0097f574c2f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:32.610755 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01623a56-dcb7-447d-8079-e0097f574c2f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:32.611029 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01623a56-dcb7-447d-8079-e0097f574c2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:32.636873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1dcae-8281-4ef2-9f81-3544c63385c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:32.637530 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1dcae-8281-4ef2-9f81-3544c63385c3 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:32.637810 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1dcae-8281-4ef2-9f81-3544c63385c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:32.638087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1dcae-8281-4ef2-9f81-3544c63385c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:32.638821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1dcae-8281-4ef2-9f81-3544c63385c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:32.639128 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1dcae-8281-4ef2-9f81-3544c63385c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:32.640547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1dcae-8281-4ef2-9f81-3544c63385c3 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:32.651728 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 7/15] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:40:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:32.657312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1dcae-8281-4ef2-9f81-3544c63385c3 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:32.676186 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01623a56-dcb7-447d-8079-e0097f574c2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:32.677698 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01623a56-dcb7-447d-8079-e0097f574c2f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:32.758258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1dcae-8281-4ef2-9f81-3544c63385c3 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:32.773892 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 9/16] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:40:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 11:40:32.781323 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01623a56-dcb7-447d-8079-e0097f574c2f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:32.801741 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3ddd4-4f12-4507-b560-7c1253b8e04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:32.803179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3ddd4-4f12-4507-b560-7c1253b8e04c None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:32.803805 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3ddd4-4f12-4507-b560-7c1253b8e04c None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:32.804162 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3ddd4-4f12-4507-b560-7c1253b8e04c None admin] PATH_INFO: `/v3/users/06642583007748d2a52d59e585d12052` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:32.805956 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3ddd4-4f12-4507-b560-7c1253b8e04c None admin] RBAC: Authorizing `identity:get_user(user_id=06642583007748d2a52d59e585d12052)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:32.807949 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3ddd4-4f12-4507-b560-7c1253b8e04c None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:32.810361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 8/17] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:40:32 2022] GET /identity/v3/users/06642583007748d2a52d59e585d12052 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:32.815475 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3ddd4-4f12-4507-b560-7c1253b8e04c None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:32.886024 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01623a56-dcb7-447d-8079-e0097f574c2f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:32.921779 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029c357-4ebf-4663-a9e9-8783182c8c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:32.922817 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029c357-4ebf-4663-a9e9-8783182c8c38 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:32.922958 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3ddd4-4f12-4507-b560-7c1253b8e04c None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:32.923370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029c357-4ebf-4663-a9e9-8783182c8c38 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:32.923822 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029c357-4ebf-4663-a9e9-8783182c8c38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:32.944511 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029c357-4ebf-4663-a9e9-8783182c8c38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:32.946742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029c357-4ebf-4663-a9e9-8783182c8c38 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:32.957082 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be92e2-f3d0-442a-9f02-fd978453b761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:32.957967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be92e2-f3d0-442a-9f02-fd978453b761 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:32.958249 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be92e2-f3d0-442a-9f02-fd978453b761 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:32.958526 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be92e2-f3d0-442a-9f02-fd978453b761 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:32.959758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be92e2-f3d0-442a-9f02-fd978453b761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:32.961217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be92e2-f3d0-442a-9f02-fd978453b761 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:32.963631 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 9/18] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:40:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:32.967652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-6029c357-4ebf-4663-a9e9-8783182c8c38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:40:32.967652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 10/19] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:40:32.969340 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be92e2-f3d0-442a-9f02-fd978453b761 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:32.972407 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029c357-4ebf-4663-a9e9-8783182c8c38 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:33.067153 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be92e2-f3d0-442a-9f02-fd978453b761 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:33.069430 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029c357-4ebf-4663-a9e9-8783182c8c38 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:33.099505 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1434c67-4620-4048-b245-d2eb668bd9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:33.100181 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1434c67-4620-4048-b245-d2eb668bd9c2 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:33.100463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1434c67-4620-4048-b245-d2eb668bd9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:33.100732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1434c67-4620-4048-b245-d2eb668bd9c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:33.101545 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1434c67-4620-4048-b245-d2eb668bd9c2 None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.domain.id=default, user.id=06642583007748d2a52d59e585d12052) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:33.101855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1434c67-4620-4048-b245-d2eb668bd9c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:33.102535 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fb778-dea9-4756-a3bf-d3a2bb6ef089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:33.103260 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fb778-dea9-4756-a3bf-d3a2bb6ef089 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:33.103461 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1434c67-4620-4048-b245-d2eb668bd9c2 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:33.103632 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fb778-dea9-4756-a3bf-d3a2bb6ef089 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:33.103912 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fb778-dea9-4756-a3bf-d3a2bb6ef089 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:33.104629 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fb778-dea9-4756-a3bf-d3a2bb6ef089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:33.104936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fb778-dea9-4756-a3bf-d3a2bb6ef089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:33.106327 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fb778-dea9-4756-a3bf-d3a2bb6ef089 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:33.110170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 10/20] 10.222.0.52 () {56 vars in 1322 bytes} [Tue Mar 8 11:40:32 2022] GET /identity/v3/role_assignments?user.id=06642583007748d2a52d59e585d12052&scope.domain.id=default&role.id=c2642d38bc964424a5edc330e0d4471d => generated 233 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:33.125987 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 11/21] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:35.772973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162d4d6-ae59-4526-ac52-0eb5ec10acba None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:35.774553 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162d4d6-ae59-4526-ac52-0eb5ec10acba None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:35.775310 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162d4d6-ae59-4526-ac52-0eb5ec10acba None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:35.777968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 11/22] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:35.784352 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd4830-0adb-4647-ad7a-f2da885348c7 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:35.785240 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd4830-0adb-4647-ad7a-f2da885348c7 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:35.785727 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd4830-0adb-4647-ad7a-f2da885348c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:35.812506 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-7ddd4830-0adb-4647-ad7a-f2da885348c7 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:35.814034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-7ddd4830-0adb-4647-ad7a-f2da885348c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:35.835184 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47690573-2b93-44f4-8194-e31297deeb6e None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:35.835881 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47690573-2b93-44f4-8194-e31297deeb6e None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:35.836370 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47690573-2b93-44f4-8194-e31297deeb6e None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:35.838964 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 12/23] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:35.844714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5610-af18-4eb4-829e-c33948597bee None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:35.845268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5610-af18-4eb4-829e-c33948597bee None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:35.845733 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5610-af18-4eb4-829e-c33948597bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:35.875868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-067d5610-af18-4eb4-829e-c33948597bee None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:35.877102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-067d5610-af18-4eb4-829e-c33948597bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:35.971635 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 12/24] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:35.979629 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 13/25] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:36.009154 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d5610-af18-4eb4-829e-c33948597bee None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:36.009338 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd4830-0adb-4647-ad7a-f2da885348c7 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:36.131276 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d5610-af18-4eb4-829e-c33948597bee None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:36.170151 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a5915-8b14-4d09-a3c6-5cff76958658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:36.171383 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a5915-8b14-4d09-a3c6-5cff76958658 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:36.171843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a5915-8b14-4d09-a3c6-5cff76958658 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:36.172263 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a5915-8b14-4d09-a3c6-5cff76958658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:36.184551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a5915-8b14-4d09-a3c6-5cff76958658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:36.186421 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a5915-8b14-4d09-a3c6-5cff76958658 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:36.207620 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-520a5915-8b14-4d09-a3c6-5cff76958658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:40:36.209638 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 14/26] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:40:36.216297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a5915-8b14-4d09-a3c6-5cff76958658 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:36.265702 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd4830-0adb-4647-ad7a-f2da885348c7 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:36.342255 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a5915-8b14-4d09-a3c6-5cff76958658 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:36.364812 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1761c2-de24-48f9-b64c-1d5bbf4f8676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:36.365872 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1761c2-de24-48f9-b64c-1d5bbf4f8676 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:36.366320 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1761c2-de24-48f9-b64c-1d5bbf4f8676 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:36.366737 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1761c2-de24-48f9-b64c-1d5bbf4f8676 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:36.379015 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e73e0-7d75-419c-bd37-361ab7ab336a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:36.380115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e73e0-7d75-419c-bd37-361ab7ab336a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:36.380709 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e73e0-7d75-419c-bd37-361ab7ab336a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:36.381189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e73e0-7d75-419c-bd37-361ab7ab336a None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:36.382110 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e73e0-7d75-419c-bd37-361ab7ab336a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:36.382577 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e73e0-7d75-419c-bd37-361ab7ab336a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:36.384334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e73e0-7d75-419c-bd37-361ab7ab336a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:36.400597 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1761c2-de24-48f9-b64c-1d5bbf4f8676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:40:36.403686 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 15/27] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:36.412366 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-ae1761c2-de24-48f9-b64c-1d5bbf4f8676 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:40:36.413904 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 13/28] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:40:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:40:36.416015 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e73e0-7d75-419c-bd37-361ab7ab336a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:36.420358 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1761c2-de24-48f9-b64c-1d5bbf4f8676 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:36.568969 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e73e0-7d75-419c-bd37-361ab7ab336a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:36.603411 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105aed80-882a-40ae-883d-d11ef329e75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:36.604108 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105aed80-882a-40ae-883d-d11ef329e75d None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:36.604391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105aed80-882a-40ae-883d-d11ef329e75d None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:36.604668 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105aed80-882a-40ae-883d-d11ef329e75d None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:36.605395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105aed80-882a-40ae-883d-d11ef329e75d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:36.606853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105aed80-882a-40ae-883d-d11ef329e75d None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:36.615092 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1761c2-de24-48f9-b64c-1d5bbf4f8676 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:36.656996 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f4804-3f2c-4a6d-a743-60badd85960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:36.657588 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f4804-3f2c-4a6d-a743-60badd85960d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:36.657870 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f4804-3f2c-4a6d-a743-60badd85960d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:36.658147 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f4804-3f2c-4a6d-a743-60badd85960d None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:36.658966 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f4804-3f2c-4a6d-a743-60badd85960d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:36.659271 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f4804-3f2c-4a6d-a743-60badd85960d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:36.660696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f4804-3f2c-4a6d-a743-60badd85960d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:36.679715 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 14/29] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:40:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:36.681763 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ce9c1-d762-479f-be35-8f315ca00974 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:36.682054 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ce9c1-d762-479f-be35-8f315ca00974 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:36.682385 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ce9c1-d762-479f-be35-8f315ca00974 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:36.687795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 15/30] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:36.690722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf247c-8349-47a0-8203-8a82bbe1e0ea None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:36.691009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf247c-8349-47a0-8203-8a82bbe1e0ea None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:36.691284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf247c-8349-47a0-8203-8a82bbe1e0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:36.709640 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-a7cf247c-8349-47a0-8203-8a82bbe1e0ea None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:36.710961 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a7cf247c-8349-47a0-8203-8a82bbe1e0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:36.799145 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 16/31] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:36.809153 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf247c-8349-47a0-8203-8a82bbe1e0ea None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:36.860264 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 16/32] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 11:40:36 2022] POST /identity/v3/projects => generated 301 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 11:40:36.861912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe82e8-9672-4e22-817a-f6f79b86ac0c None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:36.862206 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe82e8-9672-4e22-817a-f6f79b86ac0c None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:36.862489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe82e8-9672-4e22-817a-f6f79b86ac0c None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:36.873332 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 17/33] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:36.888591 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe82e8-9672-4e22-817a-f6f79b86ac0c None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:36.960035 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf247c-8349-47a0-8203-8a82bbe1e0ea None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:37.000522 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf47d46-e9bd-4ddf-a541-c7065aa5e316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:37.001477 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf47d46-e9bd-4ddf-a541-c7065aa5e316 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:37.001765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf47d46-e9bd-4ddf-a541-c7065aa5e316 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:37.002038 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf47d46-e9bd-4ddf-a541-c7065aa5e316 None admin] PATH_INFO: `/v3/users/06642583007748d2a52d59e585d12052` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:37.003926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf47d46-e9bd-4ddf-a541-c7065aa5e316 None admin] RBAC: Authorizing `identity:get_user(user_id=06642583007748d2a52d59e585d12052)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:37.005486 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf47d46-e9bd-4ddf-a541-c7065aa5e316 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:37.007229 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 17/34] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:40:36 2022] GET /identity/v3/users/06642583007748d2a52d59e585d12052 => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:37.012977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9c534-0a62-46c8-a96a-de774ca958fd None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:37.013503 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9c534-0a62-46c8-a96a-de774ca958fd None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:37.014335 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9c534-0a62-46c8-a96a-de774ca958fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:37.035500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-d9f9c534-0a62-46c8-a96a-de774ca958fd None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:37.037045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d9f9c534-0a62-46c8-a96a-de774ca958fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:37.117541 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 18/35] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:37.123219 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9c534-0a62-46c8-a96a-de774ca958fd None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:37.182626 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe82e8-9672-4e22-817a-f6f79b86ac0c None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:37.244240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce46ca-48f9-40eb-b671-aa0c11943caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:37.245303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce46ca-48f9-40eb-b671-aa0c11943caf None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:37.245783 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce46ca-48f9-40eb-b671-aa0c11943caf None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:37.246275 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce46ca-48f9-40eb-b671-aa0c11943caf None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:37.247227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce46ca-48f9-40eb-b671-aa0c11943caf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:37.249022 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce46ca-48f9-40eb-b671-aa0c11943caf None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:37.288461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9c534-0a62-46c8-a96a-de774ca958fd None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:37.321432 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc327b92-7a24-4d63-89b1-aa68113637ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:37.322245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc327b92-7a24-4d63-89b1-aa68113637ca None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:37.322525 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc327b92-7a24-4d63-89b1-aa68113637ca None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:37.322804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc327b92-7a24-4d63-89b1-aa68113637ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:37.324108 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc327b92-7a24-4d63-89b1-aa68113637ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:37.325569 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc327b92-7a24-4d63-89b1-aa68113637ca None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:37.327189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 19/36] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:40:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:37.328048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc327b92-7a24-4d63-89b1-aa68113637ca None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:37.358812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1131 bytes} [Tue Mar 8 11:40:36 2022] POST /identity/v3/roles => generated 225 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:40:37.358812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee3cb6-854f-470f-acd5-3b5a71e08a99 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:37.358812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee3cb6-854f-470f-acd5-3b5a71e08a99 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:37.358812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee3cb6-854f-470f-acd5-3b5a71e08a99 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:37.360190 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 19/38] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:37.361636 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee3cb6-854f-470f-acd5-3b5a71e08a99 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:37.441474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc327b92-7a24-4d63-89b1-aa68113637ca None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:37.481036 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66774ed-84d4-4230-a778-c86cc609d10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:37.481803 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66774ed-84d4-4230-a778-c86cc609d10e None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:37.482090 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66774ed-84d4-4230-a778-c86cc609d10e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:37.482367 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66774ed-84d4-4230-a778-c86cc609d10e None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:37.483127 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66774ed-84d4-4230-a778-c86cc609d10e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:37.484583 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66774ed-84d4-4230-a778-c86cc609d10e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:37.500321 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee3cb6-854f-470f-acd5-3b5a71e08a99 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:37.536068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a025a1-c78a-4fcd-b921-9d617a3307b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:37.536974 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a025a1-c78a-4fcd-b921-9d617a3307b2 None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:37.537257 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a025a1-c78a-4fcd-b921-9d617a3307b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:37.537546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a025a1-c78a-4fcd-b921-9d617a3307b2 None admin] PATH_INFO: `/v3/domains/default/users/06642583007748d2a52d59e585d12052/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:37.540273 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a025a1-c78a-4fcd-b921-9d617a3307b2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=06642583007748d2a52d59e585d12052, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:37.542144 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a025a1-c78a-4fcd-b921-9d617a3307b2 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:37.635010 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 20/39] 10.222.0.52 () {58 vars in 1361 bytes} [Tue Mar 8 11:40:37 2022] PUT /identity/v3/domains/default/users/06642583007748d2a52d59e585d12052/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:40:37.645053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09f358-f708-47e2-9075-fa8944d66332 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:37.645343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09f358-f708-47e2-9075-fa8944d66332 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:37.645622 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09f358-f708-47e2-9075-fa8944d66332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:37.664782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-0e09f358-f708-47e2-9075-fa8944d66332 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:37.666531 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-0e09f358-f708-47e2-9075-fa8944d66332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:37.674619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 20/40] 10.222.0.52 () {60 vars in 1131 bytes} [Tue Mar 8 11:40:37 2022] POST /identity/v3/roles => generated 219 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:40:37.676032 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc402920-02ed-41ff-bdfb-1c388d7f2b71 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:37.676327 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc402920-02ed-41ff-bdfb-1c388d7f2b71 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:37.676611 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc402920-02ed-41ff-bdfb-1c388d7f2b71 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:37.679564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 21/41] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:37.684152 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d831cd3-a3fb-4aa5-932e-94ef44a694ec None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:37.684707 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d831cd3-a3fb-4aa5-932e-94ef44a694ec None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:37.685154 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d831cd3-a3fb-4aa5-932e-94ef44a694ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:37.704321 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-7d831cd3-a3fb-4aa5-932e-94ef44a694ec None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:37.706002 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-7d831cd3-a3fb-4aa5-932e-94ef44a694ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:37.742340 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 21/42] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:37.767287 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09f358-f708-47e2-9075-fa8944d66332 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:37.792013 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 22/43] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:40:37.901870 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d831cd3-a3fb-4aa5-932e-94ef44a694ec None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:37.902429 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09f358-f708-47e2-9075-fa8944d66332 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:37.925056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1b2a2-0c79-44a0-8778-189c357e03bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:37.925663 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1b2a2-0c79-44a0-8778-189c357e03bc None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:37.925952 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1b2a2-0c79-44a0-8778-189c357e03bc None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:37.926235 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1b2a2-0c79-44a0-8778-189c357e03bc None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:37.926995 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1b2a2-0c79-44a0-8778-189c357e03bc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:37.928467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1b2a2-0c79-44a0-8778-189c357e03bc None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:37.939153 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d831cd3-a3fb-4aa5-932e-94ef44a694ec None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:37.975432 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfef66-b9f5-4140-8538-c816c82112a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:37.976316 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfef66-b9f5-4140-8538-c816c82112a2 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:37.976594 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfef66-b9f5-4140-8538-c816c82112a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:37.976873 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfef66-b9f5-4140-8538-c816c82112a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:37.978155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfef66-b9f5-4140-8538-c816c82112a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:37.979777 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfef66-b9f5-4140-8538-c816c82112a2 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:37.981495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 23/44] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:40:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:37.986881 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfef66-b9f5-4140-8538-c816c82112a2 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:38.017864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1131 bytes} [Tue Mar 8 11:40:37 2022] POST /identity/v3/roles => generated 223 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 11:40:38.094178 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfef66-b9f5-4140-8538-c816c82112a2 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:38.129909 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae2818-eab2-4d31-afb9-2591945e3259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:38.130910 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae2818-eab2-4d31-afb9-2591945e3259 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:38.131378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae2818-eab2-4d31-afb9-2591945e3259 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:38.131850 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae2818-eab2-4d31-afb9-2591945e3259 None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:38.132810 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae2818-eab2-4d31-afb9-2591945e3259 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:38.135039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae2818-eab2-4d31-afb9-2591945e3259 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:38.273065 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 11:40:37 2022] POST /identity/v3/projects => generated 312 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 11:40:40.027483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21785a7d-e30c-4ec6-b255-c58434266c48 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:40.028056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21785a7d-e30c-4ec6-b255-c58434266c48 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:40.028056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21785a7d-e30c-4ec6-b255-c58434266c48 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:40.029864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 23/47] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:40.035355 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e8036-4ffe-4440-ab2f-d7590e161c07 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:40.035796 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e8036-4ffe-4440-ab2f-d7590e161c07 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:40.035953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e8036-4ffe-4440-ab2f-d7590e161c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:40.053185 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-ee4e8036-4ffe-4440-ab2f-d7590e161c07 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:40.054364 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ee4e8036-4ffe-4440-ab2f-d7590e161c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:40.118870 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 25/48] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:40.141252 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21785a7d-e30c-4ec6-b255-c58434266c48 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:40.244462 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21785a7d-e30c-4ec6-b255-c58434266c48 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:40.280250 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e83d20-3701-4591-8360-83431c14c20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:40.281231 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e83d20-3701-4591-8360-83431c14c20c None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:40.281519 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e83d20-3701-4591-8360-83431c14c20c None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:40.281804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e83d20-3701-4591-8360-83431c14c20c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:40.292274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e83d20-3701-4591-8360-83431c14c20c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:40:40.299071 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-38e83d20-3701-4591-8360-83431c14c20c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:40:40.300295 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 24/49] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:40:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:40:40.306187 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e8036-4ffe-4440-ab2f-d7590e161c07 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:40.399689 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e8036-4ffe-4440-ab2f-d7590e161c07 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:40.431465 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206df33-98c6-4267-8c2d-adcca2530e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:40.432170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206df33-98c6-4267-8c2d-adcca2530e73 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:40.432458 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206df33-98c6-4267-8c2d-adcca2530e73 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:40.432738 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206df33-98c6-4267-8c2d-adcca2530e73 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:40.433486 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206df33-98c6-4267-8c2d-adcca2530e73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:40.433797 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206df33-98c6-4267-8c2d-adcca2530e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:40.435193 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206df33-98c6-4267-8c2d-adcca2530e73 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:40.443137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 26/50] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:40:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:40.449382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e83d20-3701-4591-8360-83431c14c20c None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:40.545909 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e83d20-3701-4591-8360-83431c14c20c None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:40.576004 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5b2b3-d508-433d-a92e-102dda598b7f None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:40.576295 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5b2b3-d508-433d-a92e-102dda598b7f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:40.576578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5b2b3-d508-433d-a92e-102dda598b7f None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:40.578352 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 27/51] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:40:40.578557 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7c56c-ca37-4bee-b6db-c42ed1d4ccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:40.579492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7c56c-ca37-4bee-b6db-c42ed1d4ccbf None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:40.579873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7c56c-ca37-4bee-b6db-c42ed1d4ccbf None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:40.580161 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7c56c-ca37-4bee-b6db-c42ed1d4ccbf None admin] PATH_INFO: `/v3/users/06642583007748d2a52d59e585d12052` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:40.581361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7c56c-ca37-4bee-b6db-c42ed1d4ccbf None admin] RBAC: Authorizing `identity:get_user(user_id=06642583007748d2a52d59e585d12052)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:40.582950 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7c56c-ca37-4bee-b6db-c42ed1d4ccbf None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:40.583155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67339758-8f62-4468-9b1f-6d7f328951b3 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:40.583440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67339758-8f62-4468-9b1f-6d7f328951b3 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:40.583745 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67339758-8f62-4468-9b1f-6d7f328951b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:40.589586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 25/52] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:40:40 2022] GET /identity/v3/users/06642583007748d2a52d59e585d12052 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:40.590527 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7c56c-ca37-4bee-b6db-c42ed1d4ccbf None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:40.600807 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-67339758-8f62-4468-9b1f-6d7f328951b3 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:40.602050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-67339758-8f62-4468-9b1f-6d7f328951b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:40.664720 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 28/53] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:40:40.682721 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7c56c-ca37-4bee-b6db-c42ed1d4ccbf None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:40.687708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67339758-8f62-4468-9b1f-6d7f328951b3 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:40.715081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28804015-f346-4c8f-8457-e4e7dba485c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:40.715906 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28804015-f346-4c8f-8457-e4e7dba485c6 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:40.716192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28804015-f346-4c8f-8457-e4e7dba485c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:40.716479 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28804015-f346-4c8f-8457-e4e7dba485c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:40.717658 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28804015-f346-4c8f-8457-e4e7dba485c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:40.719127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28804015-f346-4c8f-8457-e4e7dba485c6 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:40.720775 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 26/54] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:40:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:40.726310 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28804015-f346-4c8f-8457-e4e7dba485c6 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:40.781370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67339758-8f62-4468-9b1f-6d7f328951b3 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:40.812916 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca19a1-333f-4360-a691-cb44a4347e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:40.813645 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca19a1-333f-4360-a691-cb44a4347e81 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:40.813927 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca19a1-333f-4360-a691-cb44a4347e81 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:40.814199 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca19a1-333f-4360-a691-cb44a4347e81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:40.815364 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca19a1-333f-4360-a691-cb44a4347e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:40.816837 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca19a1-333f-4360-a691-cb44a4347e81 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:40.818458 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 29/55] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:40:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:40.820462 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28804015-f346-4c8f-8457-e4e7dba485c6 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:40.824555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca19a1-333f-4360-a691-cb44a4347e81 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:40.852068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721fb1d-97f4-4df2-915c-53fffb0979d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:40.852718 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721fb1d-97f4-4df2-915c-53fffb0979d4 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:40.852997 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721fb1d-97f4-4df2-915c-53fffb0979d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:40.853278 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721fb1d-97f4-4df2-915c-53fffb0979d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:40.854093 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721fb1d-97f4-4df2-915c-53fffb0979d4 None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.domain.id=default, user.id=06642583007748d2a52d59e585d12052) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:40.854401 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721fb1d-97f4-4df2-915c-53fffb0979d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:40.855878 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721fb1d-97f4-4df2-915c-53fffb0979d4 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:40.861372 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 27/56] 10.222.0.52 () {56 vars in 1322 bytes} [Tue Mar 8 11:40:40 2022] GET /identity/v3/role_assignments?user.id=06642583007748d2a52d59e585d12052&scope.domain.id=default&role.id=c2642d38bc964424a5edc330e0d4471d => generated 530 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:40.921920 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca19a1-333f-4360-a691-cb44a4347e81 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:40.957396 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67186bff-498e-44bc-a4ac-003c43d11480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:40.958066 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186bff-498e-44bc-a4ac-003c43d11480 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:40.958350 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186bff-498e-44bc-a4ac-003c43d11480 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:40.958627 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186bff-498e-44bc-a4ac-003c43d11480 None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:40.959355 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67186bff-498e-44bc-a4ac-003c43d11480 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:40.960893 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67186bff-498e-44bc-a4ac-003c43d11480 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:41.087464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 30/57] 10.222.0.52 () {60 vars in 1140 bytes} [Tue Mar 8 11:40:40 2022] POST /identity/v3/projects => generated 298 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 11:40:43.396504 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3ed7c-7860-4dfc-9d5c-07bbb127c71d None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:43.397008 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3ed7c-7860-4dfc-9d5c-07bbb127c71d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:43.397091 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3ed7c-7860-4dfc-9d5c-07bbb127c71d None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:43.399439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 28/58] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:43.404548 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1c238-41cc-45ff-9c02-4dfc865a5f3b None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:43.404918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1c238-41cc-45ff-9c02-4dfc865a5f3b None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:43.405107 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1c238-41cc-45ff-9c02-4dfc865a5f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:43.422407 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-71c1c238-41cc-45ff-9c02-4dfc865a5f3b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:43.423606 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-71c1c238-41cc-45ff-9c02-4dfc865a5f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:43.485096 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 31/59] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:43.509179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3ed7c-7860-4dfc-9d5c-07bbb127c71d None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:43.608295 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3ed7c-7860-4dfc-9d5c-07bbb127c71d None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:43.642459 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaad3ec-7236-4034-a376-5037be80fdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:43.643256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaad3ec-7236-4034-a376-5037be80fdd8 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:43.643589 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaad3ec-7236-4034-a376-5037be80fdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:43.643874 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaad3ec-7236-4034-a376-5037be80fdd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:43.645069 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaad3ec-7236-4034-a376-5037be80fdd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:43.646542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaad3ec-7236-4034-a376-5037be80fdd8 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:43.648201 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 29/60] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:40:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:43.654431 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1c238-41cc-45ff-9c02-4dfc865a5f3b None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:43.745933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1c238-41cc-45ff-9c02-4dfc865a5f3b None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:43.777157 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeaee91-f36e-4571-9f83-4d6b0c87a87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:43.777811 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaee91-f36e-4571-9f83-4d6b0c87a87d None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:43.778094 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaee91-f36e-4571-9f83-4d6b0c87a87d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:43.778370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaee91-f36e-4571-9f83-4d6b0c87a87d None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:43.779068 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeaee91-f36e-4571-9f83-4d6b0c87a87d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:43.780808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeaee91-f36e-4571-9f83-4d6b0c87a87d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:43.890054 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 32/61] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:40:43 2022] POST /identity/v3/users => generated 275 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:40:47.471448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e5498-7419-4cb8-b9d2-186e9086f8d5 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:47.472463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e5498-7419-4cb8-b9d2-186e9086f8d5 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:47.472978 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e5498-7419-4cb8-b9d2-186e9086f8d5 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:47.474980 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 30/62] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:47.479608 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ecde3-9517-45b4-ae9b-59b0d8f95c7b None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:47.480578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ecde3-9517-45b4-ae9b-59b0d8f95c7b None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:47.481074 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ecde3-9517-45b4-ae9b-59b0d8f95c7b None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:47.483181 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 33/63] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:47.487635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bdb40-3cb9-4d90-8e2e-1adfd0968218 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:47.488275 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bdb40-3cb9-4d90-8e2e-1adfd0968218 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:47.488774 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bdb40-3cb9-4d90-8e2e-1adfd0968218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:47.491873 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed3c14-f086-4e51-8eac-27e5b2e08df8 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:47.493538 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed3c14-f086-4e51-8eac-27e5b2e08df8 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:47.494585 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed3c14-f086-4e51-8eac-27e5b2e08df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:47.523854 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-a40bdb40-3cb9-4d90-8e2e-1adfd0968218 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:47.525483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a40bdb40-3cb9-4d90-8e2e-1adfd0968218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:47.529292 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-10ed3c14-f086-4e51-8eac-27e5b2e08df8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:47.529820 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-10ed3c14-f086-4e51-8eac-27e5b2e08df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:47.636638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 34/64] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:47.638495 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 31/65] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:40:47.660265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed3c14-f086-4e51-8eac-27e5b2e08df8 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:47.676847 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bdb40-3cb9-4d90-8e2e-1adfd0968218 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:47.768576 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed3c14-f086-4e51-8eac-27e5b2e08df8 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:47.805477 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bea12-1a85-4415-8299-db2a1882c5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:47.806571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bea12-1a85-4415-8299-db2a1882c5ba None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:47.807006 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bea12-1a85-4415-8299-db2a1882c5ba None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:47.807441 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bea12-1a85-4415-8299-db2a1882c5ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:47.815940 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bdb40-3cb9-4d90-8e2e-1adfd0968218 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:47.818432 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bea12-1a85-4415-8299-db2a1882c5ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:40:47.826499 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-fe9bea12-1a85-4415-8299-db2a1882c5ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:40:47.828158 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 35/66] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:40:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:40:47.829605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d7179-83cd-429e-b2c5-388c2179bd47 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:47.830097 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d7179-83cd-429e-b2c5-388c2179bd47 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:47.830598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d7179-83cd-429e-b2c5-388c2179bd47 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:47.832792 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 36/67] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:47.833788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d7179-83cd-429e-b2c5-388c2179bd47 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:47.863342 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e240c-fb11-4e1d-a054-d8b13786a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:47.864180 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e240c-fb11-4e1d-a054-d8b13786a392 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:47.864466 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e240c-fb11-4e1d-a054-d8b13786a392 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:47.864738 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e240c-fb11-4e1d-a054-d8b13786a392 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:47.875096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e240c-fb11-4e1d-a054-d8b13786a392 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:40:47.881951 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-7d6e240c-fb11-4e1d-a054-d8b13786a392 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:40:47.884114 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 32/68] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:40:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:40:47.885199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de97b9-36fb-4485-997b-f6c15df8918c None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:47.885703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de97b9-36fb-4485-997b-f6c15df8918c None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:47.886197 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de97b9-36fb-4485-997b-f6c15df8918c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:47.906895 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-81de97b9-36fb-4485-997b-f6c15df8918c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:47.908092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-81de97b9-36fb-4485-997b-f6c15df8918c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:47.940635 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d7179-83cd-429e-b2c5-388c2179bd47 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:47.972696 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 33/69] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:47.973261 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f45d8f-308d-4df9-a08c-76b68ca87cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:47.973935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f45d8f-308d-4df9-a08c-76b68ca87cd3 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:47.974041 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e2229-902d-4363-aa65-8ed1bb7fd643 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:47.974227 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f45d8f-308d-4df9-a08c-76b68ca87cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:47.974334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e2229-902d-4363-aa65-8ed1bb7fd643 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:47.974496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f45d8f-308d-4df9-a08c-76b68ca87cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:47.974594 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e2229-902d-4363-aa65-8ed1bb7fd643 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:47.975242 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f45d8f-308d-4df9-a08c-76b68ca87cd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:47.975570 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f45d8f-308d-4df9-a08c-76b68ca87cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:47.976462 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 34/70] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:47.976984 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f45d8f-308d-4df9-a08c-76b68ca87cd3 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:47.977172 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e2229-902d-4363-aa65-8ed1bb7fd643 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:47.990201 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 37/71] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:40:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:47.991566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f988b8-b7f2-41ae-8cdc-e5b172459a8e None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:47.992126 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f988b8-b7f2-41ae-8cdc-e5b172459a8e None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:47.992599 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f988b8-b7f2-41ae-8cdc-e5b172459a8e None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:47.994534 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 38/72] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:47.995831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44be3b8-9bb4-485d-a0c2-a130dd855d87 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:47.996310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44be3b8-9bb4-485d-a0c2-a130dd855d87 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:47.996797 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44be3b8-9bb4-485d-a0c2-a130dd855d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:48.014500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-a44be3b8-9bb4-485d-a0c2-a130dd855d87 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:48.015739 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a44be3b8-9bb4-485d-a0c2-a130dd855d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:48.077273 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e2229-902d-4363-aa65-8ed1bb7fd643 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:48.078782 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 39/73] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:48.080779 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44be3b8-9bb4-485d-a0c2-a130dd855d87 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:48.112230 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bf1a6-f6d4-4c28-b6cf-5c55d88f93e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:48.112907 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bf1a6-f6d4-4c28-b6cf-5c55d88f93e7 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:48.113191 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bf1a6-f6d4-4c28-b6cf-5c55d88f93e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:48.113476 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bf1a6-f6d4-4c28-b6cf-5c55d88f93e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:48.114222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bf1a6-f6d4-4c28-b6cf-5c55d88f93e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:48.114532 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bf1a6-f6d4-4c28-b6cf-5c55d88f93e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:48.115950 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bf1a6-f6d4-4c28-b6cf-5c55d88f93e7 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:48.123892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 35/74] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:40:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:48.124678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bf1a6-f6d4-4c28-b6cf-5c55d88f93e7 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:48.175733 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44be3b8-9bb4-485d-a0c2-a130dd855d87 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:48.208485 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8a18b-4234-4da9-aa05-e5a501c8892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:48.209359 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8a18b-4234-4da9-aa05-e5a501c8892d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:48.209643 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8a18b-4234-4da9-aa05-e5a501c8892d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:48.209919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8a18b-4234-4da9-aa05-e5a501c8892d None admin] PATH_INFO: `/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:48.219781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bf1a6-f6d4-4c28-b6cf-5c55d88f93e7 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:48.224948 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8a18b-4234-4da9-aa05-e5a501c8892d None admin] RBAC: Authorizing `identity:get_user(user_id=c4ec2b31f8a2478ca85a8e4a0973fdc6)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:48.226955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8a18b-4234-4da9-aa05-e5a501c8892d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:48.228721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 40/75] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:40:48 2022] GET /identity/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:48.229981 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcdd80-18f3-40da-90bb-b1966f6e8e53 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:48.230277 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcdd80-18f3-40da-90bb-b1966f6e8e53 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:48.230561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcdd80-18f3-40da-90bb-b1966f6e8e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:48.247030 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-0cfcdd80-18f3-40da-90bb-b1966f6e8e53 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:48.248260 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0cfcdd80-18f3-40da-90bb-b1966f6e8e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:48.252463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a73a35-ac13-45ab-986a-5390baf75032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:48.253265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a73a35-ac13-45ab-986a-5390baf75032 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:48.253550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a73a35-ac13-45ab-986a-5390baf75032 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:48.253828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a73a35-ac13-45ab-986a-5390baf75032 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:48.263429 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a73a35-ac13-45ab-986a-5390baf75032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:40:48.270524 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-89a73a35-ac13-45ab-986a-5390baf75032 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 11:40:48.271723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 36/76] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:40:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:40:48.272483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a73a35-ac13-45ab-986a-5390baf75032 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:48.311490 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 41/77] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:48.312348 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcdd80-18f3-40da-90bb-b1966f6e8e53 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:48.375456 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a73a35-ac13-45ab-986a-5390baf75032 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:48.407537 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcdd80-18f3-40da-90bb-b1966f6e8e53 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:48.407751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2795e-4ae4-444e-ae5e-61a19ff8e7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:48.408542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2795e-4ae4-444e-ae5e-61a19ff8e7ab None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:48.408825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2795e-4ae4-444e-ae5e-61a19ff8e7ab None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:48.409104 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2795e-4ae4-444e-ae5e-61a19ff8e7ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:48.419383 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2795e-4ae4-444e-ae5e-61a19ff8e7ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:40:48.426301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-9db2795e-4ae4-444e-ae5e-61a19ff8e7ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:40:48.427493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 37/78] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:40:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:40:48.428835 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2795e-4ae4-444e-ae5e-61a19ff8e7ab None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:48.442013 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbac716-b6f9-448f-8ac6-a06443319e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:48.442896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbac716-b6f9-448f-8ac6-a06443319e9d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:48.443181 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbac716-b6f9-448f-8ac6-a06443319e9d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:48.443464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbac716-b6f9-448f-8ac6-a06443319e9d None admin] PATH_INFO: `/v3/users/06642583007748d2a52d59e585d12052` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:48.444706 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbac716-b6f9-448f-8ac6-a06443319e9d None admin] RBAC: Authorizing `identity:get_user(user_id=06642583007748d2a52d59e585d12052)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:48.446461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbac716-b6f9-448f-8ac6-a06443319e9d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:48.448102 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 42/79] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:40:48 2022] GET /identity/v3/users/06642583007748d2a52d59e585d12052 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:48.448869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbac716-b6f9-448f-8ac6-a06443319e9d None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:48.524189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2795e-4ae4-444e-ae5e-61a19ff8e7ab None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:48.541553 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbac716-b6f9-448f-8ac6-a06443319e9d None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:48.557285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf088b-2aa8-4252-8b4d-6e4bf950ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:48.557942 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf088b-2aa8-4252-8b4d-6e4bf950ef96 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:48.558231 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf088b-2aa8-4252-8b4d-6e4bf950ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:48.558514 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf088b-2aa8-4252-8b4d-6e4bf950ef96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:48.573232 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f226165-9c04-44fa-81ad-2959042b70af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:48.573904 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f226165-9c04-44fa-81ad-2959042b70af None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:48.574208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f226165-9c04-44fa-81ad-2959042b70af None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:48.574474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f226165-9c04-44fa-81ad-2959042b70af None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:48.575218 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f226165-9c04-44fa-81ad-2959042b70af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:48.575542 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f226165-9c04-44fa-81ad-2959042b70af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:48.576956 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f226165-9c04-44fa-81ad-2959042b70af None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:48.584646 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 43/80] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:40:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:48.585427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f226165-9c04-44fa-81ad-2959042b70af None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:48.624716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf088b-2aa8-4252-8b4d-6e4bf950ef96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:48.626255 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf088b-2aa8-4252-8b4d-6e4bf950ef96 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:48.680710 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f226165-9c04-44fa-81ad-2959042b70af None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:48.712578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368b246-3395-49d2-bd76-d49fea25c94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:48.713369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368b246-3395-49d2-bd76-d49fea25c94b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:48.713662 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368b246-3395-49d2-bd76-d49fea25c94b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:48.713931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368b246-3395-49d2-bd76-d49fea25c94b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:48.715110 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368b246-3395-49d2-bd76-d49fea25c94b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:48.716590 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368b246-3395-49d2-bd76-d49fea25c94b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:48.718413 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 44/81] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:40:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:48.718961 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368b246-3395-49d2-bd76-d49fea25c94b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:48.730461 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 38/82] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:40:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:40:48.730461 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf088b-2aa8-4252-8b4d-6e4bf950ef96 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:48.815061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368b246-3395-49d2-bd76-d49fea25c94b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:48.818274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf088b-2aa8-4252-8b4d-6e4bf950ef96 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:48.847207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803989a-0d93-4453-849a-e3b42938e6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:48.847896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803989a-0d93-4453-849a-e3b42938e6ea None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:48.848185 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803989a-0d93-4453-849a-e3b42938e6ea None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:48.848466 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803989a-0d93-4453-849a-e3b42938e6ea None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:48.849206 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803989a-0d93-4453-849a-e3b42938e6ea None admin] RBAC: Adding query filter params (name=member) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:48.849520 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803989a-0d93-4453-849a-e3b42938e6ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:48.850397 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea43fea-74fa-4cae-acb0-1fcc8a06ef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:48.850889 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803989a-0d93-4453-849a-e3b42938e6ea None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:48.851034 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea43fea-74fa-4cae-acb0-1fcc8a06ef42 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:48.851404 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea43fea-74fa-4cae-acb0-1fcc8a06ef42 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:48.851720 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea43fea-74fa-4cae-acb0-1fcc8a06ef42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:48.858640 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 45/83] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:40:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:48.859427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803989a-0d93-4453-849a-e3b42938e6ea None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:48.914476 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea43fea-74fa-4cae-acb0-1fcc8a06ef42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:48.915899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea43fea-74fa-4cae-acb0-1fcc8a06ef42 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:48.951012 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803989a-0d93-4453-849a-e3b42938e6ea None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:48.982270 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a012500-77cd-4010-9322-3b0c8845ddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:48.983134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a012500-77cd-4010-9322-3b0c8845ddb7 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:48.983415 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a012500-77cd-4010-9322-3b0c8845ddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:48.983718 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a012500-77cd-4010-9322-3b0c8845ddb7 None admin] PATH_INFO: `/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:48.984904 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a012500-77cd-4010-9322-3b0c8845ddb7 None admin] RBAC: Authorizing `identity:get_user(user_id=c4ec2b31f8a2478ca85a8e4a0973fdc6)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:48.986332 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a012500-77cd-4010-9322-3b0c8845ddb7 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:48.988218 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 46/84] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:40:48 2022] GET /identity/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6 => generated 275 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:48.988846 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a012500-77cd-4010-9322-3b0c8845ddb7 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:49.008804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 39/85] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:40:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:40:49.009651 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea43fea-74fa-4cae-acb0-1fcc8a06ef42 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:49.082719 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a012500-77cd-4010-9322-3b0c8845ddb7 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:49.104671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea43fea-74fa-4cae-acb0-1fcc8a06ef42 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:49.113880 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c42f7e-b259-4052-81d0-3eb3e745d82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:49.114552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c42f7e-b259-4052-81d0-3eb3e745d82a None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:49.114839 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c42f7e-b259-4052-81d0-3eb3e745d82a None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:49.115120 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c42f7e-b259-4052-81d0-3eb3e745d82a None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:49.115864 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c42f7e-b259-4052-81d0-3eb3e745d82a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:49.117837 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c42f7e-b259-4052-81d0-3eb3e745d82a None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:49.137828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f588fde-3efe-4347-b08d-eab10ce314bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:49.149901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f588fde-3efe-4347-b08d-eab10ce314bd None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:49.149901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f588fde-3efe-4347-b08d-eab10ce314bd None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:49.149901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f588fde-3efe-4347-b08d-eab10ce314bd None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:49.149901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f588fde-3efe-4347-b08d-eab10ce314bd None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:49.149901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f588fde-3efe-4347-b08d-eab10ce314bd None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:49.149901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 40/86] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:40:49 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:49.150339 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f588fde-3efe-4347-b08d-eab10ce314bd None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:49.196099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 47/87] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:40:48 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:40:49.196945 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c42f7e-b259-4052-81d0-3eb3e745d82a None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:49.257650 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f588fde-3efe-4347-b08d-eab10ce314bd None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:49.294665 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1286e-402d-45e1-9f2a-2dc8bbc81c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:49.295592 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1286e-402d-45e1-9f2a-2dc8bbc81c1b None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:49.295885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1286e-402d-45e1-9f2a-2dc8bbc81c1b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:49.296166 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1286e-402d-45e1-9f2a-2dc8bbc81c1b None admin] PATH_INFO: `/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:49.297463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1286e-402d-45e1-9f2a-2dc8bbc81c1b None admin] RBAC: Authorizing `identity:get_user(user_id=c4ec2b31f8a2478ca85a8e4a0973fdc6)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:49.298927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1286e-402d-45e1-9f2a-2dc8bbc81c1b None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:49.306024 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 41/88] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:40:49 2022] GET /identity/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:49.306024 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1286e-402d-45e1-9f2a-2dc8bbc81c1b None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:49.311881 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c42f7e-b259-4052-81d0-3eb3e745d82a None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:49.349111 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8449bc-55c9-4fb1-bc71-bd60abb6d1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:49.349796 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8449bc-55c9-4fb1-bc71-bd60abb6d1d5 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:49.350087 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8449bc-55c9-4fb1-bc71-bd60abb6d1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:49.350370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8449bc-55c9-4fb1-bc71-bd60abb6d1d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:49.409230 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1286e-402d-45e1-9f2a-2dc8bbc81c1b None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:49.431198 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8449bc-55c9-4fb1-bc71-bd60abb6d1d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:49.432726 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8449bc-55c9-4fb1-bc71-bd60abb6d1d5 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:49.447445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93fd3f-40de-49af-8e36-f075c1ae032f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:49.448362 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93fd3f-40de-49af-8e36-f075c1ae032f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:49.448678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93fd3f-40de-49af-8e36-f075c1ae032f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:49.448979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93fd3f-40de-49af-8e36-f075c1ae032f None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:49.450286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93fd3f-40de-49af-8e36-f075c1ae032f None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:49.451946 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93fd3f-40de-49af-8e36-f075c1ae032f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:49.454326 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 42/89] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:40:49 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:49.455745 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93fd3f-40de-49af-8e36-f075c1ae032f None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:49.542111 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 48/90] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:40:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:40:49.543102 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8449bc-55c9-4fb1-bc71-bd60abb6d1d5 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:49.563827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93fd3f-40de-49af-8e36-f075c1ae032f None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:49.609142 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113c1e6-ad29-46a1-88b4-cabb1e26f7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:49.609812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113c1e6-ad29-46a1-88b4-cabb1e26f7ce None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:49.610102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113c1e6-ad29-46a1-88b4-cabb1e26f7ce None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:49.610383 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113c1e6-ad29-46a1-88b4-cabb1e26f7ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:49.611702 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113c1e6-ad29-46a1-88b4-cabb1e26f7ce None admin] RBAC: Adding query filter params (role.id=54b3d96f6c9d4d3cbf19a6f0663ba935, scope.project.id=2795ff37998c454597b382c5096edefd, user.id=c4ec2b31f8a2478ca85a8e4a0973fdc6) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:49.612030 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113c1e6-ad29-46a1-88b4-cabb1e26f7ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:49.613751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113c1e6-ad29-46a1-88b4-cabb1e26f7ce None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:49.621778 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 43/91] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:40:49 2022] GET /identity/v3/role_assignments?user.id=c4ec2b31f8a2478ca85a8e4a0973fdc6&scope.project.id=2795ff37998c454597b382c5096edefd&role.id=54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:49.622699 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113c1e6-ad29-46a1-88b4-cabb1e26f7ce None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:49.652838 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8449bc-55c9-4fb1-bc71-bd60abb6d1d5 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:49.689827 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85af54-faa9-4707-827d-21f4c8fe282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:49.690954 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85af54-faa9-4707-827d-21f4c8fe282f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:49.691443 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85af54-faa9-4707-827d-21f4c8fe282f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:49.691970 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85af54-faa9-4707-827d-21f4c8fe282f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:49.746279 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113c1e6-ad29-46a1-88b4-cabb1e26f7ce None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:49.779659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85af54-faa9-4707-827d-21f4c8fe282f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:49.781447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85af54-faa9-4707-827d-21f4c8fe282f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:49.782561 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af42fd-0e7e-4426-95e0-35fc08855d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:49.783474 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af42fd-0e7e-4426-95e0-35fc08855d4a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:49.784043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af42fd-0e7e-4426-95e0-35fc08855d4a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:49.784517 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af42fd-0e7e-4426-95e0-35fc08855d4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:49.785584 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af42fd-0e7e-4426-95e0-35fc08855d4a None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=2795ff37998c454597b382c5096edefd, user.id=06642583007748d2a52d59e585d12052) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:49.786102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af42fd-0e7e-4426-95e0-35fc08855d4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:49.787976 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af42fd-0e7e-4426-95e0-35fc08855d4a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:49.805662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 44/92] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:40:49 2022] GET /identity/v3/role_assignments?user.id=06642583007748d2a52d59e585d12052&scope.project.id=2795ff37998c454597b382c5096edefd&role.id=c2642d38bc964424a5edc330e0d4471d => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:49.807041 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af42fd-0e7e-4426-95e0-35fc08855d4a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:49.897236 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 49/93] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:40:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:40:49.904732 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85af54-faa9-4707-827d-21f4c8fe282f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:50.031820 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85af54-faa9-4707-827d-21f4c8fe282f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:50.061607 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af42fd-0e7e-4426-95e0-35fc08855d4a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:50.067106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453ba56-d335-4973-81de-0ded0b07d4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:50.067106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453ba56-d335-4973-81de-0ded0b07d4f8 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:50.067106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453ba56-d335-4973-81de-0ded0b07d4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:50.067106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453ba56-d335-4973-81de-0ded0b07d4f8 None admin] PATH_INFO: `/v3/projects/c648e44872024842bcc0e4cd7d94efc7` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:50.071161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453ba56-d335-4973-81de-0ded0b07d4f8 None admin] RBAC: Authorizing `identity:get_project(project_id=c648e44872024842bcc0e4cd7d94efc7)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:50.071161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453ba56-d335-4973-81de-0ded0b07d4f8 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:50.072449 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 50/94] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:40:49 2022] GET /identity/v3/projects/c648e44872024842bcc0e4cd7d94efc7 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:50.078574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453ba56-d335-4973-81de-0ded0b07d4f8 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:50.156231 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc5992-a532-4d6a-9a7b-686ede0904df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:50.157360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc5992-a532-4d6a-9a7b-686ede0904df None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:50.157793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc5992-a532-4d6a-9a7b-686ede0904df None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:50.158245 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc5992-a532-4d6a-9a7b-686ede0904df None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:50.159670 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc5992-a532-4d6a-9a7b-686ede0904df None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:50.161287 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc5992-a532-4d6a-9a7b-686ede0904df None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:50.163143 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 45/95] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:40:49 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:50.169460 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc5992-a532-4d6a-9a7b-686ede0904df None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:50.203826 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453ba56-d335-4973-81de-0ded0b07d4f8 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:50.252244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a16ece-c304-465b-9874-36c205b80778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:50.252936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a16ece-c304-465b-9874-36c205b80778 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:50.253225 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a16ece-c304-465b-9874-36c205b80778 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:50.253511 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a16ece-c304-465b-9874-36c205b80778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:50.254355 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a16ece-c304-465b-9874-36c205b80778 None admin] RBAC: Adding query filter params (role.id=54b3d96f6c9d4d3cbf19a6f0663ba935, scope.project.id=c648e44872024842bcc0e4cd7d94efc7, user.id=c4ec2b31f8a2478ca85a8e4a0973fdc6) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:50.254671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a16ece-c304-465b-9874-36c205b80778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:50.256213 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a16ece-c304-465b-9874-36c205b80778 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:50.269754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 51/96] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:40:50 2022] GET /identity/v3/role_assignments?user.id=c4ec2b31f8a2478ca85a8e4a0973fdc6&scope.project.id=c648e44872024842bcc0e4cd7d94efc7&role.id=54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:50.352856 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc5992-a532-4d6a-9a7b-686ede0904df None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:50.405607 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b7d68-3328-4621-9b79-68ce072caad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:50.406658 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b7d68-3328-4621-9b79-68ce072caad6 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:50.407170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b7d68-3328-4621-9b79-68ce072caad6 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:50.407785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b7d68-3328-4621-9b79-68ce072caad6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:50.408826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b7d68-3328-4621-9b79-68ce072caad6 None admin] RBAC: Adding query filter params (role.id=2ca014d08f26466b980433e75e765505, scope.project.id=2795ff37998c454597b382c5096edefd, user.id=c4ec2b31f8a2478ca85a8e4a0973fdc6) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:50.409358 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b7d68-3328-4621-9b79-68ce072caad6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:50.411034 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b7d68-3328-4621-9b79-68ce072caad6 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:50.420256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 46/97] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:40:50 2022] GET /identity/v3/role_assignments?user.id=c4ec2b31f8a2478ca85a8e4a0973fdc6&scope.project.id=2795ff37998c454597b382c5096edefd&role.id=2ca014d08f26466b980433e75e765505 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:52.488169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f15adf-e8d0-4ff5-b6cd-1ee180ab2fd3 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:52.488734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f15adf-e8d0-4ff5-b6cd-1ee180ab2fd3 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:52.488734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f15adf-e8d0-4ff5-b6cd-1ee180ab2fd3 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:52.490461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 52/98] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:52.496272 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620af6f3-3306-4868-af80-4d265d16f878 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:52.497041 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620af6f3-3306-4868-af80-4d265d16f878 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:52.497483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620af6f3-3306-4868-af80-4d265d16f878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:52.524618 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-620af6f3-3306-4868-af80-4d265d16f878 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:52.526154 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-620af6f3-3306-4868-af80-4d265d16f878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:52.618774 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 47/99] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:52.673005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f15adf-e8d0-4ff5-b6cd-1ee180ab2fd3 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:52.733940 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835da40-cba3-42d7-bb0d-cf9174e4bbe8 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:52.734271 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835da40-cba3-42d7-bb0d-cf9174e4bbe8 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:52.734503 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835da40-cba3-42d7-bb0d-cf9174e4bbe8 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:52.736579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 48/100] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:40:52.742879 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15437484-cac4-4ed0-8213-10f9237e71b0 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:52.743445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15437484-cac4-4ed0-8213-10f9237e71b0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:52.743975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15437484-cac4-4ed0-8213-10f9237e71b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:52.788679 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-15437484-cac4-4ed0-8213-10f9237e71b0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:52.790730 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-15437484-cac4-4ed0-8213-10f9237e71b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:52.793560 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f15adf-e8d0-4ff5-b6cd-1ee180ab2fd3 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:52.869994 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba490a6c-4afc-4177-8941-91b41027895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:52.870815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba490a6c-4afc-4177-8941-91b41027895c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:52.871105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba490a6c-4afc-4177-8941-91b41027895c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:52.871385 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba490a6c-4afc-4177-8941-91b41027895c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:52.873468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba490a6c-4afc-4177-8941-91b41027895c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:52.874960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba490a6c-4afc-4177-8941-91b41027895c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:52.876734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 53/101] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:40:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:52.880446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a81c2c-4a34-439e-b265-31cf6c5382b2 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:52.880446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a81c2c-4a34-439e-b265-31cf6c5382b2 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:52.880446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a81c2c-4a34-439e-b265-31cf6c5382b2 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:52.880446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 54/102] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:52.886157 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a81c2c-4a34-439e-b265-31cf6c5382b2 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:52.953845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 49/103] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:40:52.955586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ccbfd-8479-40d2-b1db-3595ce56956f None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:52.956118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ccbfd-8479-40d2-b1db-3595ce56956f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:52.956602 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ccbfd-8479-40d2-b1db-3595ce56956f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:53.002454 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-704ccbfd-8479-40d2-b1db-3595ce56956f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:53.004008 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-704ccbfd-8479-40d2-b1db-3595ce56956f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:53.013333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a81c2c-4a34-439e-b265-31cf6c5382b2 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:53.069068 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d4683-2657-4eb1-a982-749d6a908dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:53.069768 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d4683-2657-4eb1-a982-749d6a908dbf None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:53.070822 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d4683-2657-4eb1-a982-749d6a908dbf None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:53.071135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d4683-2657-4eb1-a982-749d6a908dbf None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:53.071883 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d4683-2657-4eb1-a982-749d6a908dbf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:53.073361 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d4683-2657-4eb1-a982-749d6a908dbf None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:53.120988 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 50/104] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:53.121953 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ccbfd-8479-40d2-b1db-3595ce56956f None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:53.184789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 55/105] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 11:40:52 2022] POST /identity/v3/projects => generated 302 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:40:53.185693 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d4683-2657-4eb1-a982-749d6a908dbf None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:53.304284 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ccbfd-8479-40d2-b1db-3595ce56956f None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:53.373844 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc334591-80ed-4e18-88c9-023033620f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:53.374914 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc334591-80ed-4e18-88c9-023033620f4f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:53.375369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc334591-80ed-4e18-88c9-023033620f4f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:53.375813 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc334591-80ed-4e18-88c9-023033620f4f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:53.387760 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc334591-80ed-4e18-88c9-023033620f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:40:53.395099 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-bc334591-80ed-4e18-88c9-023033620f4f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 11:40:53.396987 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 51/106] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:40:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:40:53.401289 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d4683-2657-4eb1-a982-749d6a908dbf None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:53.403736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc334591-80ed-4e18-88c9-023033620f4f None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:53.461683 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5700d46-315d-430f-97f2-03aa0928a103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:53.462955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5700d46-315d-430f-97f2-03aa0928a103 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:53.463247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5700d46-315d-430f-97f2-03aa0928a103 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:53.463559 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5700d46-315d-430f-97f2-03aa0928a103 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:53.478909 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5700d46-315d-430f-97f2-03aa0928a103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:40:53.487369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-c5700d46-315d-430f-97f2-03aa0928a103 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:40:53.489217 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 56/107] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:40:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:40:53.496444 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5700d46-315d-430f-97f2-03aa0928a103 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:53.516857 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc334591-80ed-4e18-88c9-023033620f4f None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:53.553013 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f057b71-fd18-4da7-baf8-bcd4f6be552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:53.554102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f057b71-fd18-4da7-baf8-bcd4f6be552b None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:53.555291 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f057b71-fd18-4da7-baf8-bcd4f6be552b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:53.555816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f057b71-fd18-4da7-baf8-bcd4f6be552b None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:53.556881 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f057b71-fd18-4da7-baf8-bcd4f6be552b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:53.557413 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f057b71-fd18-4da7-baf8-bcd4f6be552b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:53.559067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f057b71-fd18-4da7-baf8-bcd4f6be552b None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:53.568972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 52/108] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:40:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:53.579937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f057b71-fd18-4da7-baf8-bcd4f6be552b None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:53.683036 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5700d46-315d-430f-97f2-03aa0928a103 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:53.728750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3f017-bc0e-4ff4-b263-35762d20d395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:53.729448 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3f017-bc0e-4ff4-b263-35762d20d395 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:53.729737 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3f017-bc0e-4ff4-b263-35762d20d395 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:53.730023 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3f017-bc0e-4ff4-b263-35762d20d395 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:53.730789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3f017-bc0e-4ff4-b263-35762d20d395 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:53.731103 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3f017-bc0e-4ff4-b263-35762d20d395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:53.733904 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3f017-bc0e-4ff4-b263-35762d20d395 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:53.746593 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 57/109] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:40:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:53.747822 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42416aab-c696-4973-ac06-b0a961858647 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:53.748097 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42416aab-c696-4973-ac06-b0a961858647 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:53.748380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42416aab-c696-4973-ac06-b0a961858647 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:53.750041 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 58/110] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:53.761374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42416aab-c696-4973-ac06-b0a961858647 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:53.797744 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f057b71-fd18-4da7-baf8-bcd4f6be552b None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:53.876042 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42416aab-c696-4973-ac06-b0a961858647 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:53.893144 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f525d6-323d-4e5c-95f1-03de33d63ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:53.894044 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f525d6-323d-4e5c-95f1-03de33d63ac9 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:53.894334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f525d6-323d-4e5c-95f1-03de33d63ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:53.894625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f525d6-323d-4e5c-95f1-03de33d63ac9 None admin] PATH_INFO: `/v3/users/00ef4ef0cd6e4a069b3c7b9f23f5652d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:53.910170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f525d6-323d-4e5c-95f1-03de33d63ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=00ef4ef0cd6e4a069b3c7b9f23f5652d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:53.911696 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f525d6-323d-4e5c-95f1-03de33d63ac9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:53.912664 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44663c-2ca1-4513-a183-5f00c362d818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:53.914194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44663c-2ca1-4513-a183-5f00c362d818 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:53.914308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 53/111] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:40:53 2022] GET /identity/v3/users/00ef4ef0cd6e4a069b3c7b9f23f5652d => generated 289 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:53.915677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a17bf5-46e0-4b41-9365-71eada7c8a1d None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:53.915970 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a17bf5-46e0-4b41-9365-71eada7c8a1d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:53.916251 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a17bf5-46e0-4b41-9365-71eada7c8a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:53.918870 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44663c-2ca1-4513-a183-5f00c362d818 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:53.919322 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44663c-2ca1-4513-a183-5f00c362d818 None admin] PATH_INFO: `/v3/users/06642583007748d2a52d59e585d12052` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:53.920838 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44663c-2ca1-4513-a183-5f00c362d818 None admin] RBAC: Authorizing `identity:get_user(user_id=06642583007748d2a52d59e585d12052)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:53.923535 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44663c-2ca1-4513-a183-5f00c362d818 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:53.926215 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 59/112] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:40:53 2022] GET /identity/v3/users/06642583007748d2a52d59e585d12052 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:53.928116 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07313127-333f-4820-b07f-2dfec4e4a982 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:53.928409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07313127-333f-4820-b07f-2dfec4e4a982 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:53.928693 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07313127-333f-4820-b07f-2dfec4e4a982 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:53.931233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 60/113] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:53.932044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07313127-333f-4820-b07f-2dfec4e4a982 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:53.940085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-23a17bf5-46e0-4b41-9365-71eada7c8a1d None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:53.940784 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-23a17bf5-46e0-4b41-9365-71eada7c8a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:54.009873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 54/114] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:54.010833 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a17bf5-46e0-4b41-9365-71eada7c8a1d None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:54.045961 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07313127-333f-4820-b07f-2dfec4e4a982 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:54.079958 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d909a-c273-4893-b77b-918c04910fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:54.080658 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d909a-c273-4893-b77b-918c04910fe0 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:54.080986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d909a-c273-4893-b77b-918c04910fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:54.081296 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d909a-c273-4893-b77b-918c04910fe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:54.123035 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a17bf5-46e0-4b41-9365-71eada7c8a1d None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:54.146760 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d909a-c273-4893-b77b-918c04910fe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:54.148644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d909a-c273-4893-b77b-918c04910fe0 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:54.154430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d0890-c085-4f9e-a92f-46e9311fd8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:54.155565 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d0890-c085-4f9e-a92f-46e9311fd8f0 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:54.155848 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d0890-c085-4f9e-a92f-46e9311fd8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:54.156119 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d0890-c085-4f9e-a92f-46e9311fd8f0 None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:54.157303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d0890-c085-4f9e-a92f-46e9311fd8f0 None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:54.158744 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d0890-c085-4f9e-a92f-46e9311fd8f0 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:54.160476 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 55/115] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:40:54 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:54.161619 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b7aa6-bbdc-40d3-868f-898ddbabceb7 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:54.161903 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b7aa6-bbdc-40d3-868f-898ddbabceb7 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:54.162175 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b7aa6-bbdc-40d3-868f-898ddbabceb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:54.178678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-011b7aa6-bbdc-40d3-868f-898ddbabceb7 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:54.180495 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-011b7aa6-bbdc-40d3-868f-898ddbabceb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:54.247053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 56/116] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:54.256989 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40aa4eb-6212-4347-825d-c74ccc9f8627 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:54.257492 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 61/117] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:40:54.261986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d909a-c273-4893-b77b-918c04910fe0 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:54.262604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40aa4eb-6212-4347-825d-c74ccc9f8627 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:54.263900 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40aa4eb-6212-4347-825d-c74ccc9f8627 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:54.269873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 57/118] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:54 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:54.270610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40aa4eb-6212-4347-825d-c74ccc9f8627 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:54.364464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d909a-c273-4893-b77b-918c04910fe0 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:54.370911 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40aa4eb-6212-4347-825d-c74ccc9f8627 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:54.398368 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86c36b-46a7-4c1d-91ea-a44a3b326121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:54.399097 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c36b-46a7-4c1d-91ea-a44a3b326121 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:54.399382 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c36b-46a7-4c1d-91ea-a44a3b326121 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:54.399691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c36b-46a7-4c1d-91ea-a44a3b326121 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:54.403740 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da01cd3-005d-413d-86f3-889bd190feaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:54.404889 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da01cd3-005d-413d-86f3-889bd190feaa None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:54.405172 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da01cd3-005d-413d-86f3-889bd190feaa None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:54.405454 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da01cd3-005d-413d-86f3-889bd190feaa None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd/users/06642583007748d2a52d59e585d12052/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:54.407402 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da01cd3-005d-413d-86f3-889bd190feaa None admin] RBAC: Authorizing `identity:create_grant(project_id=2795ff37998c454597b382c5096edefd, user_id=06642583007748d2a52d59e585d12052, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:54.408894 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da01cd3-005d-413d-86f3-889bd190feaa None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:54.410122 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86c36b-46a7-4c1d-91ea-a44a3b326121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:40:54.417164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-4f86c36b-46a7-4c1d-91ea-a44a3b326121 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:40:54.421954 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 62/119] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:40:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:40:54.421954 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86c36b-46a7-4c1d-91ea-a44a3b326121 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:54.473817 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 58/120] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:40:54 2022] PUT /identity/v3/projects/2795ff37998c454597b382c5096edefd/users/06642583007748d2a52d59e585d12052/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:40:54.474590 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da01cd3-005d-413d-86f3-889bd190feaa None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:54.530768 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86c36b-46a7-4c1d-91ea-a44a3b326121 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:54.567734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784081f-8bc1-442b-a907-b65965b5ec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:54.568628 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784081f-8bc1-442b-a907-b65965b5ec04 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:54.568913 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784081f-8bc1-442b-a907-b65965b5ec04 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:54.569202 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784081f-8bc1-442b-a907-b65965b5ec04 None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:54.571693 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784081f-8bc1-442b-a907-b65965b5ec04 None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:54.573231 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784081f-8bc1-442b-a907-b65965b5ec04 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:54.575240 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 63/121] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:40:54 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:54.576538 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba132b-c1ba-4f3c-809f-f56eb00c20d1 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:54.576834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba132b-c1ba-4f3c-809f-f56eb00c20d1 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:54.577117 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba132b-c1ba-4f3c-809f-f56eb00c20d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:54.593713 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da01cd3-005d-413d-86f3-889bd190feaa None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:54.595317 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-e5ba132b-c1ba-4f3c-809f-f56eb00c20d1 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:54.596682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e5ba132b-c1ba-4f3c-809f-f56eb00c20d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:54.631043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2d88b-efb3-439b-8eed-35cd866901ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:54.631944 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2d88b-efb3-439b-8eed-35cd866901ee None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:54.632822 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2d88b-efb3-439b-8eed-35cd866901ee None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:54.633167 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2d88b-efb3-439b-8eed-35cd866901ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:54.645270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2d88b-efb3-439b-8eed-35cd866901ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:40:54.652758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-28f2d88b-efb3-439b-8eed-35cd866901ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:40:54.654085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 59/122] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:40:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:40:54.655828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2d88b-efb3-439b-8eed-35cd866901ee None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:54.674686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 64/123] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:54.676030 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba132b-c1ba-4f3c-809f-f56eb00c20d1 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:54.762721 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2d88b-efb3-439b-8eed-35cd866901ee None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:54.796592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba132b-c1ba-4f3c-809f-f56eb00c20d1 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:54.798727 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af0c0c-e66d-4c22-a633-5b533990d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:54.799736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af0c0c-e66d-4c22-a633-5b533990d78f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:54.800281 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af0c0c-e66d-4c22-a633-5b533990d78f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:54.800755 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af0c0c-e66d-4c22-a633-5b533990d78f None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:54.801690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af0c0c-e66d-4c22-a633-5b533990d78f None admin] RBAC: Adding query filter params (name=member) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:54.802207 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af0c0c-e66d-4c22-a633-5b533990d78f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:54.803838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af0c0c-e66d-4c22-a633-5b533990d78f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:54.813986 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 60/124] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:40:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:54.815199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af0c0c-e66d-4c22-a633-5b533990d78f None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:54.836688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09880132-4275-4d91-aa0f-a07744834e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:54.837362 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09880132-4275-4d91-aa0f-a07744834e8c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:54.837646 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09880132-4275-4d91-aa0f-a07744834e8c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:54.837925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09880132-4275-4d91-aa0f-a07744834e8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:54.839194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09880132-4275-4d91-aa0f-a07744834e8c None admin] RBAC: Adding query filter params (role.id=79b8f7dbdec64d1fb686ae3346c01e46, scope.project.id=2795ff37998c454597b382c5096edefd, user.id=00ef4ef0cd6e4a069b3c7b9f23f5652d) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:54.839513 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09880132-4275-4d91-aa0f-a07744834e8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:54.841248 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09880132-4275-4d91-aa0f-a07744834e8c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:54.848875 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 65/125] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:40:54 2022] GET /identity/v3/role_assignments?user.id=00ef4ef0cd6e4a069b3c7b9f23f5652d&scope.project.id=2795ff37998c454597b382c5096edefd&role.id=79b8f7dbdec64d1fb686ae3346c01e46 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:54.849676 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09880132-4275-4d91-aa0f-a07744834e8c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:54.930978 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af0c0c-e66d-4c22-a633-5b533990d78f None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:54.965823 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51477546-9540-494e-89be-8f58a8a93e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:54.966899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477546-9540-494e-89be-8f58a8a93e8b None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:54.967400 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477546-9540-494e-89be-8f58a8a93e8b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:54.967905 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477546-9540-494e-89be-8f58a8a93e8b None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:54.968965 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51477546-9540-494e-89be-8f58a8a93e8b None admin] RBAC: Adding query filter params (name=member) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:54.969478 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51477546-9540-494e-89be-8f58a8a93e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:54.971099 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51477546-9540-494e-89be-8f58a8a93e8b None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:54.983929 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 61/126] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:40:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:54.985194 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51477546-9540-494e-89be-8f58a8a93e8b None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:55.025946 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09880132-4275-4d91-aa0f-a07744834e8c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:55.086406 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57194142-df77-478c-a948-b76105e706ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:55.086639 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57194142-df77-478c-a948-b76105e706ae None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:55.086841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57194142-df77-478c-a948-b76105e706ae None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:55.087121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57194142-df77-478c-a948-b76105e706ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:55.097382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51477546-9540-494e-89be-8f58a8a93e8b None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:55.108910 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57194142-df77-478c-a948-b76105e706ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:40:55.124725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-57194142-df77-478c-a948-b76105e706ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 11:40:55.126001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 66/127] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:40:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:40:55.126929 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57194142-df77-478c-a948-b76105e706ae None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:55.134987 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bf360-451b-4b9c-9389-e052a30ad978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:55.136179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bf360-451b-4b9c-9389-e052a30ad978 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:55.136657 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bf360-451b-4b9c-9389-e052a30ad978 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:55.137120 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bf360-451b-4b9c-9389-e052a30ad978 None admin] PATH_INFO: `/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:55.138623 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bf360-451b-4b9c-9389-e052a30ad978 None admin] RBAC: Authorizing `identity:get_user(user_id=c4ec2b31f8a2478ca85a8e4a0973fdc6)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:55.140410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bf360-451b-4b9c-9389-e052a30ad978 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:55.142360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 62/128] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:40:54 2022] GET /identity/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:55.143428 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bf360-451b-4b9c-9389-e052a30ad978 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:55.255766 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bf360-451b-4b9c-9389-e052a30ad978 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:55.296277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0f6d2-f239-4cc6-bbc0-89cc2c40f6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:55.297308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0f6d2-f239-4cc6-bbc0-89cc2c40f6ab None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:55.297808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0f6d2-f239-4cc6-bbc0-89cc2c40f6ab None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:55.298283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0f6d2-f239-4cc6-bbc0-89cc2c40f6ab None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:55.299233 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0f6d2-f239-4cc6-bbc0-89cc2c40f6ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:55.300454 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0f6d2-f239-4cc6-bbc0-89cc2c40f6ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:55.302047 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0f6d2-f239-4cc6-bbc0-89cc2c40f6ab None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:55.317661 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 63/129] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:40:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:55.320819 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57194142-df77-478c-a948-b76105e706ae None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:55.325357 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0f6d2-f239-4cc6-bbc0-89cc2c40f6ab None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:55.397530 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746ed78-bc67-4095-b7dd-78346a1256d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:55.398647 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746ed78-bc67-4095-b7dd-78346a1256d4 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:55.398939 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746ed78-bc67-4095-b7dd-78346a1256d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:55.399219 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746ed78-bc67-4095-b7dd-78346a1256d4 None admin] PATH_INFO: `/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:55.400505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746ed78-bc67-4095-b7dd-78346a1256d4 None admin] RBAC: Authorizing `identity:get_user(user_id=c4ec2b31f8a2478ca85a8e4a0973fdc6)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:55.402001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746ed78-bc67-4095-b7dd-78346a1256d4 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:55.403986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 67/130] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:40:55 2022] GET /identity/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:55.405041 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746ed78-bc67-4095-b7dd-78346a1256d4 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:55.517469 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0f6d2-f239-4cc6-bbc0-89cc2c40f6ab None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:55.536545 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746ed78-bc67-4095-b7dd-78346a1256d4 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:55.592175 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8dca3-f76b-4693-9cdf-4e3dcadf9cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:55.593452 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8dca3-f76b-4693-9cdf-4e3dcadf9cad None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:55.594050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8dca3-f76b-4693-9cdf-4e3dcadf9cad None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:55.595049 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8dca3-f76b-4693-9cdf-4e3dcadf9cad None admin] PATH_INFO: `/v3/projects/c648e44872024842bcc0e4cd7d94efc7` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:55.597342 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8dca3-f76b-4693-9cdf-4e3dcadf9cad None admin] RBAC: Authorizing `identity:get_project(project_id=c648e44872024842bcc0e4cd7d94efc7)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:55.598995 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8dca3-f76b-4693-9cdf-4e3dcadf9cad None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:55.602730 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 64/131] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:40:55 2022] GET /identity/v3/projects/c648e44872024842bcc0e4cd7d94efc7 => generated 312 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:55.604841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8dca3-f76b-4693-9cdf-4e3dcadf9cad None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:55.608246 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57305cf4-1ea8-4994-afda-070aee81705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:55.609370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57305cf4-1ea8-4994-afda-070aee81705f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:55.610935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57305cf4-1ea8-4994-afda-070aee81705f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:55.611427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57305cf4-1ea8-4994-afda-070aee81705f None admin] PATH_INFO: `/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:55.613624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57305cf4-1ea8-4994-afda-070aee81705f None admin] RBAC: Authorizing `identity:get_user(user_id=c4ec2b31f8a2478ca85a8e4a0973fdc6)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:55.615569 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57305cf4-1ea8-4994-afda-070aee81705f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:55.620864 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 68/132] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:40:55 2022] GET /identity/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:55.622376 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57305cf4-1ea8-4994-afda-070aee81705f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:55.733845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57305cf4-1ea8-4994-afda-070aee81705f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:55.774700 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262d48a-7a00-4483-803b-8d7662eeea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:55.775961 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262d48a-7a00-4483-803b-8d7662eeea9d None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:55.776453 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262d48a-7a00-4483-803b-8d7662eeea9d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:55.776926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262d48a-7a00-4483-803b-8d7662eeea9d None admin] PATH_INFO: `/v3/projects/c648e44872024842bcc0e4cd7d94efc7/users/c4ec2b31f8a2478ca85a8e4a0973fdc6/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:55.780405 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262d48a-7a00-4483-803b-8d7662eeea9d None admin] RBAC: Authorizing `identity:create_grant(project_id=c648e44872024842bcc0e4cd7d94efc7, user_id=c4ec2b31f8a2478ca85a8e4a0973fdc6, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:55.782150 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262d48a-7a00-4483-803b-8d7662eeea9d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:55.802481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8dca3-f76b-4693-9cdf-4e3dcadf9cad None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:55.840771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a98b62-50ed-4577-b601-18158eeb6fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:55.842005 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a98b62-50ed-4577-b601-18158eeb6fa3 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:55.842492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a98b62-50ed-4577-b601-18158eeb6fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:55.843019 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a98b62-50ed-4577-b601-18158eeb6fa3 None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:55.844502 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a98b62-50ed-4577-b601-18158eeb6fa3 None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:55.846201 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a98b62-50ed-4577-b601-18158eeb6fa3 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:55.848119 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 65/133] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:40:55 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:55.849304 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a98b62-50ed-4577-b601-18158eeb6fa3 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:55.906008 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 69/134] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:40:55 2022] PUT /identity/v3/projects/c648e44872024842bcc0e4cd7d94efc7/users/c4ec2b31f8a2478ca85a8e4a0973fdc6/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:40:55.911595 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262d48a-7a00-4483-803b-8d7662eeea9d None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:55.960873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a98b62-50ed-4577-b601-18158eeb6fa3 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:56.036703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161fbdb-9dae-4a1b-a637-51354117ff25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:56.037508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161fbdb-9dae-4a1b-a637-51354117ff25 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:56.037789 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161fbdb-9dae-4a1b-a637-51354117ff25 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:56.038065 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161fbdb-9dae-4a1b-a637-51354117ff25 None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:56.043363 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161fbdb-9dae-4a1b-a637-51354117ff25 None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:56.049114 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161fbdb-9dae-4a1b-a637-51354117ff25 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:56.049114 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 66/135] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:40:55 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:56.050059 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf2835-cdbe-4b87-9db4-d7e5ab4273c7 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:56.050345 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf2835-cdbe-4b87-9db4-d7e5ab4273c7 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:56.050624 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf2835-cdbe-4b87-9db4-d7e5ab4273c7 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:56.055373 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 67/136] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:56.056251 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf2835-cdbe-4b87-9db4-d7e5ab4273c7 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:56.094797 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262d48a-7a00-4483-803b-8d7662eeea9d None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:56.161834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb3da9-7e33-4148-a223-7badfc94a394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:56.162765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb3da9-7e33-4148-a223-7badfc94a394 None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:56.163053 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb3da9-7e33-4148-a223-7badfc94a394 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:56.163368 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb3da9-7e33-4148-a223-7badfc94a394 None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd/users/c4ec2b31f8a2478ca85a8e4a0973fdc6/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:56.166833 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb3da9-7e33-4148-a223-7badfc94a394 None admin] RBAC: Authorizing `identity:create_grant(project_id=2795ff37998c454597b382c5096edefd, user_id=c4ec2b31f8a2478ca85a8e4a0973fdc6, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:56.168603 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb3da9-7e33-4148-a223-7badfc94a394 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:56.217303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf2835-cdbe-4b87-9db4-d7e5ab4273c7 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:56.256858 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 70/137] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:40:55 2022] PUT /identity/v3/projects/2795ff37998c454597b382c5096edefd/users/c4ec2b31f8a2478ca85a8e4a0973fdc6/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:40:56.259402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a83f3-e275-4e15-b445-d2ba533024d6 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:56.259990 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a83f3-e275-4e15-b445-d2ba533024d6 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:56.260477 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a83f3-e275-4e15-b445-d2ba533024d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:56.271162 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867b71d-974f-4aca-bd94-c5d34c3b405b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:56.274075 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867b71d-974f-4aca-bd94-c5d34c3b405b None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:56.275825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867b71d-974f-4aca-bd94-c5d34c3b405b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:56.276606 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867b71d-974f-4aca-bd94-c5d34c3b405b None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd/users/c4ec2b31f8a2478ca85a8e4a0973fdc6/roles/2ca014d08f26466b980433e75e765505` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:56.283484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867b71d-974f-4aca-bd94-c5d34c3b405b None admin] RBAC: Authorizing `identity:create_grant(project_id=2795ff37998c454597b382c5096edefd, user_id=c4ec2b31f8a2478ca85a8e4a0973fdc6, role_id=2ca014d08f26466b980433e75e765505)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:56.289404 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867b71d-974f-4aca-bd94-c5d34c3b405b None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:56.299361 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-275a83f3-e275-4e15-b445-d2ba533024d6 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:56.301290 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-275a83f3-e275-4e15-b445-d2ba533024d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:56.407558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 68/138] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:40:56 2022] PUT /identity/v3/projects/2795ff37998c454597b382c5096edefd/users/c4ec2b31f8a2478ca85a8e4a0973fdc6/roles/2ca014d08f26466b980433e75e765505 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:40:56.410447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 71/139] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:56.448263 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867b71d-974f-4aca-bd94-c5d34c3b405b None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:56.575302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867b71d-974f-4aca-bd94-c5d34c3b405b None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:56.618526 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37675b73-8f8d-4fa1-a68d-bc8631a147d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:56.620031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37675b73-8f8d-4fa1-a68d-bc8631a147d0 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:56.620470 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37675b73-8f8d-4fa1-a68d-bc8631a147d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:56.620903 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37675b73-8f8d-4fa1-a68d-bc8631a147d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:56.622252 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37675b73-8f8d-4fa1-a68d-bc8631a147d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:56.623888 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37675b73-8f8d-4fa1-a68d-bc8631a147d0 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:56.625658 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 69/140] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:40:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:56.631151 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a83f3-e275-4e15-b445-d2ba533024d6 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:56.733361 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a83f3-e275-4e15-b445-d2ba533024d6 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:56.770564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6319e2-c795-4abd-966e-70000b20c3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:56.771256 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6319e2-c795-4abd-966e-70000b20c3ad None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:56.771559 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6319e2-c795-4abd-966e-70000b20c3ad None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:56.771846 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6319e2-c795-4abd-966e-70000b20c3ad None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:56.772572 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6319e2-c795-4abd-966e-70000b20c3ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:56.774341 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6319e2-c795-4abd-966e-70000b20c3ad None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:56.937127 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 72/141] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:40:56 2022] POST /identity/v3/users => generated 283 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:40:57.388481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e204c-c74a-4998-865f-7b1b8ce822c5 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:57.388862 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e204c-c74a-4998-865f-7b1b8ce822c5 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:57.389071 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e204c-c74a-4998-865f-7b1b8ce822c5 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:57.391038 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 70/142] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:57.397000 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177f1eb-11d1-4559-8c73-b02409aacde8 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:57.397292 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177f1eb-11d1-4559-8c73-b02409aacde8 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:57.398085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177f1eb-11d1-4559-8c73-b02409aacde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:57.420304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-1177f1eb-11d1-4559-8c73-b02409aacde8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:57.421487 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1177f1eb-11d1-4559-8c73-b02409aacde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:57.505567 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 73/143] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:40:57.540677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e204c-c74a-4998-865f-7b1b8ce822c5 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:57.668793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e204c-c74a-4998-865f-7b1b8ce822c5 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:57.710255 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bd563-1afc-4366-a271-46a47cc2dbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:57.711069 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bd563-1afc-4366-a271-46a47cc2dbfe None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:57.711355 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bd563-1afc-4366-a271-46a47cc2dbfe None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:57.711669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bd563-1afc-4366-a271-46a47cc2dbfe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:57.723551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bd563-1afc-4366-a271-46a47cc2dbfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:40:57.731557 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-ff9bd563-1afc-4366-a271-46a47cc2dbfe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:40:57.733371 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 71/144] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:40:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:40:57.739750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177f1eb-11d1-4559-8c73-b02409aacde8 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:57.851973 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177f1eb-11d1-4559-8c73-b02409aacde8 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:57.890861 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a32b5-6c81-4f2a-b869-6c652228896d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:57.891573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a32b5-6c81-4f2a-b869-6c652228896d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:57.891863 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a32b5-6c81-4f2a-b869-6c652228896d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:57.892143 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a32b5-6c81-4f2a-b869-6c652228896d None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:57.892899 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a32b5-6c81-4f2a-b869-6c652228896d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:57.893208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a32b5-6c81-4f2a-b869-6c652228896d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:57.894604 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a32b5-6c81-4f2a-b869-6c652228896d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:57.904145 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 74/145] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:40:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:57.909503 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bd563-1afc-4366-a271-46a47cc2dbfe None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:58.009746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bd563-1afc-4366-a271-46a47cc2dbfe None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:58.048617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2219859-e926-400f-885a-161ada5b5e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:58.049936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2219859-e926-400f-885a-161ada5b5e35 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:58.050221 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2219859-e926-400f-885a-161ada5b5e35 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:58.050480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2219859-e926-400f-885a-161ada5b5e35 None admin] PATH_INFO: `/v3/users/06642583007748d2a52d59e585d12052` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:58.056610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2219859-e926-400f-885a-161ada5b5e35 None admin] RBAC: Authorizing `identity:get_user(user_id=06642583007748d2a52d59e585d12052)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:58.058132 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2219859-e926-400f-885a-161ada5b5e35 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:58.060202 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 72/146] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:40:57 2022] GET /identity/v3/users/06642583007748d2a52d59e585d12052 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:58.065205 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a32b5-6c81-4f2a-b869-6c652228896d None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:58.188367 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a32b5-6c81-4f2a-b869-6c652228896d None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:58.191963 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c383543-5a0f-43bd-b4ef-c9fd41f46da8 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:58.193761 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c383543-5a0f-43bd-b4ef-c9fd41f46da8 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:58.193761 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c383543-5a0f-43bd-b4ef-c9fd41f46da8 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:58.195199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 73/147] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:58.200506 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a664b53-8094-4005-a1a4-47b5b198ee97 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:58.200792 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a664b53-8094-4005-a1a4-47b5b198ee97 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:58.201074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a664b53-8094-4005-a1a4-47b5b198ee97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:58.229393 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-9a664b53-8094-4005-a1a4-47b5b198ee97 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:58.230611 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-9a664b53-8094-4005-a1a4-47b5b198ee97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:58.274082 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca03242-a1f1-4120-b7f1-42d3909e9ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:58.274752 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca03242-a1f1-4120-b7f1-42d3909e9ad9 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:58.275037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca03242-a1f1-4120-b7f1-42d3909e9ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:58.275309 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca03242-a1f1-4120-b7f1-42d3909e9ad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:58.373859 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 74/148] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:40:58.422586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a664b53-8094-4005-a1a4-47b5b198ee97 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:58.433308 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca03242-a1f1-4120-b7f1-42d3909e9ad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:58.435151 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca03242-a1f1-4120-b7f1-42d3909e9ad9 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:58.564872 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a664b53-8094-4005-a1a4-47b5b198ee97 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:58.604907 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058349d4-26e9-4d5b-adb0-bd17fb1ca089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:58.605722 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058349d4-26e9-4d5b-adb0-bd17fb1ca089 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:58.606009 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058349d4-26e9-4d5b-adb0-bd17fb1ca089 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:58.606290 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058349d4-26e9-4d5b-adb0-bd17fb1ca089 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:58.618171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058349d4-26e9-4d5b-adb0-bd17fb1ca089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:40:58.625477 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-058349d4-26e9-4d5b-adb0-bd17fb1ca089 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 11:40:58.626882 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 75/149] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:40:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:40:58.633085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058349d4-26e9-4d5b-adb0-bd17fb1ca089 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:58.666207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 75/150] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:40:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:40:58.671360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca03242-a1f1-4120-b7f1-42d3909e9ad9 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:58.756075 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058349d4-26e9-4d5b-adb0-bd17fb1ca089 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:58.815092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1024fe-9e51-49f3-bacd-4f9e34f418f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:58.815738 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1024fe-9e51-49f3-bacd-4f9e34f418f1 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:58.816026 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1024fe-9e51-49f3-bacd-4f9e34f418f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:58.816309 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1024fe-9e51-49f3-bacd-4f9e34f418f1 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:58.817070 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1024fe-9e51-49f3-bacd-4f9e34f418f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:58.817379 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1024fe-9e51-49f3-bacd-4f9e34f418f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:58.822064 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1024fe-9e51-49f3-bacd-4f9e34f418f1 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:58.841554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 76/151] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:40:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:58.848714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1024fe-9e51-49f3-bacd-4f9e34f418f1 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:58.909575 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca03242-a1f1-4120-b7f1-42d3909e9ad9 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:58.948136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d65fb-9504-47c1-bf7a-b6bace23221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:58.949010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d65fb-9504-47c1-bf7a-b6bace23221f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:58.949296 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d65fb-9504-47c1-bf7a-b6bace23221f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:58.949570 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d65fb-9504-47c1-bf7a-b6bace23221f None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:58.950776 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d65fb-9504-47c1-bf7a-b6bace23221f None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:58.952281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d65fb-9504-47c1-bf7a-b6bace23221f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:58.954153 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 76/152] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:40:58 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:58.959609 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d65fb-9504-47c1-bf7a-b6bace23221f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:59.022012 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1024fe-9e51-49f3-bacd-4f9e34f418f1 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:59.108850 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d484b6a-6d29-4d11-8eb0-4938f487f29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:59.109715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d484b6a-6d29-4d11-8eb0-4938f487f29e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:59.110007 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d484b6a-6d29-4d11-8eb0-4938f487f29e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:59.110285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d484b6a-6d29-4d11-8eb0-4938f487f29e None admin] PATH_INFO: `/v3/users/00ef4ef0cd6e4a069b3c7b9f23f5652d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:59.114344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d484b6a-6d29-4d11-8eb0-4938f487f29e None admin] RBAC: Authorizing `identity:get_user(user_id=00ef4ef0cd6e4a069b3c7b9f23f5652d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:59.117672 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d484b6a-6d29-4d11-8eb0-4938f487f29e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:59.118953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d65fb-9504-47c1-bf7a-b6bace23221f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:59.119453 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 77/153] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:40:58 2022] GET /identity/v3/users/00ef4ef0cd6e4a069b3c7b9f23f5652d => generated 289 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:59.125230 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d484b6a-6d29-4d11-8eb0-4938f487f29e None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:59.198161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001eaaa-cd85-4316-b48d-4fc6b1a9ffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:59.199129 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001eaaa-cd85-4316-b48d-4fc6b1a9ffb1 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:59.199640 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001eaaa-cd85-4316-b48d-4fc6b1a9ffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:59.200125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001eaaa-cd85-4316-b48d-4fc6b1a9ffb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:59.201165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001eaaa-cd85-4316-b48d-4fc6b1a9ffb1 None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=2795ff37998c454597b382c5096edefd, user.id=06642583007748d2a52d59e585d12052) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:40:59.201710 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001eaaa-cd85-4316-b48d-4fc6b1a9ffb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:59.208631 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001eaaa-cd85-4316-b48d-4fc6b1a9ffb1 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:59.220339 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 77/154] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:40:58 2022] GET /identity/v3/role_assignments?user.id=06642583007748d2a52d59e585d12052&scope.project.id=2795ff37998c454597b382c5096edefd&role.id=c2642d38bc964424a5edc330e0d4471d => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:40:59.304611 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d484b6a-6d29-4d11-8eb0-4938f487f29e None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:59.352749 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada687c-82d8-480b-8cf9-cb37e88abae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:59.353638 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada687c-82d8-480b-8cf9-cb37e88abae2 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:59.353922 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada687c-82d8-480b-8cf9-cb37e88abae2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:59.354202 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada687c-82d8-480b-8cf9-cb37e88abae2 None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:59.355645 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada687c-82d8-480b-8cf9-cb37e88abae2 None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:59.357190 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada687c-82d8-480b-8cf9-cb37e88abae2 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:59.358990 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 78/155] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:40:59 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:40:59.364834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001eaaa-cd85-4316-b48d-4fc6b1a9ffb1 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:40:59.535982 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001eaaa-cd85-4316-b48d-4fc6b1a9ffb1 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:40:59.581621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436b424-c0c0-4653-925d-4936cf4a3fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:40:59.582964 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436b424-c0c0-4653-925d-4936cf4a3fac None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:59.583456 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436b424-c0c0-4653-925d-4936cf4a3fac None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:59.583980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436b424-c0c0-4653-925d-4936cf4a3fac None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd/users/00ef4ef0cd6e4a069b3c7b9f23f5652d/roles/79b8f7dbdec64d1fb686ae3346c01e46` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:59.593251 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436b424-c0c0-4653-925d-4936cf4a3fac None admin] RBAC: Authorizing `identity:create_grant(project_id=2795ff37998c454597b382c5096edefd, user_id=00ef4ef0cd6e4a069b3c7b9f23f5652d, role_id=79b8f7dbdec64d1fb686ae3346c01e46)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:40:59.595135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436b424-c0c0-4653-925d-4936cf4a3fac None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:40:59.697734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 78/156] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:40:59 2022] PUT /identity/v3/projects/2795ff37998c454597b382c5096edefd/users/00ef4ef0cd6e4a069b3c7b9f23f5652d/roles/79b8f7dbdec64d1fb686ae3346c01e46 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:40:59.850042 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197278b-6b6a-494f-a838-26d91597fede None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:59.850596 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197278b-6b6a-494f-a838-26d91597fede None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:59.852301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197278b-6b6a-494f-a838-26d91597fede None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:59.854297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 79/157] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:40:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:40:59.865529 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb24a81-a10c-4287-beec-d86de3a03004 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:40:59.866192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb24a81-a10c-4287-beec-d86de3a03004 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:40:59.866928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb24a81-a10c-4287-beec-d86de3a03004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:40:59.892408 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-6bb24a81-a10c-4287-beec-d86de3a03004 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:40:59.894003 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-6bb24a81-a10c-4287-beec-d86de3a03004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:40:59.981647 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 79/158] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:00.033579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197278b-6b6a-494f-a838-26d91597fede None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:00.093220 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289e0fd-47eb-4b61-b7d8-76686a8565a0 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:00.093558 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289e0fd-47eb-4b61-b7d8-76686a8565a0 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:00.093795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289e0fd-47eb-4b61-b7d8-76686a8565a0 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:00.095927 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 80/159] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:00.101368 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e015f1-dfbd-453e-9471-87762f247b84 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:00.101653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e015f1-dfbd-453e-9471-87762f247b84 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:00.101930 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e015f1-dfbd-453e-9471-87762f247b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:00.124493 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-28e015f1-dfbd-453e-9471-87762f247b84 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:00.126141 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-28e015f1-dfbd-453e-9471-87762f247b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:00.190492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197278b-6b6a-494f-a838-26d91597fede None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:00.242731 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddd83f-6a7e-4bb0-a38e-946877692074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:00.243469 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddd83f-6a7e-4bb0-a38e-946877692074 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:00.243775 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddd83f-6a7e-4bb0-a38e-946877692074 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:00.244050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddd83f-6a7e-4bb0-a38e-946877692074 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:00.246591 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 81/160] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:00.260799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddd83f-6a7e-4bb0-a38e-946877692074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:00.267813 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-52ddd83f-6a7e-4bb0-a38e-946877692074 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:41:00.269276 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 80/161] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:00.275490 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e015f1-dfbd-453e-9471-87762f247b84 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:00.292226 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddd83f-6a7e-4bb0-a38e-946877692074 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:00.424789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e015f1-dfbd-453e-9471-87762f247b84 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:00.467514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344278c5-76e9-432c-9066-cdb2a680118f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:00.468361 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344278c5-76e9-432c-9066-cdb2a680118f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:00.468648 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344278c5-76e9-432c-9066-cdb2a680118f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:00.468924 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344278c5-76e9-432c-9066-cdb2a680118f None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:00.469678 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344278c5-76e9-432c-9066-cdb2a680118f None admin] RBAC: Adding query filter params (name=member) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:00.469987 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344278c5-76e9-432c-9066-cdb2a680118f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:00.471549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344278c5-76e9-432c-9066-cdb2a680118f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:00.483592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 82/162] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:00.490049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344278c5-76e9-432c-9066-cdb2a680118f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:00.507931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddd83f-6a7e-4bb0-a38e-946877692074 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:00.588209 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f069f-d34e-42e4-af76-88f9dbcfc9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:00.589402 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f069f-d34e-42e4-af76-88f9dbcfc9ee None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:00.589887 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f069f-d34e-42e4-af76-88f9dbcfc9ee None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:00.590361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f069f-d34e-42e4-af76-88f9dbcfc9ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:00.604010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344278c5-76e9-432c-9066-cdb2a680118f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:00.609569 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f069f-d34e-42e4-af76-88f9dbcfc9ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:00.617606 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-a19f069f-d34e-42e4-af76-88f9dbcfc9ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:41:00.624418 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 81/163] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:00.625890 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0e49b-e6ec-4728-bcc8-56e5691b22d0 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:00.626384 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0e49b-e6ec-4728-bcc8-56e5691b22d0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:00.626861 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0e49b-e6ec-4728-bcc8-56e5691b22d0 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:00.629009 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 82/164] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:00.634716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c1c3b-7f29-4bce-922e-d0ee41eed9f0 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:00.635248 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c1c3b-7f29-4bce-922e-d0ee41eed9f0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:00.635751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c1c3b-7f29-4bce-922e-d0ee41eed9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:00.653495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c45ff9-ff70-489b-9c50-da1cb58e2fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:00.654986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c45ff9-ff70-489b-9c50-da1cb58e2fbc None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:00.655491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c45ff9-ff70-489b-9c50-da1cb58e2fbc None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:00.655984 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c45ff9-ff70-489b-9c50-da1cb58e2fbc None admin] PATH_INFO: `/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:00.658595 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c45ff9-ff70-489b-9c50-da1cb58e2fbc None admin] RBAC: Authorizing `identity:get_user(user_id=c4ec2b31f8a2478ca85a8e4a0973fdc6)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:00.660307 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c45ff9-ff70-489b-9c50-da1cb58e2fbc None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:00.667829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 83/165] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:00 2022] GET /identity/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:00.668943 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c45ff9-ff70-489b-9c50-da1cb58e2fbc None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:00.675853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-f03c1c3b-7f29-4bce-922e-d0ee41eed9f0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:00.678050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f03c1c3b-7f29-4bce-922e-d0ee41eed9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:00.839193 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c45ff9-ff70-489b-9c50-da1cb58e2fbc None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:00.874691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 83/166] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:00.876079 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c1c3b-7f29-4bce-922e-d0ee41eed9f0 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:00.881552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aa700-1a42-4aaa-9cac-2821e631ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:00.882767 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aa700-1a42-4aaa-9cac-2821e631ce89 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:00.883147 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aa700-1a42-4aaa-9cac-2821e631ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:00.883329 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aa700-1a42-4aaa-9cac-2821e631ce89 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:00.884109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622aa700-1a42-4aaa-9cac-2821e631ce89 None admin] RBAC: Adding query filter params (name=member) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:00.884417 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622aa700-1a42-4aaa-9cac-2821e631ce89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:00.885835 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622aa700-1a42-4aaa-9cac-2821e631ce89 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:00.906247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 84/167] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:00.912799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aa700-1a42-4aaa-9cac-2821e631ce89 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:01.036650 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c1c3b-7f29-4bce-922e-d0ee41eed9f0 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:01.090542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121669c-b346-4ac6-ac9b-0512bb1d57e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:01.091132 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121669c-b346-4ac6-ac9b-0512bb1d57e9 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:01.091417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121669c-b346-4ac6-ac9b-0512bb1d57e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:01.091719 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121669c-b346-4ac6-ac9b-0512bb1d57e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:01.114750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aa700-1a42-4aaa-9cac-2821e631ce89 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:01.159953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2930f-5d49-4e93-8e8a-61871092ea51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:01.160850 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2930f-5d49-4e93-8e8a-61871092ea51 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:01.161134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2930f-5d49-4e93-8e8a-61871092ea51 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:01.161412 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2930f-5d49-4e93-8e8a-61871092ea51 None admin] PATH_INFO: `/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:01.168286 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2930f-5d49-4e93-8e8a-61871092ea51 None admin] RBAC: Authorizing `identity:get_user(user_id=c4ec2b31f8a2478ca85a8e4a0973fdc6)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:01.169841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2930f-5d49-4e93-8e8a-61871092ea51 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:01.171691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 85/168] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:00 2022] GET /identity/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:01.172377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2930f-5d49-4e93-8e8a-61871092ea51 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:01.236515 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121669c-b346-4ac6-ac9b-0512bb1d57e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:01.238012 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121669c-b346-4ac6-ac9b-0512bb1d57e9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:01.363506 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2930f-5d49-4e93-8e8a-61871092ea51 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:01.391401 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 84/169] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:01.392234 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121669c-b346-4ac6-ac9b-0512bb1d57e9 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:01.450474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33852fe1-af95-4311-b971-a870c5c659ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:01.451692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33852fe1-af95-4311-b971-a870c5c659ae None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:01.452179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33852fe1-af95-4311-b971-a870c5c659ae None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:01.452677 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33852fe1-af95-4311-b971-a870c5c659ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:01.492781 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33852fe1-af95-4311-b971-a870c5c659ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:01.500723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-33852fe1-af95-4311-b971-a870c5c659ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 11:41:01.509258 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 86/170] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:41:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:01.510342 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33852fe1-af95-4311-b971-a870c5c659ae None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:01.570921 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121669c-b346-4ac6-ac9b-0512bb1d57e9 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:01.645484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04eed5-737a-474b-9ce7-aa51603b33f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:01.646077 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04eed5-737a-474b-9ce7-aa51603b33f4 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:01.646422 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04eed5-737a-474b-9ce7-aa51603b33f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:01.651573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04eed5-737a-474b-9ce7-aa51603b33f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:01.683272 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33852fe1-af95-4311-b971-a870c5c659ae None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:01.723290 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32e8fd-6d83-43ff-9fdc-227641c55944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:01.724218 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32e8fd-6d83-43ff-9fdc-227641c55944 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:01.724498 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32e8fd-6d83-43ff-9fdc-227641c55944 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:01.724772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32e8fd-6d83-43ff-9fdc-227641c55944 None admin] PATH_INFO: `/v3/projects/c648e44872024842bcc0e4cd7d94efc7` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:01.726890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32e8fd-6d83-43ff-9fdc-227641c55944 None admin] RBAC: Authorizing `identity:get_project(project_id=c648e44872024842bcc0e4cd7d94efc7)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:01.728456 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32e8fd-6d83-43ff-9fdc-227641c55944 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:01.730500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 87/171] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:01 2022] GET /identity/v3/projects/c648e44872024842bcc0e4cd7d94efc7 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:01.735274 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32e8fd-6d83-43ff-9fdc-227641c55944 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:01.802921 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04eed5-737a-474b-9ce7-aa51603b33f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:01.804954 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04eed5-737a-474b-9ce7-aa51603b33f4 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:01.939431 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 85/172] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:01.940311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04eed5-737a-474b-9ce7-aa51603b33f4 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:01.959454 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32e8fd-6d83-43ff-9fdc-227641c55944 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:02.053127 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e2977-3b49-418e-a6d7-be99ad873eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:02.053852 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2977-3b49-418e-a6d7-be99ad873eb5 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:02.054134 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04eed5-737a-474b-9ce7-aa51603b33f4 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:02.054274 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2977-3b49-418e-a6d7-be99ad873eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:02.054507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2977-3b49-418e-a6d7-be99ad873eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:02.055340 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e2977-3b49-418e-a6d7-be99ad873eb5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:02.055705 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e2977-3b49-418e-a6d7-be99ad873eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:02.056984 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e2977-3b49-418e-a6d7-be99ad873eb5 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:02.074659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 88/173] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:02.075507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e2977-3b49-418e-a6d7-be99ad873eb5 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:02.092525 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3b6ac-7e8a-4a59-9a3a-2dd5d4ded0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:02.093190 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3b6ac-7e8a-4a59-9a3a-2dd5d4ded0fb None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:02.093468 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3b6ac-7e8a-4a59-9a3a-2dd5d4ded0fb None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:02.093738 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3b6ac-7e8a-4a59-9a3a-2dd5d4ded0fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:02.094560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3b6ac-7e8a-4a59-9a3a-2dd5d4ded0fb None admin] RBAC: Adding query filter params (role.id=54b3d96f6c9d4d3cbf19a6f0663ba935, scope.project.id=c648e44872024842bcc0e4cd7d94efc7, user.id=c4ec2b31f8a2478ca85a8e4a0973fdc6) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:02.094864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3b6ac-7e8a-4a59-9a3a-2dd5d4ded0fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:02.096640 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3b6ac-7e8a-4a59-9a3a-2dd5d4ded0fb None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:02.103268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 86/174] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:01 2022] GET /identity/v3/role_assignments?user.id=c4ec2b31f8a2478ca85a8e4a0973fdc6&scope.project.id=c648e44872024842bcc0e4cd7d94efc7&role.id=54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:02.103940 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3b6ac-7e8a-4a59-9a3a-2dd5d4ded0fb None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:02.205763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3b6ac-7e8a-4a59-9a3a-2dd5d4ded0fb None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:02.241444 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010033f0-56a0-4350-be5a-1f0e6f554daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:02.243147 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010033f0-56a0-4350-be5a-1f0e6f554daf None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:02.243424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010033f0-56a0-4350-be5a-1f0e6f554daf None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:02.243722 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010033f0-56a0-4350-be5a-1f0e6f554daf None admin] PATH_INFO: `/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:02.245035 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010033f0-56a0-4350-be5a-1f0e6f554daf None admin] RBAC: Authorizing `identity:get_user(user_id=c4ec2b31f8a2478ca85a8e4a0973fdc6)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:02.246529 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010033f0-56a0-4350-be5a-1f0e6f554daf None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:02.248410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 87/175] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:02 2022] GET /identity/v3/users/c4ec2b31f8a2478ca85a8e4a0973fdc6 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:02.249480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e243e-48ad-4cc1-a7ea-29463e001892 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:02.249760 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e243e-48ad-4cc1-a7ea-29463e001892 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:02.250032 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e243e-48ad-4cc1-a7ea-29463e001892 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:02.256377 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 88/176] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:02.257576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e243e-48ad-4cc1-a7ea-29463e001892 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:02.335658 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e2977-3b49-418e-a6d7-be99ad873eb5 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:02.373975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e243e-48ad-4cc1-a7ea-29463e001892 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:02.377044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf86c2-2366-495c-a67a-855bae1e1467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:02.378190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf86c2-2366-495c-a67a-855bae1e1467 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:02.378743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf86c2-2366-495c-a67a-855bae1e1467 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:02.379224 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf86c2-2366-495c-a67a-855bae1e1467 None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:02.381027 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf86c2-2366-495c-a67a-855bae1e1467 None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:02.383047 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf86c2-2366-495c-a67a-855bae1e1467 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:02.385435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 89/177] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:02 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:02.386947 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49396c72-8cff-44da-82c8-ca88498d8058 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:02.387444 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49396c72-8cff-44da-82c8-ca88498d8058 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:02.392613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49396c72-8cff-44da-82c8-ca88498d8058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:02.410998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-49396c72-8cff-44da-82c8-ca88498d8058 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:02.411765 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5114a-6b6e-4f13-a10e-5eee2458271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:02.412423 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5114a-6b6e-4f13-a10e-5eee2458271f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:02.412706 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5114a-6b6e-4f13-a10e-5eee2458271f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:02.413610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5114a-6b6e-4f13-a10e-5eee2458271f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:02.414100 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-49396c72-8cff-44da-82c8-ca88498d8058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:02.481434 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5114a-6b6e-4f13-a10e-5eee2458271f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:02.482839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5114a-6b6e-4f13-a10e-5eee2458271f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:02.485833 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 90/178] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:02.487391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae1f63-f5fb-44c6-a1d3-027233a5ca51 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:02.487944 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae1f63-f5fb-44c6-a1d3-027233a5ca51 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:02.488421 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae1f63-f5fb-44c6-a1d3-027233a5ca51 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:02.490576 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 91/179] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:02.492675 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae1f63-f5fb-44c6-a1d3-027233a5ca51 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:02.586522 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 89/180] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 11:41:02.588751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fc7f2-6e52-4066-88c7-78fca0afaf43 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:02.588751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fc7f2-6e52-4066-88c7-78fca0afaf43 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:02.588955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fc7f2-6e52-4066-88c7-78fca0afaf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:02.604996 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae1f63-f5fb-44c6-a1d3-027233a5ca51 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:02.609597 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-4d2fc7f2-6e52-4066-88c7-78fca0afaf43 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:02.610786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-4d2fc7f2-6e52-4066-88c7-78fca0afaf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:02.649838 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676e828-fc83-4c2c-a353-e596d2d7aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:02.650503 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676e828-fc83-4c2c-a353-e596d2d7aba1 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:02.650786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676e828-fc83-4c2c-a353-e596d2d7aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:02.651229 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676e828-fc83-4c2c-a353-e596d2d7aba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:02.652934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676e828-fc83-4c2c-a353-e596d2d7aba1 None admin] RBAC: Adding query filter params (role.id=54b3d96f6c9d4d3cbf19a6f0663ba935, scope.project.id=2795ff37998c454597b382c5096edefd, user.id=c4ec2b31f8a2478ca85a8e4a0973fdc6) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:02.653265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676e828-fc83-4c2c-a353-e596d2d7aba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:02.655174 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676e828-fc83-4c2c-a353-e596d2d7aba1 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:02.661552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 92/181] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:02 2022] GET /identity/v3/role_assignments?user.id=c4ec2b31f8a2478ca85a8e4a0973fdc6&scope.project.id=2795ff37998c454597b382c5096edefd&role.id=54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:02.667557 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676e828-fc83-4c2c-a353-e596d2d7aba1 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:02.691929 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 90/182] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:02.693413 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8a6b7-9484-4fc6-928d-da601fcf9141 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:02.693700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8a6b7-9484-4fc6-928d-da601fcf9141 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:02.693976 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8a6b7-9484-4fc6-928d-da601fcf9141 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:02.695973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 91/183] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:02.696751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8a6b7-9484-4fc6-928d-da601fcf9141 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:02.809105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676e828-fc83-4c2c-a353-e596d2d7aba1 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:02.816854 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8a6b7-9484-4fc6-928d-da601fcf9141 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:02.846582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174325b9-e0e7-41a3-a34f-350151d066bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:02.847039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174325b9-e0e7-41a3-a34f-350151d066bd None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:02.847310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174325b9-e0e7-41a3-a34f-350151d066bd None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:02.847641 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174325b9-e0e7-41a3-a34f-350151d066bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:02.853532 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868d95a-7a4a-4956-8794-4d42c265f27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:02.854404 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868d95a-7a4a-4956-8794-4d42c265f27d None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:02.854688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868d95a-7a4a-4956-8794-4d42c265f27d None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:02.854962 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868d95a-7a4a-4956-8794-4d42c265f27d None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:02.856186 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868d95a-7a4a-4956-8794-4d42c265f27d None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:02.857656 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868d95a-7a4a-4956-8794-4d42c265f27d None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:02.859116 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174325b9-e0e7-41a3-a34f-350151d066bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:02.859549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 92/184] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:02 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:02.864649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537a736-2c3f-497a-b2df-34065700b950 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:02.864930 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537a736-2c3f-497a-b2df-34065700b950 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:02.865201 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537a736-2c3f-497a-b2df-34065700b950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:02.866573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-174325b9-e0e7-41a3-a34f-350151d066bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:41:02.868513 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 93/185] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:41:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:02.869295 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174325b9-e0e7-41a3-a34f-350151d066bd None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:02.889240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c537a736-2c3f-497a-b2df-34065700b950 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:02.890442 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c537a736-2c3f-497a-b2df-34065700b950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:02.974944 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 93/186] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:02.976272 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537a736-2c3f-497a-b2df-34065700b950 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:02.985914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174325b9-e0e7-41a3-a34f-350151d066bd None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:03.023788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d729d-755b-48d0-ab02-54b42fa49b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:03.024729 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d729d-755b-48d0-ab02-54b42fa49b91 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:03.025014 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d729d-755b-48d0-ab02-54b42fa49b91 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:03.025294 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d729d-755b-48d0-ab02-54b42fa49b91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:03.037041 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d729d-755b-48d0-ab02-54b42fa49b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:03.045293 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-c58d729d-755b-48d0-ab02-54b42fa49b91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 11:41:03.046902 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 94/187] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:41:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:03.047884 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d729d-755b-48d0-ab02-54b42fa49b91 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:03.093419 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537a736-2c3f-497a-b2df-34065700b950 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:03.127873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44533d-e3b3-45a1-bd5b-91a22b9a263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:03.128551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44533d-e3b3-45a1-bd5b-91a22b9a263d None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:03.128836 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44533d-e3b3-45a1-bd5b-91a22b9a263d None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:03.129109 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44533d-e3b3-45a1-bd5b-91a22b9a263d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:03.129926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44533d-e3b3-45a1-bd5b-91a22b9a263d None admin] RBAC: Adding query filter params (role.id=2ca014d08f26466b980433e75e765505, scope.project.id=2795ff37998c454597b382c5096edefd, user.id=c4ec2b31f8a2478ca85a8e4a0973fdc6) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:03.130234 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44533d-e3b3-45a1-bd5b-91a22b9a263d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:03.132647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44533d-e3b3-45a1-bd5b-91a22b9a263d None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:03.143757 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 94/188] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:02 2022] GET /identity/v3/role_assignments?user.id=c4ec2b31f8a2478ca85a8e4a0973fdc6&scope.project.id=2795ff37998c454597b382c5096edefd&role.id=2ca014d08f26466b980433e75e765505 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:03.143757 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44533d-e3b3-45a1-bd5b-91a22b9a263d None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:03.152663 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d729d-755b-48d0-ab02-54b42fa49b91 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:03.190276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fe8e8-edd6-4250-8cb5-826ec8720b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:03.190966 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fe8e8-edd6-4250-8cb5-826ec8720b1c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:03.191244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fe8e8-edd6-4250-8cb5-826ec8720b1c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:03.191515 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fe8e8-edd6-4250-8cb5-826ec8720b1c None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:03.192294 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fe8e8-edd6-4250-8cb5-826ec8720b1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:03.192602 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fe8e8-edd6-4250-8cb5-826ec8720b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:03.193998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fe8e8-edd6-4250-8cb5-826ec8720b1c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:03.203257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 95/189] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:03.204549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fe8e8-edd6-4250-8cb5-826ec8720b1c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:03.269382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44533d-e3b3-45a1-bd5b-91a22b9a263d None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:03.309132 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae4dad-f30f-460c-b955-bfc1f9d724b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:03.309950 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae4dad-f30f-460c-b955-bfc1f9d724b5 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:03.310233 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae4dad-f30f-460c-b955-bfc1f9d724b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:03.310510 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae4dad-f30f-460c-b955-bfc1f9d724b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:03.311770 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae4dad-f30f-460c-b955-bfc1f9d724b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:03.312285 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fe8e8-edd6-4250-8cb5-826ec8720b1c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:03.313249 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae4dad-f30f-460c-b955-bfc1f9d724b5 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:03.315319 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 95/190] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:03.316311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae4dad-f30f-460c-b955-bfc1f9d724b5 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:03.354860 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16dc99-2216-4ae8-9789-85e252ed53ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:03.355566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16dc99-2216-4ae8-9789-85e252ed53ab None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:03.355778 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16dc99-2216-4ae8-9789-85e252ed53ab None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:03.356053 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16dc99-2216-4ae8-9789-85e252ed53ab None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:03.356798 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16dc99-2216-4ae8-9789-85e252ed53ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:03.357103 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16dc99-2216-4ae8-9789-85e252ed53ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:03.358686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16dc99-2216-4ae8-9789-85e252ed53ab None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:03.373899 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 96/191] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:03.374898 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16dc99-2216-4ae8-9789-85e252ed53ab None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:03.430780 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae4dad-f30f-460c-b955-bfc1f9d724b5 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:03.464819 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4d4b9-f77d-483f-beb4-81c023d00a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:03.465699 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4d4b9-f77d-483f-beb4-81c023d00a02 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:03.465977 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4d4b9-f77d-483f-beb4-81c023d00a02 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:03.466264 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4d4b9-f77d-483f-beb4-81c023d00a02 None admin] PATH_INFO: `/v3/users/37d34e802f8a4b97a70635c3f30e2602` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:03.480746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4d4b9-f77d-483f-beb4-81c023d00a02 None admin] RBAC: Authorizing `identity:get_user(user_id=37d34e802f8a4b97a70635c3f30e2602)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:03.481273 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16dc99-2216-4ae8-9789-85e252ed53ab None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:03.482228 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4d4b9-f77d-483f-beb4-81c023d00a02 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:03.483960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 96/192] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:03 2022] GET /identity/v3/users/37d34e802f8a4b97a70635c3f30e2602 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:03.485163 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f953adf-f4ea-40a2-97a9-d84a25726674 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:03.485445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f953adf-f4ea-40a2-97a9-d84a25726674 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:03.485721 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f953adf-f4ea-40a2-97a9-d84a25726674 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:03.487490 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 97/193] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:03.492226 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f953adf-f4ea-40a2-97a9-d84a25726674 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:03.515018 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e8e62-3be2-42f6-b3cf-706f55201bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:03.515757 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e8e62-3be2-42f6-b3cf-706f55201bc1 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:03.516039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e8e62-3be2-42f6-b3cf-706f55201bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:03.516312 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e8e62-3be2-42f6-b3cf-706f55201bc1 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:03.517014 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e8e62-3be2-42f6-b3cf-706f55201bc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:03.518453 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e8e62-3be2-42f6-b3cf-706f55201bc1 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:03.587087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f953adf-f4ea-40a2-97a9-d84a25726674 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:03.619445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af0fb4-6ee6-4970-8e47-eadcda6baa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:03.620275 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0fb4-6ee6-4970-8e47-eadcda6baa63 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:03.620555 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0fb4-6ee6-4970-8e47-eadcda6baa63 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:03.620830 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0fb4-6ee6-4970-8e47-eadcda6baa63 None admin] PATH_INFO: `/v3/users/37d34e802f8a4b97a70635c3f30e2602` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:03.622001 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af0fb4-6ee6-4970-8e47-eadcda6baa63 None admin] RBAC: Authorizing `identity:get_user(user_id=37d34e802f8a4b97a70635c3f30e2602)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:03.623446 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af0fb4-6ee6-4970-8e47-eadcda6baa63 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:03.625204 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 98/194] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:03 2022] GET /identity/v3/users/37d34e802f8a4b97a70635c3f30e2602 => generated 283 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:03.626044 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af0fb4-6ee6-4970-8e47-eadcda6baa63 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:03.647556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 97/195] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:41:03 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:41:03.647556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9219c-8a8a-47a1-b327-789afe49b303 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:03.647556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9219c-8a8a-47a1-b327-789afe49b303 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:03.647556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9219c-8a8a-47a1-b327-789afe49b303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:03.658990 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-36e9219c-8a8a-47a1-b327-789afe49b303 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:03.660256 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-36e9219c-8a8a-47a1-b327-789afe49b303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:03.731882 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af0fb4-6ee6-4970-8e47-eadcda6baa63 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:03.735554 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 98/196] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:03.740294 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9219c-8a8a-47a1-b327-789afe49b303 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:03.770247 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7a443-6b0d-484d-b7f2-c492ee6e5554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:03.770920 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7a443-6b0d-484d-b7f2-c492ee6e5554 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:03.771203 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7a443-6b0d-484d-b7f2-c492ee6e5554 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:03.771480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7a443-6b0d-484d-b7f2-c492ee6e5554 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:03.842983 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7a443-6b0d-484d-b7f2-c492ee6e5554 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:03.844862 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7a443-6b0d-484d-b7f2-c492ee6e5554 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:03.848277 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9219c-8a8a-47a1-b327-789afe49b303 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:03.884662 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83f71d-0e60-42e2-838c-0a8fce2bbbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:03.885253 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83f71d-0e60-42e2-838c-0a8fce2bbbc9 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:03.885536 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83f71d-0e60-42e2-838c-0a8fce2bbbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:03.885813 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83f71d-0e60-42e2-838c-0a8fce2bbbc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:03.951013 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 99/197] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:03.952178 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7a443-6b0d-484d-b7f2-c492ee6e5554 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:03.954380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83f71d-0e60-42e2-838c-0a8fce2bbbc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:03.956004 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83f71d-0e60-42e2-838c-0a8fce2bbbc9 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:04.051556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7a443-6b0d-484d-b7f2-c492ee6e5554 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:04.057150 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 99/198] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:04.058004 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83f71d-0e60-42e2-838c-0a8fce2bbbc9 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:04.087600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2985c-3f85-471e-a26c-6f100c59ec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:04.088415 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2985c-3f85-471e-a26c-6f100c59ec51 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:04.088704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2985c-3f85-471e-a26c-6f100c59ec51 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:04.088967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2985c-3f85-471e-a26c-6f100c59ec51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:04.099298 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2985c-3f85-471e-a26c-6f100c59ec51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:04.106542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-d3d2985c-3f85-471e-a26c-6f100c59ec51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 11:41:04.108158 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 100/199] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:04.109006 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2985c-3f85-471e-a26c-6f100c59ec51 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:04.162208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83f71d-0e60-42e2-838c-0a8fce2bbbc9 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:04.200323 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ba0b4-bb87-4a2e-88f9-04bb1d7ee0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:04.201388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ba0b4-bb87-4a2e-88f9-04bb1d7ee0f5 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:04.201807 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ba0b4-bb87-4a2e-88f9-04bb1d7ee0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:04.202219 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ba0b4-bb87-4a2e-88f9-04bb1d7ee0f5 None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:04.203667 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ba0b4-bb87-4a2e-88f9-04bb1d7ee0f5 None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:04.205281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ba0b4-bb87-4a2e-88f9-04bb1d7ee0f5 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:04.207243 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 100/200] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:04 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:04.208175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ba0b4-bb87-4a2e-88f9-04bb1d7ee0f5 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:04.214432 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2985c-3f85-471e-a26c-6f100c59ec51 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:04.247483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015212b2-bea8-40e0-b2b5-9fd6febd5850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:04.248478 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015212b2-bea8-40e0-b2b5-9fd6febd5850 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:04.248642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015212b2-bea8-40e0-b2b5-9fd6febd5850 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:04.248917 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015212b2-bea8-40e0-b2b5-9fd6febd5850 None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:04.250096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015212b2-bea8-40e0-b2b5-9fd6febd5850 None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:04.251585 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015212b2-bea8-40e0-b2b5-9fd6febd5850 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:04.253272 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 101/201] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:04 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:04.254021 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015212b2-bea8-40e0-b2b5-9fd6febd5850 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:04.307714 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ba0b4-bb87-4a2e-88f9-04bb1d7ee0f5 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:04.341041 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c43e15-6d7e-4dc9-af2c-3b52edf7cca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:04.341962 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43e15-6d7e-4dc9-af2c-3b52edf7cca7 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:04.342412 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43e15-6d7e-4dc9-af2c-3b52edf7cca7 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:04.342878 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43e15-6d7e-4dc9-af2c-3b52edf7cca7 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:04.343809 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c43e15-6d7e-4dc9-af2c-3b52edf7cca7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:04.344284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c43e15-6d7e-4dc9-af2c-3b52edf7cca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:04.345831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c43e15-6d7e-4dc9-af2c-3b52edf7cca7 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:04.353043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015212b2-bea8-40e0-b2b5-9fd6febd5850 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:04.354827 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 101/202] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:04.355917 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c43e15-6d7e-4dc9-af2c-3b52edf7cca7 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:04.388715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f786-d634-4f7d-a556-4265bd709f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:04.389624 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f786-d634-4f7d-a556-4265bd709f31 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:04.390077 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f786-d634-4f7d-a556-4265bd709f31 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:04.390570 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f786-d634-4f7d-a556-4265bd709f31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:04.391610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4f786-d634-4f7d-a556-4265bd709f31 None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=e3d72911271b482a9514071507315e06, user.id=37d34e802f8a4b97a70635c3f30e2602) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:04.392181 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4f786-d634-4f7d-a556-4265bd709f31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:04.393864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4f786-d634-4f7d-a556-4265bd709f31 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:04.400348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 102/203] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:04 2022] GET /identity/v3/role_assignments?user.id=37d34e802f8a4b97a70635c3f30e2602&scope.project.id=e3d72911271b482a9514071507315e06&role.id=c2642d38bc964424a5edc330e0d4471d => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:04.401395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f786-d634-4f7d-a556-4265bd709f31 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:04.486280 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c43e15-6d7e-4dc9-af2c-3b52edf7cca7 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:04.517648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f786-d634-4f7d-a556-4265bd709f31 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:04.522176 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6c59b-fccb-47fd-8e16-b69df1139829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:04.523315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6c59b-fccb-47fd-8e16-b69df1139829 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:04.523838 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6c59b-fccb-47fd-8e16-b69df1139829 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:04.524313 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6c59b-fccb-47fd-8e16-b69df1139829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:04.525368 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6c59b-fccb-47fd-8e16-b69df1139829 None admin] RBAC: Adding query filter params (role.id=2ca014d08f26466b980433e75e765505, scope.project.id=e3d72911271b482a9514071507315e06, user.id=37d34e802f8a4b97a70635c3f30e2602) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:04.525894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6c59b-fccb-47fd-8e16-b69df1139829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:04.527659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6c59b-fccb-47fd-8e16-b69df1139829 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:04.534244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 102/204] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:04 2022] GET /identity/v3/role_assignments?user.id=37d34e802f8a4b97a70635c3f30e2602&scope.project.id=e3d72911271b482a9514071507315e06&role.id=2ca014d08f26466b980433e75e765505 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:04.559828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7c4e8-d0d9-418a-8608-9764a717c7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:04.561112 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7c4e8-d0d9-418a-8608-9764a717c7aa None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:04.561591 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7c4e8-d0d9-418a-8608-9764a717c7aa None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:04.562088 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7c4e8-d0d9-418a-8608-9764a717c7aa None admin] PATH_INFO: `/v3/users/00ef4ef0cd6e4a069b3c7b9f23f5652d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:04.563662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7c4e8-d0d9-418a-8608-9764a717c7aa None admin] RBAC: Authorizing `identity:get_user(user_id=00ef4ef0cd6e4a069b3c7b9f23f5652d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:04.565492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7c4e8-d0d9-418a-8608-9764a717c7aa None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:04.567760 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 103/205] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:04 2022] GET /identity/v3/users/00ef4ef0cd6e4a069b3c7b9f23f5652d => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:04.576695 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6c59b-fccb-47fd-8e16-b69df1139829 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:04.710346 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6c59b-fccb-47fd-8e16-b69df1139829 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:04.747408 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee2ab5-da0d-47c1-b650-e43330e95637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:04.748035 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee2ab5-da0d-47c1-b650-e43330e95637 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:04.748315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee2ab5-da0d-47c1-b650-e43330e95637 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:04.748588 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee2ab5-da0d-47c1-b650-e43330e95637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:04.818479 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee2ab5-da0d-47c1-b650-e43330e95637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:04.820682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee2ab5-da0d-47c1-b650-e43330e95637 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:04.918790 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 103/206] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:04.924239 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7c4e8-d0d9-418a-8608-9764a717c7aa None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:05.025025 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7c4e8-d0d9-418a-8608-9764a717c7aa None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:05.062942 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbbabb-abfc-4f72-a0b7-775ed9a0da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:05.063846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbbabb-abfc-4f72-a0b7-775ed9a0da7a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:05.064126 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbbabb-abfc-4f72-a0b7-775ed9a0da7a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:05.064398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbbabb-abfc-4f72-a0b7-775ed9a0da7a None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:05.065594 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbbabb-abfc-4f72-a0b7-775ed9a0da7a None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:05.074617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbbabb-abfc-4f72-a0b7-775ed9a0da7a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:05.074617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 104/207] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:04 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:05.075412 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee2ab5-da0d-47c1-b650-e43330e95637 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:05.174478 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee2ab5-da0d-47c1-b650-e43330e95637 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:05.207911 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aa379-0e96-4c4e-8f7e-de86cb45d52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:05.208572 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aa379-0e96-4c4e-8f7e-de86cb45d52a None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:05.208856 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aa379-0e96-4c4e-8f7e-de86cb45d52a None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:05.209124 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aa379-0e96-4c4e-8f7e-de86cb45d52a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:05.210009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5aa379-0e96-4c4e-8f7e-de86cb45d52a None admin] RBAC: Adding query filter params (role.id=79b8f7dbdec64d1fb686ae3346c01e46, scope.project.id=2795ff37998c454597b382c5096edefd, user.id=00ef4ef0cd6e4a069b3c7b9f23f5652d) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:05.210315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5aa379-0e96-4c4e-8f7e-de86cb45d52a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:05.215540 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5aa379-0e96-4c4e-8f7e-de86cb45d52a None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:05.217963 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 104/208] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:05 2022] GET /identity/v3/role_assignments?user.id=00ef4ef0cd6e4a069b3c7b9f23f5652d&scope.project.id=2795ff37998c454597b382c5096edefd&role.id=79b8f7dbdec64d1fb686ae3346c01e46 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:06.332130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82fd9e-f177-4832-80b0-9e644480f9ae None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:06.332659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82fd9e-f177-4832-80b0-9e644480f9ae None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:06.332659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82fd9e-f177-4832-80b0-9e644480f9ae None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:06.334719 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 105/209] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:06.340130 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1cbc9-fab2-4813-b7f9-e8e422fe0465 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:06.341989 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9f6bc-eff4-46d4-9684-ca992e2a88ee None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:06.342273 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9f6bc-eff4-46d4-9684-ca992e2a88ee None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:06.342545 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9f6bc-eff4-46d4-9684-ca992e2a88ee None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:06.343912 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1cbc9-fab2-4813-b7f9-e8e422fe0465 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:06.344230 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 106/210] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:41:06.344641 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1cbc9-fab2-4813-b7f9-e8e422fe0465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:06.352436 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec67d7-85a3-4255-a2af-b190ad2db010 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:06.352964 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec67d7-85a3-4255-a2af-b190ad2db010 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:06.353505 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec67d7-85a3-4255-a2af-b190ad2db010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:06.364697 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-62f1cbc9-fab2-4813-b7f9-e8e422fe0465 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:06.366627 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-62f1cbc9-fab2-4813-b7f9-e8e422fe0465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:06.371383 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-52ec67d7-85a3-4255-a2af-b190ad2db010 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:06.372796 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-52ec67d7-85a3-4255-a2af-b190ad2db010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:06.435918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 105/211] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:06.439924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 107/212] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:06.461551 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1cbc9-fab2-4813-b7f9-e8e422fe0465 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:06.463396 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec67d7-85a3-4255-a2af-b190ad2db010 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:06.560913 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec67d7-85a3-4255-a2af-b190ad2db010 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:06.561808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1cbc9-fab2-4813-b7f9-e8e422fe0465 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:06.595677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d4b2a-c301-4408-81d3-e64898d2788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:06.596986 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d4b2a-c301-4408-81d3-e64898d2788e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:06.597545 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d4b2a-c301-4408-81d3-e64898d2788e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:06.597960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d4b2a-c301-4408-81d3-e64898d2788e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:06.598167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69ae2f-c524-4b7d-94ff-dfe38b50b5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:06.599194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69ae2f-c524-4b7d-94ff-dfe38b50b5e3 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:06.599709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69ae2f-c524-4b7d-94ff-dfe38b50b5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:06.600319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69ae2f-c524-4b7d-94ff-dfe38b50b5e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:06.601713 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69ae2f-c524-4b7d-94ff-dfe38b50b5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:06.603371 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69ae2f-c524-4b7d-94ff-dfe38b50b5e3 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:06.605232 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 106/213] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:06.608722 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d4b2a-c301-4408-81d3-e64898d2788e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:06.610765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69ae2f-c524-4b7d-94ff-dfe38b50b5e3 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:06.617110 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-683d4b2a-c301-4408-81d3-e64898d2788e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:41:06.618459 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 108/214] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:06.624170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d4b2a-c301-4408-81d3-e64898d2788e None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:06.712944 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69ae2f-c524-4b7d-94ff-dfe38b50b5e3 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:06.723380 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d4b2a-c301-4408-81d3-e64898d2788e None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:06.748478 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9211c-6faa-4d00-b1e3-23740866c394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:06.749389 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9211c-6faa-4d00-b1e3-23740866c394 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:06.749816 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9211c-6faa-4d00-b1e3-23740866c394 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:06.750234 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9211c-6faa-4d00-b1e3-23740866c394 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:06.751108 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9211c-6faa-4d00-b1e3-23740866c394 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:06.752729 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9211c-6faa-4d00-b1e3-23740866c394 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:06.759228 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f6fe8-f8d7-4014-8318-4281e8bffae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:06.760054 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f6fe8-f8d7-4014-8318-4281e8bffae2 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:06.760467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f6fe8-f8d7-4014-8318-4281e8bffae2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:06.760972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f6fe8-f8d7-4014-8318-4281e8bffae2 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:06.761904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f6fe8-f8d7-4014-8318-4281e8bffae2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:06.762418 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f6fe8-f8d7-4014-8318-4281e8bffae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:06.764372 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f6fe8-f8d7-4014-8318-4281e8bffae2 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:06.773304 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 109/215] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:06.779045 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f6fe8-f8d7-4014-8318-4281e8bffae2 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:06.847190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 107/216] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:41:06 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 11:41:06.899378 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f6fe8-f8d7-4014-8318-4281e8bffae2 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:06.938052 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae73f3b-e89c-4289-b10d-7c7f6b608335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:06.939295 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae73f3b-e89c-4289-b10d-7c7f6b608335 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:06.939878 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae73f3b-e89c-4289-b10d-7c7f6b608335 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:06.940363 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae73f3b-e89c-4289-b10d-7c7f6b608335 None admin] PATH_INFO: `/v3/users/637faedcec954d288acf24c637036946` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:06.957446 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae73f3b-e89c-4289-b10d-7c7f6b608335 None admin] RBAC: Authorizing `identity:get_user(user_id=637faedcec954d288acf24c637036946)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:06.959290 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae73f3b-e89c-4289-b10d-7c7f6b608335 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:06.961968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 110/217] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:06 2022] GET /identity/v3/users/637faedcec954d288acf24c637036946 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:06.967824 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9211c-6faa-4d00-b1e3-23740866c394 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:07.073689 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9211c-6faa-4d00-b1e3-23740866c394 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:07.106695 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d2951-4816-427a-89f2-ed73547aea70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:07.107712 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d2951-4816-427a-89f2-ed73547aea70 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:07.108208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d2951-4816-427a-89f2-ed73547aea70 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:07.108690 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d2951-4816-427a-89f2-ed73547aea70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:07.177956 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d2951-4816-427a-89f2-ed73547aea70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:07.180424 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d2951-4816-427a-89f2-ed73547aea70 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:07.180550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792a151-4da3-4607-957a-aea423a6e453 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:07.180840 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792a151-4da3-4607-957a-aea423a6e453 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:07.181115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792a151-4da3-4607-957a-aea423a6e453 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:07.184800 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 111/218] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:41:07.190537 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe2b28-d8b9-43af-8b6e-497d0c6dff03 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:07.190537 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe2b28-d8b9-43af-8b6e-497d0c6dff03 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:07.190537 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe2b28-d8b9-43af-8b6e-497d0c6dff03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:07.223331 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-f2fe2b28-d8b9-43af-8b6e-497d0c6dff03 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:07.226224 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f2fe2b28-d8b9-43af-8b6e-497d0c6dff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:07.293221 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 108/219] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:07.294838 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b30e1-e24d-412c-92fa-5acd5d98e26d None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:07.295123 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b30e1-e24d-412c-92fa-5acd5d98e26d None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:07.295398 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b30e1-e24d-412c-92fa-5acd5d98e26d None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:07.297096 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 109/220] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:07.300602 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b30e1-e24d-412c-92fa-5acd5d98e26d None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:07.314195 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 112/221] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:07.315725 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3d224-a512-4a68-8485-c5e63561bf0b None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:07.316194 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3d224-a512-4a68-8485-c5e63561bf0b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:07.316470 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3d224-a512-4a68-8485-c5e63561bf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:07.337589 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-80b3d224-a512-4a68-8485-c5e63561bf0b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:07.339423 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-80b3d224-a512-4a68-8485-c5e63561bf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:07.424877 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b30e1-e24d-412c-92fa-5acd5d98e26d None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:07.426574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 113/222] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:07.427721 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3d224-a512-4a68-8485-c5e63561bf0b None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:07.462268 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40259c60-a23a-4b01-8fb2-afa1ff92503c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:07.463400 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40259c60-a23a-4b01-8fb2-afa1ff92503c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:07.463888 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40259c60-a23a-4b01-8fb2-afa1ff92503c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:07.464382 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40259c60-a23a-4b01-8fb2-afa1ff92503c None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:07.465801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40259c60-a23a-4b01-8fb2-afa1ff92503c None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:07.467549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40259c60-a23a-4b01-8fb2-afa1ff92503c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:07.469583 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 110/223] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:07 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:07.471597 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40259c60-a23a-4b01-8fb2-afa1ff92503c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:07.536993 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3d224-a512-4a68-8485-c5e63561bf0b None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:07.572826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8cf52-6513-43a3-9c6e-d366df03e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:07.573854 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8cf52-6513-43a3-9c6e-d366df03e25f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:07.574244 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8cf52-6513-43a3-9c6e-d366df03e25f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:07.574618 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8cf52-6513-43a3-9c6e-d366df03e25f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:07.585980 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8cf52-6513-43a3-9c6e-d366df03e25f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:07.593724 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-2fc8cf52-6513-43a3-9c6e-d366df03e25f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 11:41:07.594454 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40259c60-a23a-4b01-8fb2-afa1ff92503c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:07.595441 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 114/224] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:41:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:07.596338 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8cf52-6513-43a3-9c6e-d366df03e25f None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:07.641525 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4628c-59ea-48bf-8365-585bd2157b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:07.642603 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4628c-59ea-48bf-8365-585bd2157b91 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:07.642902 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4628c-59ea-48bf-8365-585bd2157b91 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:07.643176 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4628c-59ea-48bf-8365-585bd2157b91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:07.656241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4628c-59ea-48bf-8365-585bd2157b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:07.665438 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-c9b4628c-59ea-48bf-8365-585bd2157b91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:41:07.667418 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 111/225] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:41:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:07.668315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4628c-59ea-48bf-8365-585bd2157b91 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:07.709180 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8cf52-6513-43a3-9c6e-d366df03e25f None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:07.751658 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc2c14-f903-4bf4-b410-faae6410caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:07.752468 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc2c14-f903-4bf4-b410-faae6410caee None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:07.753101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc2c14-f903-4bf4-b410-faae6410caee None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:07.753382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc2c14-f903-4bf4-b410-faae6410caee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:07.754473 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc2c14-f903-4bf4-b410-faae6410caee None admin] RBAC: Adding query filter params (role.id=54b3d96f6c9d4d3cbf19a6f0663ba935, scope.project.id=e3d72911271b482a9514071507315e06, user.id=637faedcec954d288acf24c637036946) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:07.754785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc2c14-f903-4bf4-b410-faae6410caee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:07.756803 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc2c14-f903-4bf4-b410-faae6410caee None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:07.763707 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 115/226] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:07 2022] GET /identity/v3/role_assignments?user.id=637faedcec954d288acf24c637036946&scope.project.id=e3d72911271b482a9514071507315e06&role.id=54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:07.764659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc2c14-f903-4bf4-b410-faae6410caee None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:07.782766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4628c-59ea-48bf-8365-585bd2157b91 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:07.872428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4a4ea-c1ad-4985-8437-747721652860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:07.873050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a4ea-c1ad-4985-8437-747721652860 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:07.873338 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a4ea-c1ad-4985-8437-747721652860 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:07.873622 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a4ea-c1ad-4985-8437-747721652860 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:07.874383 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4a4ea-c1ad-4985-8437-747721652860 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:07.874696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4a4ea-c1ad-4985-8437-747721652860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:07.876175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4a4ea-c1ad-4985-8437-747721652860 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:07.889010 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc2c14-f903-4bf4-b410-faae6410caee None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:07.892418 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 112/227] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:07.901993 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4a4ea-c1ad-4985-8437-747721652860 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:07.934260 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d19cea-b263-4c51-b2c1-18880e1b720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:07.934943 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d19cea-b263-4c51-b2c1-18880e1b720c None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:07.935222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d19cea-b263-4c51-b2c1-18880e1b720c None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:07.935494 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d19cea-b263-4c51-b2c1-18880e1b720c None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:07.936277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d19cea-b263-4c51-b2c1-18880e1b720c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:07.936581 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d19cea-b263-4c51-b2c1-18880e1b720c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:07.938010 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d19cea-b263-4c51-b2c1-18880e1b720c None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:07.947801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 116/228] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:07.954403 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d19cea-b263-4c51-b2c1-18880e1b720c None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:08.146213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d19cea-b263-4c51-b2c1-18880e1b720c None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:08.170282 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4a4ea-c1ad-4985-8437-747721652860 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:08.221317 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d199662-eefe-49f0-8f57-866e86c99dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:08.222434 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d199662-eefe-49f0-8f57-866e86c99dd2 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:08.222715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d199662-eefe-49f0-8f57-866e86c99dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:08.225669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d199662-eefe-49f0-8f57-866e86c99dd2 None admin] PATH_INFO: `/v3/users/37d34e802f8a4b97a70635c3f30e2602` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:08.228425 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d199662-eefe-49f0-8f57-866e86c99dd2 None admin] RBAC: Authorizing `identity:get_user(user_id=37d34e802f8a4b97a70635c3f30e2602)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:08.230068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d199662-eefe-49f0-8f57-866e86c99dd2 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:08.232585 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 117/229] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:07 2022] GET /identity/v3/users/37d34e802f8a4b97a70635c3f30e2602 => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:08.239558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d199662-eefe-49f0-8f57-866e86c99dd2 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:08.253898 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1724d98-ae90-4bbc-9a3e-b9cb5cadf182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:08.254846 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1724d98-ae90-4bbc-9a3e-b9cb5cadf182 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:08.255168 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1724d98-ae90-4bbc-9a3e-b9cb5cadf182 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:08.255445 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1724d98-ae90-4bbc-9a3e-b9cb5cadf182 None admin] PATH_INFO: `/v3/users/37d34e802f8a4b97a70635c3f30e2602` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:08.257953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1724d98-ae90-4bbc-9a3e-b9cb5cadf182 None admin] RBAC: Authorizing `identity:get_user(user_id=37d34e802f8a4b97a70635c3f30e2602)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:08.259617 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1724d98-ae90-4bbc-9a3e-b9cb5cadf182 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:08.262987 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 113/230] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:07 2022] GET /identity/v3/users/37d34e802f8a4b97a70635c3f30e2602 => generated 283 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:08.285189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1724d98-ae90-4bbc-9a3e-b9cb5cadf182 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:08.382199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d199662-eefe-49f0-8f57-866e86c99dd2 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:08.419567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c98e2-92fc-408a-b596-5bc4e4eeca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:08.420756 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c98e2-92fc-408a-b596-5bc4e4eeca84 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:08.421235 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c98e2-92fc-408a-b596-5bc4e4eeca84 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:08.421714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c98e2-92fc-408a-b596-5bc4e4eeca84 None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:08.423072 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c98e2-92fc-408a-b596-5bc4e4eeca84 None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:08.425031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c98e2-92fc-408a-b596-5bc4e4eeca84 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:08.426901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 118/231] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:08 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:08.433345 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c98e2-92fc-408a-b596-5bc4e4eeca84 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:08.478773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1724d98-ae90-4bbc-9a3e-b9cb5cadf182 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:08.524032 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046bcf6-0f11-4138-8257-ebfde261dc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:08.525224 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046bcf6-0f11-4138-8257-ebfde261dc38 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:08.527737 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046bcf6-0f11-4138-8257-ebfde261dc38 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:08.528250 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046bcf6-0f11-4138-8257-ebfde261dc38 None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:08.530825 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046bcf6-0f11-4138-8257-ebfde261dc38 None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:08.533821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046bcf6-0f11-4138-8257-ebfde261dc38 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:08.536286 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 114/232] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:08 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:08.560934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046bcf6-0f11-4138-8257-ebfde261dc38 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:08.620634 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c98e2-92fc-408a-b596-5bc4e4eeca84 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:08.663307 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48851e64-db43-4f44-bf66-1b532ba9371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:08.664611 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48851e64-db43-4f44-bf66-1b532ba9371f None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:08.666181 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48851e64-db43-4f44-bf66-1b532ba9371f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:08.666662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48851e64-db43-4f44-bf66-1b532ba9371f None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06/users/37d34e802f8a4b97a70635c3f30e2602/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:08.670474 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48851e64-db43-4f44-bf66-1b532ba9371f None admin] RBAC: Authorizing `identity:create_grant(project_id=e3d72911271b482a9514071507315e06, user_id=37d34e802f8a4b97a70635c3f30e2602, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:08.673095 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48851e64-db43-4f44-bf66-1b532ba9371f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:08.724853 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046bcf6-0f11-4138-8257-ebfde261dc38 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:08.759989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985470e3-f48a-43fc-b2d5-3a745cf8bd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:08.761237 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985470e3-f48a-43fc-b2d5-3a745cf8bd6b None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:08.761747 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985470e3-f48a-43fc-b2d5-3a745cf8bd6b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:08.762252 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985470e3-f48a-43fc-b2d5-3a745cf8bd6b None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06/users/37d34e802f8a4b97a70635c3f30e2602/roles/2ca014d08f26466b980433e75e765505` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:08.769200 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 119/233] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:41:08 2022] PUT /identity/v3/projects/e3d72911271b482a9514071507315e06/users/37d34e802f8a4b97a70635c3f30e2602/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:41:08.771316 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985470e3-f48a-43fc-b2d5-3a745cf8bd6b None admin] RBAC: Authorizing `identity:create_grant(project_id=e3d72911271b482a9514071507315e06, user_id=37d34e802f8a4b97a70635c3f30e2602, role_id=2ca014d08f26466b980433e75e765505)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:08.773914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985470e3-f48a-43fc-b2d5-3a745cf8bd6b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:08.857509 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 115/234] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:41:08 2022] PUT /identity/v3/projects/e3d72911271b482a9514071507315e06/users/37d34e802f8a4b97a70635c3f30e2602/roles/2ca014d08f26466b980433e75e765505 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 11:41:09.708865 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a0722-c9de-46e5-9eb7-f9c371adc951 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:09.709488 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a0722-c9de-46e5-9eb7-f9c371adc951 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:09.709488 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a0722-c9de-46e5-9eb7-f9c371adc951 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:09.711491 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 120/235] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:09.716478 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b244f9-7eb2-4dac-ad45-800bca064811 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:09.716868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b244f9-7eb2-4dac-ad45-800bca064811 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:09.717048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b244f9-7eb2-4dac-ad45-800bca064811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:09.732324 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bd37b-433d-4ccb-8893-1080dac8500f None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:09.732925 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bd37b-433d-4ccb-8893-1080dac8500f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:09.733409 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bd37b-433d-4ccb-8893-1080dac8500f None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:09.735693 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 121/236] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:41:09.741765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-b6b244f9-7eb2-4dac-ad45-800bca064811 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:09.742352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024e0ae-af69-4e05-8d71-3983c95a3559 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:09.742529 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b6b244f9-7eb2-4dac-ad45-800bca064811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:09.743020 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024e0ae-af69-4e05-8d71-3983c95a3559 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:09.743498 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024e0ae-af69-4e05-8d71-3983c95a3559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:09.761369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c024e0ae-af69-4e05-8d71-3983c95a3559 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:09.762850 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c024e0ae-af69-4e05-8d71-3983c95a3559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:09.854989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 116/237] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:09.873346 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 122/238] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:09.906569 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b244f9-7eb2-4dac-ad45-800bca064811 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:09.930129 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024e0ae-af69-4e05-8d71-3983c95a3559 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:10.028834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b244f9-7eb2-4dac-ad45-800bca064811 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:10.063628 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024e0ae-af69-4e05-8d71-3983c95a3559 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:10.097911 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d4a2c-846e-435f-9922-46123221f515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:10.098705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d4a2c-846e-435f-9922-46123221f515 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:10.098984 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d4a2c-846e-435f-9922-46123221f515 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:10.099259 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d4a2c-846e-435f-9922-46123221f515 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:10.110166 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d4a2c-846e-435f-9922-46123221f515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:10.117367 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-835d4a2c-846e-435f-9922-46123221f515 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 11:41:10.117919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806df9a4-6442-454f-b7a3-5610e00109a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:10.118995 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 123/239] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:10.119129 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806df9a4-6442-454f-b7a3-5610e00109a6 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:10.119580 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806df9a4-6442-454f-b7a3-5610e00109a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:10.120064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806df9a4-6442-454f-b7a3-5610e00109a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:10.121530 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806df9a4-6442-454f-b7a3-5610e00109a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:10.123267 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806df9a4-6442-454f-b7a3-5610e00109a6 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:10.125383 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 117/240] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:10.129852 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d4a2c-846e-435f-9922-46123221f515 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:10.130903 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806df9a4-6442-454f-b7a3-5610e00109a6 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:10.233000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d4a2c-846e-435f-9922-46123221f515 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:10.271463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef0de2-12f7-431b-a1e3-5e51cedc0626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:10.272757 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef0de2-12f7-431b-a1e3-5e51cedc0626 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:10.272757 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef0de2-12f7-431b-a1e3-5e51cedc0626 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:10.278228 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef0de2-12f7-431b-a1e3-5e51cedc0626 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:10.278228 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef0de2-12f7-431b-a1e3-5e51cedc0626 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:10.278228 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef0de2-12f7-431b-a1e3-5e51cedc0626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:10.278228 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef0de2-12f7-431b-a1e3-5e51cedc0626 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:10.284902 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 124/241] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:10.296913 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef0de2-12f7-431b-a1e3-5e51cedc0626 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:10.297269 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806df9a4-6442-454f-b7a3-5610e00109a6 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:10.337926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889b084-74d4-4c0d-826b-dc3155776b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:10.338603 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889b084-74d4-4c0d-826b-dc3155776b19 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:10.338885 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889b084-74d4-4c0d-826b-dc3155776b19 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:10.339158 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889b084-74d4-4c0d-826b-dc3155776b19 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:10.339896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889b084-74d4-4c0d-826b-dc3155776b19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:10.341353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889b084-74d4-4c0d-826b-dc3155776b19 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:10.431277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef0de2-12f7-431b-a1e3-5e51cedc0626 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:10.438445 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 118/242] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:41:10 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:41:10.481154 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765e28c-94f1-4c4e-a0be-ce0dd68c104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:10.482183 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e28c-94f1-4c4e-a0be-ce0dd68c104e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:10.482465 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e28c-94f1-4c4e-a0be-ce0dd68c104e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:10.482738 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e28c-94f1-4c4e-a0be-ce0dd68c104e None admin] PATH_INFO: `/v3/users/7958dabcb9b142bbbf944cee67d6580d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:10.497853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765e28c-94f1-4c4e-a0be-ce0dd68c104e None admin] RBAC: Authorizing `identity:get_user(user_id=7958dabcb9b142bbbf944cee67d6580d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:10.499387 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765e28c-94f1-4c4e-a0be-ce0dd68c104e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:10.501494 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 125/243] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:10 2022] GET /identity/v3/users/7958dabcb9b142bbbf944cee67d6580d => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:10.507313 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889b084-74d4-4c0d-826b-dc3155776b19 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:10.642122 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889b084-74d4-4c0d-826b-dc3155776b19 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:10.676758 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89cbd4-789f-44a4-8856-883710ffa59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:10.677422 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89cbd4-789f-44a4-8856-883710ffa59f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:10.677704 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89cbd4-789f-44a4-8856-883710ffa59f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:10.678385 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89cbd4-789f-44a4-8856-883710ffa59f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:10.723068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026fdb1-7c54-4018-a279-392a5061387d None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:10.723589 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026fdb1-7c54-4018-a279-392a5061387d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:10.723798 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026fdb1-7c54-4018-a279-392a5061387d None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:10.725827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 126/244] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:10.730838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a336fb-03c1-485a-87ec-6b946640cb31 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:10.731130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a336fb-03c1-485a-87ec-6b946640cb31 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:10.731405 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a336fb-03c1-485a-87ec-6b946640cb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:10.749904 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89cbd4-789f-44a4-8856-883710ffa59f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:10.751364 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89cbd4-789f-44a4-8856-883710ffa59f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:10.752955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-a1a336fb-03c1-485a-87ec-6b946640cb31 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:10.754172 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a1a336fb-03c1-485a-87ec-6b946640cb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:10.833666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 127/245] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:10.856378 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a336fb-03c1-485a-87ec-6b946640cb31 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:10.872191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 119/246] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:10.880723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89cbd4-789f-44a4-8856-883710ffa59f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:10.987484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a336fb-03c1-485a-87ec-6b946640cb31 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:11.033360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9d9a4-4096-4e71-bf28-cfab5024f547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:11.034726 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9d9a4-4096-4e71-bf28-cfab5024f547 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:11.035014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9d9a4-4096-4e71-bf28-cfab5024f547 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:11.035288 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9d9a4-4096-4e71-bf28-cfab5024f547 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:11.036562 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89cbd4-789f-44a4-8856-883710ffa59f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:11.049901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9d9a4-4096-4e71-bf28-cfab5024f547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:11.058634 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-32a9d9a4-4096-4e71-bf28-cfab5024f547 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:41:11.060553 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 128/247] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:11.067913 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9d9a4-4096-4e71-bf28-cfab5024f547 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:11.083900 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d4fc5-bffa-4f29-998f-848508478f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:11.085485 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d4fc5-bffa-4f29-998f-848508478f15 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:11.085684 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d4fc5-bffa-4f29-998f-848508478f15 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:11.085906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d4fc5-bffa-4f29-998f-848508478f15 None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:11.087104 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d4fc5-bffa-4f29-998f-848508478f15 None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:11.088723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d4fc5-bffa-4f29-998f-848508478f15 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:11.090936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 120/248] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:10 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:11.101012 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d4fc5-bffa-4f29-998f-848508478f15 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:11.224175 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9d9a4-4096-4e71-bf28-cfab5024f547 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:11.226679 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d4fc5-bffa-4f29-998f-848508478f15 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:11.262889 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbdbf0-46f0-4763-a372-f3dea686bdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:11.263799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbdbf0-46f0-4763-a372-f3dea686bdc8 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:11.264211 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbdbf0-46f0-4763-a372-f3dea686bdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:11.264628 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbdbf0-46f0-4763-a372-f3dea686bdc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:11.265487 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c3c6-d02b-41fa-a555-3ebc0650d0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:11.265810 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbdbf0-46f0-4763-a372-f3dea686bdc8 None admin] RBAC: Adding query filter params (role.id=79b8f7dbdec64d1fb686ae3346c01e46, scope.project.id=e3d72911271b482a9514071507315e06, user.id=7958dabcb9b142bbbf944cee67d6580d) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:11.266257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbdbf0-46f0-4763-a372-f3dea686bdc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:11.266362 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c3c6-d02b-41fa-a555-3ebc0650d0b6 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:11.266703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c3c6-d02b-41fa-a555-3ebc0650d0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:11.267049 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c3c6-d02b-41fa-a555-3ebc0650d0b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:11.267907 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7c3c6-d02b-41fa-a555-3ebc0650d0b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:11.268286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7c3c6-d02b-41fa-a555-3ebc0650d0b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:11.268653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbdbf0-46f0-4763-a372-f3dea686bdc8 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:11.269853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7c3c6-d02b-41fa-a555-3ebc0650d0b6 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:11.280379 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 121/249] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:11 2022] GET /identity/v3/role_assignments?user.id=7958dabcb9b142bbbf944cee67d6580d&scope.project.id=e3d72911271b482a9514071507315e06&role.id=79b8f7dbdec64d1fb686ae3346c01e46 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:11.302540 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 129/250] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:11.311801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbdbf0-46f0-4763-a372-f3dea686bdc8 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:11.433571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbdbf0-46f0-4763-a372-f3dea686bdc8 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:11.475722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7404b-2b92-4289-a6ad-75cca0c302c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:11.476967 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7404b-2b92-4289-a6ad-75cca0c302c6 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:11.477401 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7404b-2b92-4289-a6ad-75cca0c302c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:11.477818 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7404b-2b92-4289-a6ad-75cca0c302c6 None admin] PATH_INFO: `/v3/users/637faedcec954d288acf24c637036946` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:11.484333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7404b-2b92-4289-a6ad-75cca0c302c6 None admin] RBAC: Authorizing `identity:get_user(user_id=637faedcec954d288acf24c637036946)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:11.486031 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7404b-2b92-4289-a6ad-75cca0c302c6 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:11.488431 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 122/251] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:11 2022] GET /identity/v3/users/637faedcec954d288acf24c637036946 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:11.494421 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c3c6-d02b-41fa-a555-3ebc0650d0b6 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:11.620108 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c3c6-d02b-41fa-a555-3ebc0650d0b6 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:11.663758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2e187-546e-4182-9727-0e26c8f443a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:11.664649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2e187-546e-4182-9727-0e26c8f443a4 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:11.664925 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2e187-546e-4182-9727-0e26c8f443a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:11.665199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2e187-546e-4182-9727-0e26c8f443a4 None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:11.666406 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2e187-546e-4182-9727-0e26c8f443a4 None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:11.667891 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2e187-546e-4182-9727-0e26c8f443a4 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:11.669752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 130/252] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:11 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:11.675357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7404b-2b92-4289-a6ad-75cca0c302c6 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:11.808523 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7404b-2b92-4289-a6ad-75cca0c302c6 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:11.827547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1dd58-63ca-4fcb-83b4-57a45ae91375 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:11.827547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1dd58-63ca-4fcb-83b4-57a45ae91375 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:11.827547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1dd58-63ca-4fcb-83b4-57a45ae91375 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:11.827547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 131/253] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:41:11.839317 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733045df-9bee-4d44-8648-fccc6134a5aa None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:11.839654 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733045df-9bee-4d44-8648-fccc6134a5aa None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:11.839932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733045df-9bee-4d44-8648-fccc6134a5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:11.862361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-733045df-9bee-4d44-8648-fccc6134a5aa None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:11.863549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-733045df-9bee-4d44-8648-fccc6134a5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:11.867645 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a78573-6bdf-4dd0-9bdd-52851151db16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:11.868552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a78573-6bdf-4dd0-9bdd-52851151db16 None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:11.868831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a78573-6bdf-4dd0-9bdd-52851151db16 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:11.869103 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a78573-6bdf-4dd0-9bdd-52851151db16 None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06/users/637faedcec954d288acf24c637036946/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:11.871134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a78573-6bdf-4dd0-9bdd-52851151db16 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3d72911271b482a9514071507315e06, user_id=637faedcec954d288acf24c637036946, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:11.872549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a78573-6bdf-4dd0-9bdd-52851151db16 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:11.931257 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 132/254] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:11.932671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30c967-6ef8-4e1d-9735-d2b8e57a213a None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:11.932960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30c967-6ef8-4e1d-9735-d2b8e57a213a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:11.933233 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30c967-6ef8-4e1d-9735-d2b8e57a213a None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:11.935047 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 133/255] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:11.940183 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4745f7-8350-4ea8-baed-a0d6181dd5e0 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:11.940462 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4745f7-8350-4ea8-baed-a0d6181dd5e0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:11.940734 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4745f7-8350-4ea8-baed-a0d6181dd5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:11.957561 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-3e4745f7-8350-4ea8-baed-a0d6181dd5e0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:11.958747 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3e4745f7-8350-4ea8-baed-a0d6181dd5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:11.982556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 123/256] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:41:11 2022] PUT /identity/v3/projects/e3d72911271b482a9514071507315e06/users/637faedcec954d288acf24c637036946/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:41:11.983244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a78573-6bdf-4dd0-9bdd-52851151db16 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:12.030797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 134/257] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:12.055126 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4745f7-8350-4ea8-baed-a0d6181dd5e0 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:12.159574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4745f7-8350-4ea8-baed-a0d6181dd5e0 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:12.163585 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a78573-6bdf-4dd0-9bdd-52851151db16 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:12.195391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76927c-8a88-4af0-adb3-6f1ae02494da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:12.196236 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76927c-8a88-4af0-adb3-6f1ae02494da None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:12.196514 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76927c-8a88-4af0-adb3-6f1ae02494da None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:12.196784 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76927c-8a88-4af0-adb3-6f1ae02494da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:12.207373 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76927c-8a88-4af0-adb3-6f1ae02494da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:12.214422 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-cd76927c-8a88-4af0-adb3-6f1ae02494da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:41:12.216023 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 135/258] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:41:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:12.221779 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76927c-8a88-4af0-adb3-6f1ae02494da None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:12.244048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a9326-c70d-4dc8-b5bb-a55e632e6fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:12.245343 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a9326-c70d-4dc8-b5bb-a55e632e6fde None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:12.245833 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a9326-c70d-4dc8-b5bb-a55e632e6fde None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:12.246371 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a9326-c70d-4dc8-b5bb-a55e632e6fde None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:12.268977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a9326-c70d-4dc8-b5bb-a55e632e6fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:12.277808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-417a9326-c70d-4dc8-b5bb-a55e632e6fde None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 11:41:12.288493 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 124/259] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:41:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:12.294293 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a9326-c70d-4dc8-b5bb-a55e632e6fde None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:12.325987 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76927c-8a88-4af0-adb3-6f1ae02494da None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:12.361798 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81313a64-5771-44e6-b4ac-770563dc2a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:12.362482 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81313a64-5771-44e6-b4ac-770563dc2a66 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:12.362765 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81313a64-5771-44e6-b4ac-770563dc2a66 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:12.363047 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81313a64-5771-44e6-b4ac-770563dc2a66 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:12.363842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81313a64-5771-44e6-b4ac-770563dc2a66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:12.364150 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81313a64-5771-44e6-b4ac-770563dc2a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:12.365659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81313a64-5771-44e6-b4ac-770563dc2a66 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:12.376795 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 136/260] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:12.382928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81313a64-5771-44e6-b4ac-770563dc2a66 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:12.485718 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a9326-c70d-4dc8-b5bb-a55e632e6fde None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:12.495121 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81313a64-5771-44e6-b4ac-770563dc2a66 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:12.534142 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08b85b-284f-44b2-b6f8-5c083222fd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:12.535153 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08b85b-284f-44b2-b6f8-5c083222fd74 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:12.535435 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08b85b-284f-44b2-b6f8-5c083222fd74 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:12.535867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08b85b-284f-44b2-b6f8-5c083222fd74 None admin] PATH_INFO: `/v3/users/37d34e802f8a4b97a70635c3f30e2602` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:12.537288 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08b85b-284f-44b2-b6f8-5c083222fd74 None admin] RBAC: Authorizing `identity:get_user(user_id=37d34e802f8a4b97a70635c3f30e2602)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:12.539063 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08b85b-284f-44b2-b6f8-5c083222fd74 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:12.541162 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 137/261] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:12 2022] GET /identity/v3/users/37d34e802f8a4b97a70635c3f30e2602 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:12.547129 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08b85b-284f-44b2-b6f8-5c083222fd74 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:12.557539 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb528c36-ac9d-427c-84f8-6c8486f8546e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:12.558531 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb528c36-ac9d-427c-84f8-6c8486f8546e None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:12.559019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb528c36-ac9d-427c-84f8-6c8486f8546e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:12.559493 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb528c36-ac9d-427c-84f8-6c8486f8546e None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:12.560549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb528c36-ac9d-427c-84f8-6c8486f8546e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:12.561070 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb528c36-ac9d-427c-84f8-6c8486f8546e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:12.562727 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb528c36-ac9d-427c-84f8-6c8486f8546e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:12.577448 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 125/262] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:12.582813 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb528c36-ac9d-427c-84f8-6c8486f8546e None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:12.654798 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08b85b-284f-44b2-b6f8-5c083222fd74 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:12.691340 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f07b15-03ed-409f-9800-1b857d83343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:12.692024 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f07b15-03ed-409f-9800-1b857d83343d None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:12.692300 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f07b15-03ed-409f-9800-1b857d83343d None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:12.692722 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f07b15-03ed-409f-9800-1b857d83343d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:12.761903 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f07b15-03ed-409f-9800-1b857d83343d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:12.763679 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f07b15-03ed-409f-9800-1b857d83343d None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:12.780229 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb528c36-ac9d-427c-84f8-6c8486f8546e None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:12.878926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6ab11-feb2-4b21-9338-b0e4b1c6742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:12.880675 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6ab11-feb2-4b21-9338-b0e4b1c6742e None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:12.881194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6ab11-feb2-4b21-9338-b0e4b1c6742e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:12.881699 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6ab11-feb2-4b21-9338-b0e4b1c6742e None admin] PATH_INFO: `/v3/users/37d34e802f8a4b97a70635c3f30e2602` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:12.883273 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6ab11-feb2-4b21-9338-b0e4b1c6742e None admin] RBAC: Authorizing `identity:get_user(user_id=37d34e802f8a4b97a70635c3f30e2602)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:12.884994 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6ab11-feb2-4b21-9338-b0e4b1c6742e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:12.887261 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 126/263] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:12 2022] GET /identity/v3/users/37d34e802f8a4b97a70635c3f30e2602 => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:12.892772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6ab11-feb2-4b21-9338-b0e4b1c6742e None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:13.001781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 138/264] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 11:41:13.007716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f07b15-03ed-409f-9800-1b857d83343d None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:13.115740 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f07b15-03ed-409f-9800-1b857d83343d None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:13.133490 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6ab11-feb2-4b21-9338-b0e4b1c6742e None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:13.152538 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679baf4-8ccf-463c-8ce9-049d212ac279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:13.153788 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679baf4-8ccf-463c-8ce9-049d212ac279 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:13.154067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679baf4-8ccf-463c-8ce9-049d212ac279 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:13.154339 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679baf4-8ccf-463c-8ce9-049d212ac279 None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:13.155692 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679baf4-8ccf-463c-8ce9-049d212ac279 None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:13.157528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679baf4-8ccf-463c-8ce9-049d212ac279 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:13.159756 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 139/265] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:13 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:13.166269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679baf4-8ccf-463c-8ce9-049d212ac279 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:13.220246 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3d9e9-2a2b-4e13-8bb5-de1e2656e25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:13.221080 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3d9e9-2a2b-4e13-8bb5-de1e2656e25e None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:13.221444 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3d9e9-2a2b-4e13-8bb5-de1e2656e25e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:13.221823 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3d9e9-2a2b-4e13-8bb5-de1e2656e25e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:13.274660 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679baf4-8ccf-463c-8ce9-049d212ac279 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:13.312802 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627ae11-6306-497b-a8ed-683f47e9ba67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:13.313459 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627ae11-6306-497b-a8ed-683f47e9ba67 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:13.314168 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627ae11-6306-497b-a8ed-683f47e9ba67 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:13.314456 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627ae11-6306-497b-a8ed-683f47e9ba67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:13.315280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627ae11-6306-497b-a8ed-683f47e9ba67 None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=e3d72911271b482a9514071507315e06, user.id=37d34e802f8a4b97a70635c3f30e2602) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:13.315616 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627ae11-6306-497b-a8ed-683f47e9ba67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:13.317068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627ae11-6306-497b-a8ed-683f47e9ba67 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:13.324604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 140/266] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:13 2022] GET /identity/v3/role_assignments?user.id=37d34e802f8a4b97a70635c3f30e2602&scope.project.id=e3d72911271b482a9514071507315e06&role.id=c2642d38bc964424a5edc330e0d4471d => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:13.391584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3d9e9-2a2b-4e13-8bb5-de1e2656e25e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:13.393030 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3d9e9-2a2b-4e13-8bb5-de1e2656e25e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:13.547593 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 127/267] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:13.553716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627ae11-6306-497b-a8ed-683f47e9ba67 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:13.667174 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627ae11-6306-497b-a8ed-683f47e9ba67 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:13.703072 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672db11-bb04-4ec2-a298-1fea4c91d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:13.703972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672db11-bb04-4ec2-a298-1fea4c91d819 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:13.704252 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672db11-bb04-4ec2-a298-1fea4c91d819 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:13.704525 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672db11-bb04-4ec2-a298-1fea4c91d819 None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:13.705788 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672db11-bb04-4ec2-a298-1fea4c91d819 None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:13.707291 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672db11-bb04-4ec2-a298-1fea4c91d819 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:13.709857 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 141/268] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:13 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:13.720741 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3d9e9-2a2b-4e13-8bb5-de1e2656e25e None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:13.830139 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3d9e9-2a2b-4e13-8bb5-de1e2656e25e None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:13.870060 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ded20d-20ac-4e56-83c9-3bbde68b8ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:13.870730 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ded20d-20ac-4e56-83c9-3bbde68b8ad2 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:13.871006 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ded20d-20ac-4e56-83c9-3bbde68b8ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:13.871281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ded20d-20ac-4e56-83c9-3bbde68b8ad2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:13.872139 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ded20d-20ac-4e56-83c9-3bbde68b8ad2 None admin] RBAC: Adding query filter params (role.id=2ca014d08f26466b980433e75e765505, scope.project.id=e3d72911271b482a9514071507315e06, user.id=37d34e802f8a4b97a70635c3f30e2602) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:13.872448 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ded20d-20ac-4e56-83c9-3bbde68b8ad2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:13.873912 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ded20d-20ac-4e56-83c9-3bbde68b8ad2 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:13.880232 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 128/269] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:13 2022] GET /identity/v3/role_assignments?user.id=37d34e802f8a4b97a70635c3f30e2602&scope.project.id=e3d72911271b482a9514071507315e06&role.id=2ca014d08f26466b980433e75e765505 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:14.169711 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e891f02-e137-4467-85be-f9fc2a4a9a30 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:14.170569 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e891f02-e137-4467-85be-f9fc2a4a9a30 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:14.170991 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e891f02-e137-4467-85be-f9fc2a4a9a30 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:14.173392 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 142/270] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:14.185471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf1fb-c44d-4c45-bc20-0d1dd3e20c7d None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:14.185990 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf1fb-c44d-4c45-bc20-0d1dd3e20c7d None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:14.186409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf1fb-c44d-4c45-bc20-0d1dd3e20c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:14.208621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-642bf1fb-c44d-4c45-bc20-0d1dd3e20c7d None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:14.210306 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-642bf1fb-c44d-4c45-bc20-0d1dd3e20c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:14.230303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3993102-3d9d-42f8-9da7-9f32daaa9460 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:14.230611 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3993102-3d9d-42f8-9da7-9f32daaa9460 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:14.230919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3993102-3d9d-42f8-9da7-9f32daaa9460 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:14.233006 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 143/271] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:14.239011 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2025cf-4aa0-4bc8-9569-6ed9892d7765 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:14.239672 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2025cf-4aa0-4bc8-9569-6ed9892d7765 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:14.240313 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2025cf-4aa0-4bc8-9569-6ed9892d7765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:14.257934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-7d2025cf-4aa0-4bc8-9569-6ed9892d7765 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:14.259448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-7d2025cf-4aa0-4bc8-9569-6ed9892d7765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:14.308313 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 129/272] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:14.339871 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 144/273] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:14.342955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bf1fb-c44d-4c45-bc20-0d1dd3e20c7d None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:14.376429 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2025cf-4aa0-4bc8-9569-6ed9892d7765 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:14.471906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bf1fb-c44d-4c45-bc20-0d1dd3e20c7d None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:14.498729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2025cf-4aa0-4bc8-9569-6ed9892d7765 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:14.513972 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c5232-686b-4ddd-88cd-35f19d92ef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:14.515001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c5232-686b-4ddd-88cd-35f19d92ef25 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:14.515283 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c5232-686b-4ddd-88cd-35f19d92ef25 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:14.515752 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c5232-686b-4ddd-88cd-35f19d92ef25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:14.532220 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c5232-686b-4ddd-88cd-35f19d92ef25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:14.540281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-a13c5232-686b-4ddd-88cd-35f19d92ef25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:41:14.541382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d70c3-71b2-4710-bc73-afd871eace7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:14.542397 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d70c3-71b2-4710-bc73-afd871eace7d None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:14.542946 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d70c3-71b2-4710-bc73-afd871eace7d None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:14.543440 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d70c3-71b2-4710-bc73-afd871eace7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:14.546352 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 130/274] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:14.547369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c5232-686b-4ddd-88cd-35f19d92ef25 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:14.548395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d70c3-71b2-4710-bc73-afd871eace7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:14.549899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d70c3-71b2-4710-bc73-afd871eace7d None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:14.551682 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 145/275] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:14.557213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d70c3-71b2-4710-bc73-afd871eace7d None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:14.657590 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c5232-686b-4ddd-88cd-35f19d92ef25 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:14.660311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d70c3-71b2-4710-bc73-afd871eace7d None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:14.692127 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d9a34-f17c-48c3-98d5-23719168acf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:14.693091 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d9a34-f17c-48c3-98d5-23719168acf3 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:14.694054 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d9a34-f17c-48c3-98d5-23719168acf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:14.694500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d9a34-f17c-48c3-98d5-23719168acf3 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:14.695417 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d9a34-f17c-48c3-98d5-23719168acf3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:14.695772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d9a34-f17c-48c3-98d5-23719168acf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:14.697594 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d9a34-f17c-48c3-98d5-23719168acf3 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:14.702223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3379f-cb80-4197-9061-f65c97beabca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:14.703186 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3379f-cb80-4197-9061-f65c97beabca None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:14.703696 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3379f-cb80-4197-9061-f65c97beabca None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:14.704175 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3379f-cb80-4197-9061-f65c97beabca None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:14.705128 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3379f-cb80-4197-9061-f65c97beabca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:14.706813 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3379f-cb80-4197-9061-f65c97beabca None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:14.711427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 131/276] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:14.721062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d9a34-f17c-48c3-98d5-23719168acf3 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:14.833363 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 146/277] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:41:14 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:41:14.837091 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d9a34-f17c-48c3-98d5-23719168acf3 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:14.875743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a277f2b-498f-411c-88d4-ec082a312532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:14.876644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a277f2b-498f-411c-88d4-ec082a312532 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:14.876928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a277f2b-498f-411c-88d4-ec082a312532 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:14.877206 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a277f2b-498f-411c-88d4-ec082a312532 None admin] PATH_INFO: `/v3/users/83a2ffc5bd3f413ca3846b1dd32a964c` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:14.894507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a277f2b-498f-411c-88d4-ec082a312532 None admin] RBAC: Authorizing `identity:get_user(user_id=83a2ffc5bd3f413ca3846b1dd32a964c)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:14.896099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a277f2b-498f-411c-88d4-ec082a312532 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:14.898283 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 132/278] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:14 2022] GET /identity/v3/users/83a2ffc5bd3f413ca3846b1dd32a964c => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:14.904337 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3379f-cb80-4197-9061-f65c97beabca None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:15.017589 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3379f-cb80-4197-9061-f65c97beabca None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:15.062035 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8481b-2699-4682-b25d-d63df81ca8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:15.062698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8481b-2699-4682-b25d-d63df81ca8c9 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:15.062977 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8481b-2699-4682-b25d-d63df81ca8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:15.063259 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8481b-2699-4682-b25d-d63df81ca8c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:15.064157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8481b-2699-4682-b25d-d63df81ca8c9 None admin] RBAC: Adding query filter params (role.id=54b3d96f6c9d4d3cbf19a6f0663ba935, user.id=83a2ffc5bd3f413ca3846b1dd32a964c, scope.system=all) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:15.064468 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8481b-2699-4682-b25d-d63df81ca8c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:15.065943 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8481b-2699-4682-b25d-d63df81ca8c9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:15.071538 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 147/279] 10.222.0.52 () {56 vars in 1308 bytes} [Tue Mar 8 11:41:14 2022] GET /identity/v3/role_assignments?user.id=83a2ffc5bd3f413ca3846b1dd32a964c&scope.system=all&role.id=54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:15.171235 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4767f4d-aad3-4ee2-b9fd-23e57cd7625d None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:15.171560 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4767f4d-aad3-4ee2-b9fd-23e57cd7625d None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:15.171744 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4767f4d-aad3-4ee2-b9fd-23e57cd7625d None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:15.173731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 133/280] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:15.180663 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c6661-29a0-40e6-8b63-8b57915ff889 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:15.181186 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c6661-29a0-40e6-8b63-8b57915ff889 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:15.181186 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c6661-29a0-40e6-8b63-8b57915ff889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:15.209206 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-0d9c6661-29a0-40e6-8b63-8b57915ff889 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:15.210808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-0d9c6661-29a0-40e6-8b63-8b57915ff889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:15.295747 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 148/281] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:15.318558 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4767f4d-aad3-4ee2-b9fd-23e57cd7625d None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:15.453179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4767f4d-aad3-4ee2-b9fd-23e57cd7625d None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:15.489588 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590494b0-ed2d-4563-a6a3-55ffca323878 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:15.489905 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590494b0-ed2d-4563-a6a3-55ffca323878 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:15.491564 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590494b0-ed2d-4563-a6a3-55ffca323878 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:15.492481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 149/282] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:41:15.497746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025678fc-4b61-48ec-93a2-b0b9da7a0572 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:15.498027 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025678fc-4b61-48ec-93a2-b0b9da7a0572 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:15.498302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025678fc-4b61-48ec-93a2-b0b9da7a0572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:15.499017 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915993a3-dcf2-4cb9-b637-79db453ee611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:15.500068 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915993a3-dcf2-4cb9-b637-79db453ee611 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:15.500556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915993a3-dcf2-4cb9-b637-79db453ee611 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:15.501019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915993a3-dcf2-4cb9-b637-79db453ee611 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:15.518360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-025678fc-4b61-48ec-93a2-b0b9da7a0572 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:15.521865 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-025678fc-4b61-48ec-93a2-b0b9da7a0572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:15.524711 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915993a3-dcf2-4cb9-b637-79db453ee611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:15.532164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-915993a3-dcf2-4cb9-b637-79db453ee611 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 11:41:15.540436 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 134/283] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:15.547547 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915993a3-dcf2-4cb9-b637-79db453ee611 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:15.665475 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915993a3-dcf2-4cb9-b637-79db453ee611 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:15.670823 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 150/284] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:15.713200 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1481a-d2f1-4159-bf41-07db30c91094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:15.713849 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1481a-d2f1-4159-bf41-07db30c91094 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:15.714129 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1481a-d2f1-4159-bf41-07db30c91094 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:15.714402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1481a-d2f1-4159-bf41-07db30c91094 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:15.715217 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1481a-d2f1-4159-bf41-07db30c91094 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:15.715541 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1481a-d2f1-4159-bf41-07db30c91094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:15.716996 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1481a-d2f1-4159-bf41-07db30c91094 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:15.727288 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 135/285] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:15.733063 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025678fc-4b61-48ec-93a2-b0b9da7a0572 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:15.760427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1481a-d2f1-4159-bf41-07db30c91094 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:15.894278 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025678fc-4b61-48ec-93a2-b0b9da7a0572 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:15.933937 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1481a-d2f1-4159-bf41-07db30c91094 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:15.957599 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9d208-39c3-4b76-a6cb-d28e5d0c5e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:15.958549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9d208-39c3-4b76-a6cb-d28e5d0c5e96 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:15.958937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9d208-39c3-4b76-a6cb-d28e5d0c5e96 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:15.959264 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9d208-39c3-4b76-a6cb-d28e5d0c5e96 None admin] PATH_INFO: `/v3/users/7958dabcb9b142bbbf944cee67d6580d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:15.961253 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9d208-39c3-4b76-a6cb-d28e5d0c5e96 None admin] RBAC: Authorizing `identity:get_user(user_id=7958dabcb9b142bbbf944cee67d6580d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:15.962744 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9d208-39c3-4b76-a6cb-d28e5d0c5e96 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:15.964627 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 151/286] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:15 2022] GET /identity/v3/users/7958dabcb9b142bbbf944cee67d6580d => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:15.976742 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9d208-39c3-4b76-a6cb-d28e5d0c5e96 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:15.983696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e5e21-bfc5-4c32-8879-ebe43f99be37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:15.984774 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e5e21-bfc5-4c32-8879-ebe43f99be37 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:15.985251 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e5e21-bfc5-4c32-8879-ebe43f99be37 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:15.985718 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e5e21-bfc5-4c32-8879-ebe43f99be37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:16.008145 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e5e21-bfc5-4c32-8879-ebe43f99be37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:16.017933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-cb2e5e21-bfc5-4c32-8879-ebe43f99be37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:41:16.022104 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 136/287] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:16.029619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e5e21-bfc5-4c32-8879-ebe43f99be37 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:16.170119 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e5e21-bfc5-4c32-8879-ebe43f99be37 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:16.173716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9d208-39c3-4b76-a6cb-d28e5d0c5e96 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:16.207773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53f1df-3ed5-4a02-aecb-325b7ba5a2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:16.208589 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53f1df-3ed5-4a02-aecb-325b7ba5a2bb None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:16.215615 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53f1df-3ed5-4a02-aecb-325b7ba5a2bb None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:16.215615 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53f1df-3ed5-4a02-aecb-325b7ba5a2bb None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:16.215615 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53f1df-3ed5-4a02-aecb-325b7ba5a2bb None admin] RBAC: Adding query filter params (name=member) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:16.215615 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53f1df-3ed5-4a02-aecb-325b7ba5a2bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:16.215615 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53f1df-3ed5-4a02-aecb-325b7ba5a2bb None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:16.222056 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 137/288] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:16.232499 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53f1df-3ed5-4a02-aecb-325b7ba5a2bb None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:16.246998 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8021ec-9685-4d87-91ce-9e527a94c8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:16.247900 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8021ec-9685-4d87-91ce-9e527a94c8fe None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:16.248179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8021ec-9685-4d87-91ce-9e527a94c8fe None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:16.248449 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8021ec-9685-4d87-91ce-9e527a94c8fe None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:16.249657 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8021ec-9685-4d87-91ce-9e527a94c8fe None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:16.251118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8021ec-9685-4d87-91ce-9e527a94c8fe None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:16.252841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 152/289] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:15 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:16.259698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8021ec-9685-4d87-91ce-9e527a94c8fe None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:16.337636 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53f1df-3ed5-4a02-aecb-325b7ba5a2bb None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:16.384259 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a954dfc-d232-4c7a-955b-e1c5a2ad0743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:16.385159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a954dfc-d232-4c7a-955b-e1c5a2ad0743 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:16.385441 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a954dfc-d232-4c7a-955b-e1c5a2ad0743 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:16.385714 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a954dfc-d232-4c7a-955b-e1c5a2ad0743 None admin] PATH_INFO: `/v3/users/637faedcec954d288acf24c637036946` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:16.388392 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a954dfc-d232-4c7a-955b-e1c5a2ad0743 None admin] RBAC: Authorizing `identity:get_user(user_id=637faedcec954d288acf24c637036946)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:16.390155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a954dfc-d232-4c7a-955b-e1c5a2ad0743 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:16.392439 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 138/290] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:16 2022] GET /identity/v3/users/637faedcec954d288acf24c637036946 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:16.398600 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a954dfc-d232-4c7a-955b-e1c5a2ad0743 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:16.398732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8021ec-9685-4d87-91ce-9e527a94c8fe None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:16.437480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc8ace-fd18-43e2-b089-429a208d55aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:16.438376 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc8ace-fd18-43e2-b089-429a208d55aa None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:16.438657 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc8ace-fd18-43e2-b089-429a208d55aa None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:16.438934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc8ace-fd18-43e2-b089-429a208d55aa None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06/users/7958dabcb9b142bbbf944cee67d6580d/roles/79b8f7dbdec64d1fb686ae3346c01e46` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:16.441867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc8ace-fd18-43e2-b089-429a208d55aa None admin] RBAC: Authorizing `identity:create_grant(project_id=e3d72911271b482a9514071507315e06, user_id=7958dabcb9b142bbbf944cee67d6580d, role_id=79b8f7dbdec64d1fb686ae3346c01e46)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:16.445698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc8ace-fd18-43e2-b089-429a208d55aa None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:16.518445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 153/291] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:41:16 2022] PUT /identity/v3/projects/e3d72911271b482a9514071507315e06/users/7958dabcb9b142bbbf944cee67d6580d/roles/79b8f7dbdec64d1fb686ae3346c01e46 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:41:16.553207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a954dfc-d232-4c7a-955b-e1c5a2ad0743 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:16.602219 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c579b-9889-4885-ab77-25dd39f14aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:16.602963 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c579b-9889-4885-ab77-25dd39f14aaa None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:16.603253 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c579b-9889-4885-ab77-25dd39f14aaa None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:16.603546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c579b-9889-4885-ab77-25dd39f14aaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:16.701029 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c579b-9889-4885-ab77-25dd39f14aaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:16.702590 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c579b-9889-4885-ab77-25dd39f14aaa None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:16.817800 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 139/292] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 11:41:16.823932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc8ace-fd18-43e2-b089-429a208d55aa None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:16.938393 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc8ace-fd18-43e2-b089-429a208d55aa None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:16.976221 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4612c-c502-45b0-b669-4fbfa72e8cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:16.977104 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4612c-c502-45b0-b669-4fbfa72e8cca None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:16.977389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4612c-c502-45b0-b669-4fbfa72e8cca None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:16.977665 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4612c-c502-45b0-b669-4fbfa72e8cca None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:16.978894 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4612c-c502-45b0-b669-4fbfa72e8cca None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:16.980392 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4612c-c502-45b0-b669-4fbfa72e8cca None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:16.982297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 154/293] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:16 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:16.988261 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c579b-9889-4885-ab77-25dd39f14aaa None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:17.134083 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c579b-9889-4885-ab77-25dd39f14aaa None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:17.182253 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f75db5-9b28-4646-9edc-5dd4de5ba05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:17.182925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75db5-9b28-4646-9edc-5dd4de5ba05b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:17.183209 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75db5-9b28-4646-9edc-5dd4de5ba05b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:17.183572 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75db5-9b28-4646-9edc-5dd4de5ba05b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:17.184413 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f75db5-9b28-4646-9edc-5dd4de5ba05b None admin] RBAC: Adding query filter params (role.id=54b3d96f6c9d4d3cbf19a6f0663ba935, scope.project.id=e3d72911271b482a9514071507315e06, user.id=637faedcec954d288acf24c637036946) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:17.184729 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f75db5-9b28-4646-9edc-5dd4de5ba05b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:17.186184 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f75db5-9b28-4646-9edc-5dd4de5ba05b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:17.196589 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 140/294] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:16 2022] GET /identity/v3/role_assignments?user.id=637faedcec954d288acf24c637036946&scope.project.id=e3d72911271b482a9514071507315e06&role.id=54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:17.751563 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6bc20-0257-4f56-983e-c196269eff03 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:17.751563 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6bc20-0257-4f56-983e-c196269eff03 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:17.751563 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6bc20-0257-4f56-983e-c196269eff03 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:17.752966 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 155/295] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:17.758570 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfaf52-469f-4ad1-97c3-3695f2ace74a None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:17.759107 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfaf52-469f-4ad1-97c3-3695f2ace74a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:17.759625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfaf52-469f-4ad1-97c3-3695f2ace74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:17.777333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-63dfaf52-469f-4ad1-97c3-3695f2ace74a None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:17.779083 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-63dfaf52-469f-4ad1-97c3-3695f2ace74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:17.835439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab128a-0e2a-49c5-8e2e-258d8e5f4a89 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:17.836084 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab128a-0e2a-49c5-8e2e-258d8e5f4a89 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:17.836578 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab128a-0e2a-49c5-8e2e-258d8e5f4a89 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:17.840264 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 156/296] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:17.844474 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4818e87-d8bb-40d6-b3d2-07845d4d2d51 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:17.844986 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4818e87-d8bb-40d6-b3d2-07845d4d2d51 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:17.845456 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4818e87-d8bb-40d6-b3d2-07845d4d2d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:17.849915 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 141/297] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:17.863920 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-a4818e87-d8bb-40d6-b3d2-07845d4d2d51 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:17.867314 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a4818e87-d8bb-40d6-b3d2-07845d4d2d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:17.872982 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfaf52-469f-4ad1-97c3-3695f2ace74a None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:17.952004 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 157/298] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:17.952004 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87391eb-421f-40e5-be4e-e6232981c09b None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:17.952004 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87391eb-421f-40e5-be4e-e6232981c09b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:17.952004 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87391eb-421f-40e5-be4e-e6232981c09b None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:17.956133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 158/299] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:17.957348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c435b-f70e-4a27-8ed6-56c6c90ea902 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:17.957634 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c435b-f70e-4a27-8ed6-56c6c90ea902 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:17.957909 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c435b-f70e-4a27-8ed6-56c6c90ea902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:17.977532 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-bf7c435b-f70e-4a27-8ed6-56c6c90ea902 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:17.978657 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfaf52-469f-4ad1-97c3-3695f2ace74a None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:17.978761 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-bf7c435b-f70e-4a27-8ed6-56c6c90ea902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:18.011401 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d44c69-0fe4-4330-a3f4-a6211859c42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:18.012318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d44c69-0fe4-4330-a3f4-a6211859c42b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:18.012619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d44c69-0fe4-4330-a3f4-a6211859c42b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:18.013528 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d44c69-0fe4-4330-a3f4-a6211859c42b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:18.014046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d44c69-0fe4-4330-a3f4-a6211859c42b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:18.015538 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d44c69-0fe4-4330-a3f4-a6211859c42b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:18.023194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 142/300] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:18.023194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d44c69-0fe4-4330-a3f4-a6211859c42b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:18.051377 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 159/301] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:18.053365 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c435b-f70e-4a27-8ed6-56c6c90ea902 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:18.156640 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d44c69-0fe4-4330-a3f4-a6211859c42b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:18.194343 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172038de-d2c6-4e9f-965f-b2d536a408c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:18.195155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172038de-d2c6-4e9f-965f-b2d536a408c0 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:18.195267 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c435b-f70e-4a27-8ed6-56c6c90ea902 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:18.195463 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172038de-d2c6-4e9f-965f-b2d536a408c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:18.195748 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172038de-d2c6-4e9f-965f-b2d536a408c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:18.205651 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172038de-d2c6-4e9f-965f-b2d536a408c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:18.212616 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-172038de-d2c6-4e9f-965f-b2d536a408c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:41:18.218557 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 143/302] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:18.218557 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172038de-d2c6-4e9f-965f-b2d536a408c0 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:18.235610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba53bf5-479f-4793-a89e-b2dfc31ca204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:18.236280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba53bf5-479f-4793-a89e-b2dfc31ca204 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:18.236564 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba53bf5-479f-4793-a89e-b2dfc31ca204 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:18.236840 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba53bf5-479f-4793-a89e-b2dfc31ca204 None admin] PATH_INFO: `/v3/groups` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:18.237523 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba53bf5-479f-4793-a89e-b2dfc31ca204 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:18.238973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba53bf5-479f-4793-a89e-b2dfc31ca204 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:18.306711 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 160/303] 10.222.0.52 () {60 vars in 1134 bytes} [Tue Mar 8 11:41:18 2022] POST /identity/v3/groups => generated 229 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:41:18.307613 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba53bf5-479f-4793-a89e-b2dfc31ca204 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:18.320161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172038de-d2c6-4e9f-965f-b2d536a408c0 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:18.358855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6908ec-e5e0-42a8-a618-f4e249daf3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:18.360216 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6908ec-e5e0-42a8-a618-f4e249daf3ae None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:18.360758 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6908ec-e5e0-42a8-a618-f4e249daf3ae None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:18.361265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6908ec-e5e0-42a8-a618-f4e249daf3ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:18.374232 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6908ec-e5e0-42a8-a618-f4e249daf3ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:18.383071 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-ea6908ec-e5e0-42a8-a618-f4e249daf3ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 11:41:18.384841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 144/304] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:18.390977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6908ec-e5e0-42a8-a618-f4e249daf3ae None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:18.442706 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba53bf5-479f-4793-a89e-b2dfc31ca204 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:18.495760 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2d455-5fcc-4603-844c-0c764cf17d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:18.497093 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2d455-5fcc-4603-844c-0c764cf17d8e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:18.497833 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2d455-5fcc-4603-844c-0c764cf17d8e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:18.498274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2d455-5fcc-4603-844c-0c764cf17d8e None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:18.499678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2d455-5fcc-4603-844c-0c764cf17d8e None admin] RBAC: Adding query filter params (name=member) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:18.500183 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2d455-5fcc-4603-844c-0c764cf17d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:18.501744 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2d455-5fcc-4603-844c-0c764cf17d8e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:18.508688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6908ec-e5e0-42a8-a618-f4e249daf3ae None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:18.511305 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 161/305] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:18.518249 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2d455-5fcc-4603-844c-0c764cf17d8e None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:18.550688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714b473-9637-4ea0-9650-bb5b17ef3fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:18.551370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714b473-9637-4ea0-9650-bb5b17ef3fed None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:18.551690 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714b473-9637-4ea0-9650-bb5b17ef3fed None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:18.551964 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714b473-9637-4ea0-9650-bb5b17ef3fed None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:18.553481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714b473-9637-4ea0-9650-bb5b17ef3fed None admin] RBAC: Adding query filter params (name=reader) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:18.553820 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714b473-9637-4ea0-9650-bb5b17ef3fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:18.555169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714b473-9637-4ea0-9650-bb5b17ef3fed None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:18.565351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 145/306] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:18.571608 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714b473-9637-4ea0-9650-bb5b17ef3fed None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:18.629291 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2d455-5fcc-4603-844c-0c764cf17d8e None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:18.665511 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f4ccd-7592-4ad0-b099-f59b3333e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:18.666669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f4ccd-7592-4ad0-b099-f59b3333e1dd None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:18.667114 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f4ccd-7592-4ad0-b099-f59b3333e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:18.667547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f4ccd-7592-4ad0-b099-f59b3333e1dd None admin] PATH_INFO: `/v3/users/83a2ffc5bd3f413ca3846b1dd32a964c` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:18.668937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f4ccd-7592-4ad0-b099-f59b3333e1dd None admin] RBAC: Authorizing `identity:get_user(user_id=83a2ffc5bd3f413ca3846b1dd32a964c)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:18.670525 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f4ccd-7592-4ad0-b099-f59b3333e1dd None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:18.672621 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 162/307] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:18 2022] GET /identity/v3/users/83a2ffc5bd3f413ca3846b1dd32a964c => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:18.678434 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f4ccd-7592-4ad0-b099-f59b3333e1dd None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:18.683596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714b473-9637-4ea0-9650-bb5b17ef3fed None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:18.724254 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6bf45-b49c-4762-9ef2-974bee97135d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:18.725887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6bf45-b49c-4762-9ef2-974bee97135d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:18.726346 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6bf45-b49c-4762-9ef2-974bee97135d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:18.726799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6bf45-b49c-4762-9ef2-974bee97135d None admin] PATH_INFO: `/v3/users/58bd7288a70541648df07974d8745c7f` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:18.744258 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6bf45-b49c-4762-9ef2-974bee97135d None admin] RBAC: Authorizing `identity:get_user(user_id=58bd7288a70541648df07974d8745c7f)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:18.746411 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6bf45-b49c-4762-9ef2-974bee97135d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:18.753910 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 146/308] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:18 2022] GET /identity/v3/users/58bd7288a70541648df07974d8745c7f => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:18.754888 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6bf45-b49c-4762-9ef2-974bee97135d None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:18.792848 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f4ccd-7592-4ad0-b099-f59b3333e1dd None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:18.827443 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abc467-9dbc-4e58-9c92-2b9e5d43454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:18.828709 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abc467-9dbc-4e58-9c92-2b9e5d43454b None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:18.829183 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abc467-9dbc-4e58-9c92-2b9e5d43454b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:18.829671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abc467-9dbc-4e58-9c92-2b9e5d43454b None admin] PATH_INFO: `/v3/system/users/83a2ffc5bd3f413ca3846b1dd32a964c/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:18.831562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abc467-9dbc-4e58-9c92-2b9e5d43454b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=83a2ffc5bd3f413ca3846b1dd32a964c, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:18.833140 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abc467-9dbc-4e58-9c92-2b9e5d43454b None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:18.855296 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6bf45-b49c-4762-9ef2-974bee97135d None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:18.890960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4dd49-898a-40d3-8315-87348186ee36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:18.891672 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4dd49-898a-40d3-8315-87348186ee36 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:18.891957 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4dd49-898a-40d3-8315-87348186ee36 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:18.892283 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4dd49-898a-40d3-8315-87348186ee36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:18.893074 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4dd49-898a-40d3-8315-87348186ee36 None admin] RBAC: Adding query filter params (role.id=79b8f7dbdec64d1fb686ae3346c01e46, user.id=58bd7288a70541648df07974d8745c7f, scope.system=all) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:18.893383 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4dd49-898a-40d3-8315-87348186ee36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:18.894831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4dd49-898a-40d3-8315-87348186ee36 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:18.900722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 147/309] 10.222.0.52 () {56 vars in 1308 bytes} [Tue Mar 8 11:41:18 2022] GET /identity/v3/role_assignments?user.id=58bd7288a70541648df07974d8745c7f&scope.system=all&role.id=79b8f7dbdec64d1fb686ae3346c01e46 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:18.947448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 163/310] 10.222.0.52 () {58 vars in 1334 bytes} [Tue Mar 8 11:41:18 2022] PUT /identity/v3/system/users/83a2ffc5bd3f413ca3846b1dd32a964c/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 11:41:19.248648 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60556752-42f8-4ca4-a372-b31f1d68ac08 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:19.249218 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60556752-42f8-4ca4-a372-b31f1d68ac08 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:19.249218 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60556752-42f8-4ca4-a372-b31f1d68ac08 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:19.250986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 148/311] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:19.256624 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f01e37-542c-4a26-8ca1-72bb67693f13 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:19.257176 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f01e37-542c-4a26-8ca1-72bb67693f13 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:19.257665 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f01e37-542c-4a26-8ca1-72bb67693f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:19.275701 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-89f01e37-542c-4a26-8ca1-72bb67693f13 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:19.277185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-89f01e37-542c-4a26-8ca1-72bb67693f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:19.346265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 164/312] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:19.369601 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60556752-42f8-4ca4-a372-b31f1d68ac08 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:19.480742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60556752-42f8-4ca4-a372-b31f1d68ac08 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:19.514418 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87df50-1f53-4a5a-ba8e-21d7617d7f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:19.515241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87df50-1f53-4a5a-ba8e-21d7617d7f74 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:19.515543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87df50-1f53-4a5a-ba8e-21d7617d7f74 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:19.515882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87df50-1f53-4a5a-ba8e-21d7617d7f74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:19.528379 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87df50-1f53-4a5a-ba8e-21d7617d7f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:19.535433 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-3a87df50-1f53-4a5a-ba8e-21d7617d7f74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 11:41:19.537653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 149/313] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:19.543393 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f01e37-542c-4a26-8ca1-72bb67693f13 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:19.639325 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f01e37-542c-4a26-8ca1-72bb67693f13 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:19.673771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426236b0-e8ec-4931-aad2-4929ab246a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:19.674482 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426236b0-e8ec-4931-aad2-4929ab246a0e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:19.674862 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426236b0-e8ec-4931-aad2-4929ab246a0e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:19.675232 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426236b0-e8ec-4931-aad2-4929ab246a0e None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:19.676088 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426236b0-e8ec-4931-aad2-4929ab246a0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:19.676426 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426236b0-e8ec-4931-aad2-4929ab246a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:19.678424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426236b0-e8ec-4931-aad2-4929ab246a0e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:19.689651 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 165/314] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:19.695260 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87df50-1f53-4a5a-ba8e-21d7617d7f74 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:19.797043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87df50-1f53-4a5a-ba8e-21d7617d7f74 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:19.831324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dab16b-32b3-4293-93a7-61bf0eaf9503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:19.832237 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dab16b-32b3-4293-93a7-61bf0eaf9503 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:19.832515 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dab16b-32b3-4293-93a7-61bf0eaf9503 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:19.832787 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dab16b-32b3-4293-93a7-61bf0eaf9503 None admin] PATH_INFO: `/v3/users/7958dabcb9b142bbbf944cee67d6580d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:19.834065 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dab16b-32b3-4293-93a7-61bf0eaf9503 None admin] RBAC: Authorizing `identity:get_user(user_id=7958dabcb9b142bbbf944cee67d6580d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:19.835785 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dab16b-32b3-4293-93a7-61bf0eaf9503 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:19.837730 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 150/315] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:19 2022] GET /identity/v3/users/7958dabcb9b142bbbf944cee67d6580d => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:19.843101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426236b0-e8ec-4931-aad2-4929ab246a0e None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:19.943473 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426236b0-e8ec-4931-aad2-4929ab246a0e None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:19.977146 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c49c2-5828-4e89-9399-c082d70d8578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:19.977800 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c49c2-5828-4e89-9399-c082d70d8578 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:19.978083 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c49c2-5828-4e89-9399-c082d70d8578 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:19.978357 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c49c2-5828-4e89-9399-c082d70d8578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:20.051952 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c49c2-5828-4e89-9399-c082d70d8578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:20.054368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c49c2-5828-4e89-9399-c082d70d8578 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:20.158410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 166/316] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:20.164686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dab16b-32b3-4293-93a7-61bf0eaf9503 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:20.268752 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dab16b-32b3-4293-93a7-61bf0eaf9503 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:20.303719 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26bec8-16d9-4b4d-aada-f86d8d7c0287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:20.304865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26bec8-16d9-4b4d-aada-f86d8d7c0287 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:20.305324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26bec8-16d9-4b4d-aada-f86d8d7c0287 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:20.305776 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26bec8-16d9-4b4d-aada-f86d8d7c0287 None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:20.307228 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26bec8-16d9-4b4d-aada-f86d8d7c0287 None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:20.308876 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26bec8-16d9-4b4d-aada-f86d8d7c0287 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:20.311078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 151/317] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:20 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:20.317127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c49c2-5828-4e89-9399-c082d70d8578 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:20.419143 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c49c2-5828-4e89-9399-c082d70d8578 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:20.453411 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f4b68-1750-4473-ae18-130d2074f8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:20.454358 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f4b68-1750-4473-ae18-130d2074f8e2 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:20.454848 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f4b68-1750-4473-ae18-130d2074f8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:20.455313 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f4b68-1750-4473-ae18-130d2074f8e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:20.456325 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f4b68-1750-4473-ae18-130d2074f8e2 None admin] RBAC: Adding query filter params (role.id=79b8f7dbdec64d1fb686ae3346c01e46, scope.project.id=e3d72911271b482a9514071507315e06, user.id=7958dabcb9b142bbbf944cee67d6580d) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:20.456815 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f4b68-1750-4473-ae18-130d2074f8e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:20.458487 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f4b68-1750-4473-ae18-130d2074f8e2 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:20.464653 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 167/318] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:20 2022] GET /identity/v3/role_assignments?user.id=7958dabcb9b142bbbf944cee67d6580d&scope.project.id=e3d72911271b482a9514071507315e06&role.id=79b8f7dbdec64d1fb686ae3346c01e46 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:20.731015 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044223ff-e153-4f93-9f07-26c285ccab9c None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:20.731377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044223ff-e153-4f93-9f07-26c285ccab9c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:20.731603 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044223ff-e153-4f93-9f07-26c285ccab9c None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:20.733521 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 152/319] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:20.738801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03808a8-8d06-4fc3-b959-78235c672914 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:20.739087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03808a8-8d06-4fc3-b959-78235c672914 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:20.739392 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03808a8-8d06-4fc3-b959-78235c672914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:20.756240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c03808a8-8d06-4fc3-b959-78235c672914 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:20.757433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c03808a8-8d06-4fc3-b959-78235c672914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:20.821493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 168/320] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:20.844369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044223ff-e153-4f93-9f07-26c285ccab9c None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:20.947599 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044223ff-e153-4f93-9f07-26c285ccab9c None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:20.982176 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939eb8ea-cc14-48ca-a29a-172c510293ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:20.982900 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939eb8ea-cc14-48ca-a29a-172c510293ec None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:20.983184 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939eb8ea-cc14-48ca-a29a-172c510293ec None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:20.983459 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939eb8ea-cc14-48ca-a29a-172c510293ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:20.984653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939eb8ea-cc14-48ca-a29a-172c510293ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:20.986103 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939eb8ea-cc14-48ca-a29a-172c510293ec None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:20.987902 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 153/321] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:20.993307 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03808a8-8d06-4fc3-b959-78235c672914 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:21.088923 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03808a8-8d06-4fc3-b959-78235c672914 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:21.120266 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea287c4-2a0f-45ca-a3ed-825d3e8ed9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:21.120937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea287c4-2a0f-45ca-a3ed-825d3e8ed9e1 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:21.121216 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea287c4-2a0f-45ca-a3ed-825d3e8ed9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:21.121492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea287c4-2a0f-45ca-a3ed-825d3e8ed9e1 None admin] PATH_INFO: `/v3/groups` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:21.122185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea287c4-2a0f-45ca-a3ed-825d3e8ed9e1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:21.123658 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea287c4-2a0f-45ca-a3ed-825d3e8ed9e1 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:21.219630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 169/322] 10.222.0.52 () {60 vars in 1134 bytes} [Tue Mar 8 11:41:20 2022] POST /identity/v3/groups => generated 226 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 11:41:21.271845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f1943-9909-4ab0-b645-6497ecdfdc5d None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:21.272344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f1943-9909-4ab0-b645-6497ecdfdc5d None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:21.272418 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f1943-9909-4ab0-b645-6497ecdfdc5d None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:21.274460 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 154/323] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:21.282419 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150754be-e2fd-45e4-9cd8-71978c58b430 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:21.282752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150754be-e2fd-45e4-9cd8-71978c58b430 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:21.282972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150754be-e2fd-45e4-9cd8-71978c58b430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:21.300355 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-150754be-e2fd-45e4-9cd8-71978c58b430 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:21.301573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-150754be-e2fd-45e4-9cd8-71978c58b430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:21.306464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc733d5-a1ee-4eae-a37d-c421d565781a None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:21.306766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc733d5-a1ee-4eae-a37d-c421d565781a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:21.307020 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc733d5-a1ee-4eae-a37d-c421d565781a None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:21.309014 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 155/324] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:41:21.315469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338a038-4dff-4f24-b31f-e0c24ba0be72 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:21.315786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338a038-4dff-4f24-b31f-e0c24ba0be72 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:21.316061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338a038-4dff-4f24-b31f-e0c24ba0be72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:21.336206 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-7338a038-4dff-4f24-b31f-e0c24ba0be72 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:21.337525 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-7338a038-4dff-4f24-b31f-e0c24ba0be72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:21.375171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 170/325] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:21.398522 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150754be-e2fd-45e4-9cd8-71978c58b430 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:21.417556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 156/326] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:21.440276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338a038-4dff-4f24-b31f-e0c24ba0be72 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:21.511895 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150754be-e2fd-45e4-9cd8-71978c58b430 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:21.555854 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f12aa-b8a3-4b1a-b031-b0c8343e541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:21.557007 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f12aa-b8a3-4b1a-b031-b0c8343e541b None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:21.557007 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f12aa-b8a3-4b1a-b031-b0c8343e541b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:21.557191 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f12aa-b8a3-4b1a-b031-b0c8343e541b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:21.559923 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338a038-4dff-4f24-b31f-e0c24ba0be72 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:21.570705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f12aa-b8a3-4b1a-b031-b0c8343e541b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:21.578518 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-5a9f12aa-b8a3-4b1a-b031-b0c8343e541b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:41:21.580052 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 171/327] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:21.586947 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f12aa-b8a3-4b1a-b031-b0c8343e541b None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:21.602440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2517399-7df8-4e6e-ae2d-b885ebf29490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:21.603626 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2517399-7df8-4e6e-ae2d-b885ebf29490 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:21.604140 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2517399-7df8-4e6e-ae2d-b885ebf29490 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:21.604618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2517399-7df8-4e6e-ae2d-b885ebf29490 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:21.617159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2517399-7df8-4e6e-ae2d-b885ebf29490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:21.625240 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-b2517399-7df8-4e6e-ae2d-b885ebf29490 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 11:41:21.626470 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 157/328] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:21.634169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2517399-7df8-4e6e-ae2d-b885ebf29490 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:21.708634 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f12aa-b8a3-4b1a-b031-b0c8343e541b None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:21.749579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68954ad2-af54-48a8-b418-48c0d446f593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:21.750255 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68954ad2-af54-48a8-b418-48c0d446f593 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:21.750700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68954ad2-af54-48a8-b418-48c0d446f593 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:21.750987 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68954ad2-af54-48a8-b418-48c0d446f593 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:21.752225 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68954ad2-af54-48a8-b418-48c0d446f593 None admin] RBAC: Adding query filter params (name=member) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:21.752654 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68954ad2-af54-48a8-b418-48c0d446f593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:21.754207 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68954ad2-af54-48a8-b418-48c0d446f593 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:21.760537 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2517399-7df8-4e6e-ae2d-b885ebf29490 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:21.765343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 172/329] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:21.770469 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68954ad2-af54-48a8-b418-48c0d446f593 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:21.800504 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395656b8-e35b-4132-91f5-3a74f0d86198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:21.801312 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395656b8-e35b-4132-91f5-3a74f0d86198 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:21.801663 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395656b8-e35b-4132-91f5-3a74f0d86198 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:21.802007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395656b8-e35b-4132-91f5-3a74f0d86198 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:21.802862 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395656b8-e35b-4132-91f5-3a74f0d86198 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:21.803259 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395656b8-e35b-4132-91f5-3a74f0d86198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:21.805631 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395656b8-e35b-4132-91f5-3a74f0d86198 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:21.815078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 158/330] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:21.820909 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395656b8-e35b-4132-91f5-3a74f0d86198 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:21.892672 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68954ad2-af54-48a8-b418-48c0d446f593 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:21.937487 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3d609-ce25-45fb-9150-4c75f047d665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:21.938532 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3d609-ce25-45fb-9150-4c75f047d665 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:21.939137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3d609-ce25-45fb-9150-4c75f047d665 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:21.939419 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3d609-ce25-45fb-9150-4c75f047d665 None admin] PATH_INFO: `/v3/users/83a2ffc5bd3f413ca3846b1dd32a964c` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:21.941078 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3d609-ce25-45fb-9150-4c75f047d665 None admin] RBAC: Authorizing `identity:get_user(user_id=83a2ffc5bd3f413ca3846b1dd32a964c)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:21.942539 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3d609-ce25-45fb-9150-4c75f047d665 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:21.946009 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 173/331] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:21 2022] GET /identity/v3/users/83a2ffc5bd3f413ca3846b1dd32a964c => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:21.950646 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395656b8-e35b-4132-91f5-3a74f0d86198 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:21.951237 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3d609-ce25-45fb-9150-4c75f047d665 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:21.984234 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24511bf6-d628-4d25-9ed6-bdc819e3f105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:21.985102 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24511bf6-d628-4d25-9ed6-bdc819e3f105 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:21.985382 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24511bf6-d628-4d25-9ed6-bdc819e3f105 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:21.985651 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24511bf6-d628-4d25-9ed6-bdc819e3f105 None admin] PATH_INFO: `/v3/users/58bd7288a70541648df07974d8745c7f` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:21.986851 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24511bf6-d628-4d25-9ed6-bdc819e3f105 None admin] RBAC: Authorizing `identity:get_user(user_id=58bd7288a70541648df07974d8745c7f)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:21.988309 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24511bf6-d628-4d25-9ed6-bdc819e3f105 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:21.990767 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 159/332] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:21 2022] GET /identity/v3/users/58bd7288a70541648df07974d8745c7f => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:21.996352 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24511bf6-d628-4d25-9ed6-bdc819e3f105 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:22.060436 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3d609-ce25-45fb-9150-4c75f047d665 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:22.155192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326d4e2-ad9b-4e24-bc10-2957ea5e327c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:22.155848 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326d4e2-ad9b-4e24-bc10-2957ea5e327c None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:22.156130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326d4e2-ad9b-4e24-bc10-2957ea5e327c None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:22.156411 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326d4e2-ad9b-4e24-bc10-2957ea5e327c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:22.157240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326d4e2-ad9b-4e24-bc10-2957ea5e327c None admin] RBAC: Adding query filter params (role.id=54b3d96f6c9d4d3cbf19a6f0663ba935, user.id=83a2ffc5bd3f413ca3846b1dd32a964c, scope.system=all) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:22.157550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326d4e2-ad9b-4e24-bc10-2957ea5e327c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:22.159011 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326d4e2-ad9b-4e24-bc10-2957ea5e327c None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:22.171955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 174/333] 10.222.0.52 () {56 vars in 1308 bytes} [Tue Mar 8 11:41:21 2022] GET /identity/v3/role_assignments?user.id=83a2ffc5bd3f413ca3846b1dd32a964c&scope.system=all&role.id=54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:22.228955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24511bf6-d628-4d25-9ed6-bdc819e3f105 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:22.265406 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53537264-dbd4-4d8e-89cb-4b26c07f3edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:22.266290 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53537264-dbd4-4d8e-89cb-4b26c07f3edd None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:22.266572 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53537264-dbd4-4d8e-89cb-4b26c07f3edd None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:22.266847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53537264-dbd4-4d8e-89cb-4b26c07f3edd None admin] PATH_INFO: `/v3/system/users/58bd7288a70541648df07974d8745c7f/roles/79b8f7dbdec64d1fb686ae3346c01e46` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:22.268495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53537264-dbd4-4d8e-89cb-4b26c07f3edd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=58bd7288a70541648df07974d8745c7f, role_id=79b8f7dbdec64d1fb686ae3346c01e46)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:22.269917 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53537264-dbd4-4d8e-89cb-4b26c07f3edd None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:22.343057 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 160/334] 10.222.0.52 () {58 vars in 1334 bytes} [Tue Mar 8 11:41:21 2022] PUT /identity/v3/system/users/58bd7288a70541648df07974d8745c7f/roles/79b8f7dbdec64d1fb686ae3346c01e46 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 11:41:24.541669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fb1eb-8bf0-48a3-bfd0-dfba1b29c537 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:24.542193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fb1eb-8bf0-48a3-bfd0-dfba1b29c537 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:24.542193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fb1eb-8bf0-48a3-bfd0-dfba1b29c537 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:24.543976 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 175/335] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:24.549728 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36e04c-addd-45e0-b220-563ef3f9cba3 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:24.550224 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36e04c-addd-45e0-b220-563ef3f9cba3 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:24.550415 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36e04c-addd-45e0-b220-563ef3f9cba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:24.580834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-1d36e04c-addd-45e0-b220-563ef3f9cba3 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:24.582080 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1d36e04c-addd-45e0-b220-563ef3f9cba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:24.659863 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 161/336] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:24.700590 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fb1eb-8bf0-48a3-bfd0-dfba1b29c537 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:24.814538 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fb1eb-8bf0-48a3-bfd0-dfba1b29c537 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:24.863065 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd37999-ed79-44de-9d54-25a9b6339a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:24.863919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd37999-ed79-44de-9d54-25a9b6339a0e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:24.864201 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd37999-ed79-44de-9d54-25a9b6339a0e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:24.865281 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd37999-ed79-44de-9d54-25a9b6339a0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:24.881373 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd37999-ed79-44de-9d54-25a9b6339a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:24.888794 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-3dd37999-ed79-44de-9d54-25a9b6339a0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 11:41:24.890229 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 176/337] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:41:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:24.896001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36e04c-addd-45e0-b220-563ef3f9cba3 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:25.002495 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b803fd-eaeb-4b5f-b878-b9dde726d7c6 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:25.002832 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b803fd-eaeb-4b5f-b878-b9dde726d7c6 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:25.003054 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b803fd-eaeb-4b5f-b878-b9dde726d7c6 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:25.004873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 177/338] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:41:25.011127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7843b-8e5a-4bee-bc9d-3de42edc01eb None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:25.011403 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7843b-8e5a-4bee-bc9d-3de42edc01eb None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:25.011692 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7843b-8e5a-4bee-bc9d-3de42edc01eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:25.025467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36e04c-addd-45e0-b220-563ef3f9cba3 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:25.038765 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-48f7843b-8e5a-4bee-bc9d-3de42edc01eb None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:25.040286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-48f7843b-8e5a-4bee-bc9d-3de42edc01eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:25.085639 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4277f8-ccb7-4a9d-868a-5ca534d0308d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:25.086841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4277f8-ccb7-4a9d-868a-5ca534d0308d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:25.088241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4277f8-ccb7-4a9d-868a-5ca534d0308d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:25.089304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4277f8-ccb7-4a9d-868a-5ca534d0308d None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:25.090433 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4277f8-ccb7-4a9d-868a-5ca534d0308d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:25.091544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4277f8-ccb7-4a9d-868a-5ca534d0308d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:25.093683 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4277f8-ccb7-4a9d-868a-5ca534d0308d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:25.113168 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 162/339] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:25.120534 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca900b-bce9-4a98-8290-9a6a93d9664f None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:25.121659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca900b-bce9-4a98-8290-9a6a93d9664f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:25.122664 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca900b-bce9-4a98-8290-9a6a93d9664f None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:25.127063 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 163/340] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:25.130679 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9215960-6940-44a3-9b06-28c1be447694 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:25.132214 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9215960-6940-44a3-9b06-28c1be447694 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:25.132854 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9215960-6940-44a3-9b06-28c1be447694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:25.166991 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 178/341] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:25.168188 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7843b-8e5a-4bee-bc9d-3de42edc01eb None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:25.171608 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-a9215960-6940-44a3-9b06-28c1be447694 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:25.173851 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a9215960-6940-44a3-9b06-28c1be447694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:25.321349 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 164/342] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:25.322113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9215960-6940-44a3-9b06-28c1be447694 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:25.367794 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7843b-8e5a-4bee-bc9d-3de42edc01eb None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:25.437198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24e8e1-2e5e-4e8e-9163-421a726b0c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:25.437866 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24e8e1-2e5e-4e8e-9163-421a726b0c81 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:25.438285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24e8e1-2e5e-4e8e-9163-421a726b0c81 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:25.438572 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24e8e1-2e5e-4e8e-9163-421a726b0c81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:25.516752 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9215960-6940-44a3-9b06-28c1be447694 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:25.542819 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24e8e1-2e5e-4e8e-9163-421a726b0c81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:25.544319 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24e8e1-2e5e-4e8e-9163-421a726b0c81 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:25.580747 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f9ac5-ed9c-4b06-ad05-57814847db99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:25.582143 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f9ac5-ed9c-4b06-ad05-57814847db99 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:25.582613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f9ac5-ed9c-4b06-ad05-57814847db99 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:25.583117 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f9ac5-ed9c-4b06-ad05-57814847db99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:25.602205 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f9ac5-ed9c-4b06-ad05-57814847db99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:25.616279 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-789f9ac5-ed9c-4b06-ad05-57814847db99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:41:25.616279 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 165/343] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:25.616707 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f9ac5-ed9c-4b06-ad05-57814847db99 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:25.651842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 179/344] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:25.652797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24e8e1-2e5e-4e8e-9163-421a726b0c81 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:25.751231 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24e8e1-2e5e-4e8e-9163-421a726b0c81 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:25.756061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f9ac5-ed9c-4b06-ad05-57814847db99 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:25.795576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16ad00-c1fc-4faf-9255-999f90fb9045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:25.796266 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16ad00-c1fc-4faf-9255-999f90fb9045 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:25.796548 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16ad00-c1fc-4faf-9255-999f90fb9045 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:25.796823 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16ad00-c1fc-4faf-9255-999f90fb9045 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:25.797574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16ad00-c1fc-4faf-9255-999f90fb9045 None admin] RBAC: Adding query filter params (name=member) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:25.797881 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16ad00-c1fc-4faf-9255-999f90fb9045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:25.799275 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16ad00-c1fc-4faf-9255-999f90fb9045 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:25.807896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221643f-f73f-4896-b010-d3d67992e847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:25.808711 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221643f-f73f-4896-b010-d3d67992e847 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:25.809186 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221643f-f73f-4896-b010-d3d67992e847 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:25.809360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 180/345] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:25.809521 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221643f-f73f-4896-b010-d3d67992e847 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:25.810008 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16ad00-c1fc-4faf-9255-999f90fb9045 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:25.826538 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221643f-f73f-4896-b010-d3d67992e847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:25.834301 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-0221643f-f73f-4896-b010-d3d67992e847 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:41:25.835867 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 166/346] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:25.837107 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a5ff-c79f-449e-8b3e-647f62ba84f0 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:25.837390 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a5ff-c79f-449e-8b3e-647f62ba84f0 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:25.837660 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a5ff-c79f-449e-8b3e-647f62ba84f0 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:25.839340 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 167/347] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:25.841136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7a5ff-c79f-449e-8b3e-647f62ba84f0 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:25.931301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16ad00-c1fc-4faf-9255-999f90fb9045 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:25.972481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988d016-8ff9-4cd8-aa73-e569ea353c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:25.974084 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988d016-8ff9-4cd8-aa73-e569ea353c20 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:25.974640 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988d016-8ff9-4cd8-aa73-e569ea353c20 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:25.975165 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988d016-8ff9-4cd8-aa73-e569ea353c20 None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:25.976989 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988d016-8ff9-4cd8-aa73-e569ea353c20 None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:25.979033 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988d016-8ff9-4cd8-aa73-e569ea353c20 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:25.980572 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7a5ff-c79f-449e-8b3e-647f62ba84f0 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:25.981659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 181/348] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:25 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:25.983309 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9a010-3c93-4846-ae06-3885083f0bb7 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:25.988421 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9a010-3c93-4846-ae06-3885083f0bb7 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:25.988421 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9a010-3c93-4846-ae06-3885083f0bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:26.006194 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-95e9a010-3c93-4846-ae06-3885083f0bb7 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:26.007374 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-95e9a010-3c93-4846-ae06-3885083f0bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:26.029066 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b7358-f7e6-4ee4-9c3f-66eddefd90d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:26.030541 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b7358-f7e6-4ee4-9c3f-66eddefd90d7 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:26.031037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b7358-f7e6-4ee4-9c3f-66eddefd90d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:26.031707 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b7358-f7e6-4ee4-9c3f-66eddefd90d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:26.079684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 182/349] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:26.081227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9a010-3c93-4846-ae06-3885083f0bb7 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:26.122755 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b7358-f7e6-4ee4-9c3f-66eddefd90d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:26.124251 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b7358-f7e6-4ee4-9c3f-66eddefd90d7 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:26.229014 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 168/350] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:26.229920 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b7358-f7e6-4ee4-9c3f-66eddefd90d7 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:26.251511 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9a010-3c93-4846-ae06-3885083f0bb7 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:26.298517 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f9008-9cd0-411d-bd3e-830ab5b03af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:26.299205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f9008-9cd0-411d-bd3e-830ab5b03af8 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:26.299486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f9008-9cd0-411d-bd3e-830ab5b03af8 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:26.299778 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f9008-9cd0-411d-bd3e-830ab5b03af8 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:26.300536 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f9008-9cd0-411d-bd3e-830ab5b03af8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:26.300837 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f9008-9cd0-411d-bd3e-830ab5b03af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:26.303115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f9008-9cd0-411d-bd3e-830ab5b03af8 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:26.316530 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 183/351] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:26.317692 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f9008-9cd0-411d-bd3e-830ab5b03af8 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:26.355994 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b7358-f7e6-4ee4-9c3f-66eddefd90d7 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:26.392773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652831d0-214e-4dab-ae23-5eb205770c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:26.394115 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652831d0-214e-4dab-ae23-5eb205770c7d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:26.394115 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652831d0-214e-4dab-ae23-5eb205770c7d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:26.394590 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652831d0-214e-4dab-ae23-5eb205770c7d None admin] PATH_INFO: `/v3/groups/251a8633493b4e9ca9cbd51bba53c59f` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:26.400958 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652831d0-214e-4dab-ae23-5eb205770c7d None admin] RBAC: Authorizing `identity:get_group(group_id=251a8633493b4e9ca9cbd51bba53c59f)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:26.402840 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652831d0-214e-4dab-ae23-5eb205770c7d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:26.404815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 169/352] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 11:41:26 2022] GET /identity/v3/groups/251a8633493b4e9ca9cbd51bba53c59f => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:26.405519 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652831d0-214e-4dab-ae23-5eb205770c7d None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:26.440892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f9008-9cd0-411d-bd3e-830ab5b03af8 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:26.480320 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339027e-d00f-45d0-877f-4b056c37b6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:26.481261 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339027e-d00f-45d0-877f-4b056c37b6da None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:26.481681 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339027e-d00f-45d0-877f-4b056c37b6da None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:26.482052 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339027e-d00f-45d0-877f-4b056c37b6da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:26.494705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339027e-d00f-45d0-877f-4b056c37b6da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:26.502239 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-4339027e-d00f-45d0-877f-4b056c37b6da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 11:41:26.503672 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 184/353] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:41:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:26.504574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339027e-d00f-45d0-877f-4b056c37b6da None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:26.531179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652831d0-214e-4dab-ae23-5eb205770c7d None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:26.574303 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440161cb-44c4-4b99-9253-276c0955e061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:26.575713 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440161cb-44c4-4b99-9253-276c0955e061 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:26.576138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440161cb-44c4-4b99-9253-276c0955e061 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:26.576553 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440161cb-44c4-4b99-9253-276c0955e061 None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:26.578097 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440161cb-44c4-4b99-9253-276c0955e061 None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:26.580544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440161cb-44c4-4b99-9253-276c0955e061 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:26.584228 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 170/354] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:26 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:26.585616 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440161cb-44c4-4b99-9253-276c0955e061 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:26.616317 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339027e-d00f-45d0-877f-4b056c37b6da None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:26.656786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6b3ae-f29c-4f70-8a84-dedee774e8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:26.657657 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6b3ae-f29c-4f70-8a84-dedee774e8bb None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:26.658040 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6b3ae-f29c-4f70-8a84-dedee774e8bb None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:26.658550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6b3ae-f29c-4f70-8a84-dedee774e8bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:26.711171 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440161cb-44c4-4b99-9253-276c0955e061 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:26.733049 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6b3ae-f29c-4f70-8a84-dedee774e8bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:26.734443 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6b3ae-f29c-4f70-8a84-dedee774e8bb None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:26.751458 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3dd69-69f6-45b1-b7c7-0a7c8e8a88f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:26.752452 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3dd69-69f6-45b1-b7c7-0a7c8e8a88f4 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:26.752915 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3dd69-69f6-45b1-b7c7-0a7c8e8a88f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:26.753369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3dd69-69f6-45b1-b7c7-0a7c8e8a88f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:26.754352 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3dd69-69f6-45b1-b7c7-0a7c8e8a88f4 None admin] RBAC: Adding query filter params (group.id=251a8633493b4e9ca9cbd51bba53c59f, role.id=2ca014d08f26466b980433e75e765505, scope.project.id=2795ff37998c454597b382c5096edefd) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:26.755125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3dd69-69f6-45b1-b7c7-0a7c8e8a88f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:26.756829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3dd69-69f6-45b1-b7c7-0a7c8e8a88f4 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:26.762537 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 171/355] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 11:41:26 2022] GET /identity/v3/role_assignments?group.id=251a8633493b4e9ca9cbd51bba53c59f&scope.project.id=2795ff37998c454597b382c5096edefd&role.id=2ca014d08f26466b980433e75e765505 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:26.763282 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3dd69-69f6-45b1-b7c7-0a7c8e8a88f4 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:26.865588 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 185/356] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:26.866728 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6b3ae-f29c-4f70-8a84-dedee774e8bb None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:26.902752 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3dd69-69f6-45b1-b7c7-0a7c8e8a88f4 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:26.944907 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011b43a-37aa-4942-903f-9401cff2e425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:26.945603 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011b43a-37aa-4942-903f-9401cff2e425 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:26.945891 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011b43a-37aa-4942-903f-9401cff2e425 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:26.946175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011b43a-37aa-4942-903f-9401cff2e425 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:26.946939 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011b43a-37aa-4942-903f-9401cff2e425 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:26.947345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011b43a-37aa-4942-903f-9401cff2e425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:26.948805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011b43a-37aa-4942-903f-9401cff2e425 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:26.958457 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 172/357] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:26.960057 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0481a5-06ad-4414-ac2c-24b3480b2f0a None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:26.960345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0481a5-06ad-4414-ac2c-24b3480b2f0a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:26.960622 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0481a5-06ad-4414-ac2c-24b3480b2f0a None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:26.962337 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 173/358] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:26.965625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3fb15-e506-408d-b0c0-633fe57e6c12 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:26.965625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3fb15-e506-408d-b0c0-633fe57e6c12 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:26.965625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3fb15-e506-408d-b0c0-633fe57e6c12 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:26.968260 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 174/359] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:26.968554 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3fb15-e506-408d-b0c0-633fe57e6c12 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:27.011556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6b3ae-f29c-4f70-8a84-dedee774e8bb None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:27.052739 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4f148-8a3f-412d-b7d8-79596870d850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:27.053985 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4f148-8a3f-412d-b7d8-79596870d850 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:27.054476 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4f148-8a3f-412d-b7d8-79596870d850 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:27.054936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4f148-8a3f-412d-b7d8-79596870d850 None admin] PATH_INFO: `/v3/groups/251a8633493b4e9ca9cbd51bba53c59f` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:27.057164 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4f148-8a3f-412d-b7d8-79596870d850 None admin] RBAC: Authorizing `identity:get_group(group_id=251a8633493b4e9ca9cbd51bba53c59f)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:27.058825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4f148-8a3f-412d-b7d8-79596870d850 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:27.060558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 186/360] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 11:41:26 2022] GET /identity/v3/groups/251a8633493b4e9ca9cbd51bba53c59f => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:27.062043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4f148-8a3f-412d-b7d8-79596870d850 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:27.096196 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3fb15-e506-408d-b0c0-633fe57e6c12 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:27.138136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42a7db-ae1b-4231-a1ea-9f72698a7a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:27.139385 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42a7db-ae1b-4231-a1ea-9f72698a7a52 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:27.139790 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42a7db-ae1b-4231-a1ea-9f72698a7a52 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:27.140134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42a7db-ae1b-4231-a1ea-9f72698a7a52 None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:27.141843 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42a7db-ae1b-4231-a1ea-9f72698a7a52 None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:27.143321 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42a7db-ae1b-4231-a1ea-9f72698a7a52 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:27.145077 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 175/361] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:26 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:27.147037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1255789-5426-45ae-8f68-e8f78eab8caa None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:27.147037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1255789-5426-45ae-8f68-e8f78eab8caa None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:27.147037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1255789-5426-45ae-8f68-e8f78eab8caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:27.170433 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-d1255789-5426-45ae-8f68-e8f78eab8caa None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:27.172477 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d1255789-5426-45ae-8f68-e8f78eab8caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:27.185170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4f148-8a3f-412d-b7d8-79596870d850 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:27.229731 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8fa79-6887-4f0d-8e2c-4474a20adf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:27.230849 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8fa79-6887-4f0d-8e2c-4474a20adf8a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:27.231699 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8fa79-6887-4f0d-8e2c-4474a20adf8a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:27.232345 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8fa79-6887-4f0d-8e2c-4474a20adf8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:27.253857 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 176/362] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:27.255210 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb4ff5-7020-45d9-91d2-0e5058d4bbbf None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:27.255551 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb4ff5-7020-45d9-91d2-0e5058d4bbbf None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:27.256009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb4ff5-7020-45d9-91d2-0e5058d4bbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:27.274428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-19bb4ff5-7020-45d9-91d2-0e5058d4bbbf None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:27.275776 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-19bb4ff5-7020-45d9-91d2-0e5058d4bbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:27.311269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8fa79-6887-4f0d-8e2c-4474a20adf8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:27.313350 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8fa79-6887-4f0d-8e2c-4474a20adf8a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:27.353925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 177/363] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:27.354934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb4ff5-7020-45d9-91d2-0e5058d4bbbf None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:27.441014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 187/364] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:27.442198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8fa79-6887-4f0d-8e2c-4474a20adf8a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:27.496481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb4ff5-7020-45d9-91d2-0e5058d4bbbf None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:27.531265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cfd61-f41c-4624-a04d-60fc24b31224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:27.531895 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cfd61-f41c-4624-a04d-60fc24b31224 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:27.532175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cfd61-f41c-4624-a04d-60fc24b31224 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:27.532451 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cfd61-f41c-4624-a04d-60fc24b31224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:27.533538 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cfd61-f41c-4624-a04d-60fc24b31224 None admin] RBAC: Adding query filter params (group.id=251a8633493b4e9ca9cbd51bba53c59f, role.id=54b3d96f6c9d4d3cbf19a6f0663ba935, scope.project.id=e3d72911271b482a9514071507315e06) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:27.533654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cfd61-f41c-4624-a04d-60fc24b31224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:27.535007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cfd61-f41c-4624-a04d-60fc24b31224 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:27.541138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 178/365] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 11:41:27 2022] GET /identity/v3/role_assignments?group.id=251a8633493b4e9ca9cbd51bba53c59f&scope.project.id=e3d72911271b482a9514071507315e06&role.id=54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:27.541646 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cfd61-f41c-4624-a04d-60fc24b31224 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:27.562368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8fa79-6887-4f0d-8e2c-4474a20adf8a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:27.602797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d54ad-d6be-4336-a8e4-5c6d451b7704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:27.603689 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d54ad-d6be-4336-a8e4-5c6d451b7704 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:27.603975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d54ad-d6be-4336-a8e4-5c6d451b7704 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:27.604250 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d54ad-d6be-4336-a8e4-5c6d451b7704 None admin] PATH_INFO: `/v3/groups/251a8633493b4e9ca9cbd51bba53c59f` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:27.605459 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d54ad-d6be-4336-a8e4-5c6d451b7704 None admin] RBAC: Authorizing `identity:get_group(group_id=251a8633493b4e9ca9cbd51bba53c59f)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:27.606936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d54ad-d6be-4336-a8e4-5c6d451b7704 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:27.613707 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 188/366] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 11:41:27 2022] GET /identity/v3/groups/251a8633493b4e9ca9cbd51bba53c59f => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:27.615647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d54ad-d6be-4336-a8e4-5c6d451b7704 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:27.658339 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cfd61-f41c-4624-a04d-60fc24b31224 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:27.696705 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08637c47-7ad9-41f9-ae0d-20672de511ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:27.697516 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08637c47-7ad9-41f9-ae0d-20672de511ae None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:27.697793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08637c47-7ad9-41f9-ae0d-20672de511ae None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:27.698064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08637c47-7ad9-41f9-ae0d-20672de511ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:27.709610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08637c47-7ad9-41f9-ae0d-20672de511ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:27.716794 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-08637c47-7ad9-41f9-ae0d-20672de511ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:41:27.718348 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 179/367] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:41:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:27.719168 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08637c47-7ad9-41f9-ae0d-20672de511ae None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:27.734983 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d54ad-d6be-4336-a8e4-5c6d451b7704 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:27.772200 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a44714-f64c-4145-b5c6-e45920adf7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:27.772995 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a44714-f64c-4145-b5c6-e45920adf7e1 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:27.773283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a44714-f64c-4145-b5c6-e45920adf7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:27.773560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a44714-f64c-4145-b5c6-e45920adf7e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:27.785576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a44714-f64c-4145-b5c6-e45920adf7e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:27.792489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-67a44714-f64c-4145-b5c6-e45920adf7e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 11:41:27.794057 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 189/368] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:27.794904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a44714-f64c-4145-b5c6-e45920adf7e1 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:27.840008 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08637c47-7ad9-41f9-ae0d-20672de511ae None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:27.877378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3f641-c80f-4697-bcf9-ffe3c9467cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:27.878614 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3f641-c80f-4697-bcf9-ffe3c9467cbe None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:27.879087 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3f641-c80f-4697-bcf9-ffe3c9467cbe None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:27.879700 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3f641-c80f-4697-bcf9-ffe3c9467cbe None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:27.882062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3f641-c80f-4697-bcf9-ffe3c9467cbe None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:27.883863 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3f641-c80f-4697-bcf9-ffe3c9467cbe None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:27.886109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 180/369] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:27 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:27.887119 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3f641-c80f-4697-bcf9-ffe3c9467cbe None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:27.917417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a44714-f64c-4145-b5c6-e45920adf7e1 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:27.962272 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126c164-62de-4c0f-b7b6-926149e64898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:27.962937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126c164-62de-4c0f-b7b6-926149e64898 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:27.963215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126c164-62de-4c0f-b7b6-926149e64898 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:27.963489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126c164-62de-4c0f-b7b6-926149e64898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:27.964821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126c164-62de-4c0f-b7b6-926149e64898 None admin] RBAC: Adding query filter params (group.id=251a8633493b4e9ca9cbd51bba53c59f, role.id=54b3d96f6c9d4d3cbf19a6f0663ba935, scope.project.id=2795ff37998c454597b382c5096edefd) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:27.965142 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126c164-62de-4c0f-b7b6-926149e64898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:27.966847 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126c164-62de-4c0f-b7b6-926149e64898 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:27.974581 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 190/370] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 11:41:27 2022] GET /identity/v3/role_assignments?group.id=251a8633493b4e9ca9cbd51bba53c59f&scope.project.id=2795ff37998c454597b382c5096edefd&role.id=54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:27.975302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126c164-62de-4c0f-b7b6-926149e64898 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:28.009417 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3f641-c80f-4697-bcf9-ffe3c9467cbe None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:28.045461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6a446-5523-4f9f-b8e2-2b3c6989e664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:28.046506 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6a446-5523-4f9f-b8e2-2b3c6989e664 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:28.047069 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6a446-5523-4f9f-b8e2-2b3c6989e664 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:28.047610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6a446-5523-4f9f-b8e2-2b3c6989e664 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:28.048642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6a446-5523-4f9f-b8e2-2b3c6989e664 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:28.049167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6a446-5523-4f9f-b8e2-2b3c6989e664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:28.050816 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6a446-5523-4f9f-b8e2-2b3c6989e664 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:28.060841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 181/371] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:28.062045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6a446-5523-4f9f-b8e2-2b3c6989e664 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:28.103503 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126c164-62de-4c0f-b7b6-926149e64898 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:28.149108 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3e2c3-601d-4f06-a527-32e399787869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:28.149789 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3e2c3-601d-4f06-a527-32e399787869 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:28.150074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3e2c3-601d-4f06-a527-32e399787869 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:28.150351 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3e2c3-601d-4f06-a527-32e399787869 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:28.151096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3e2c3-601d-4f06-a527-32e399787869 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:28.151400 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3e2c3-601d-4f06-a527-32e399787869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:28.153625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3e2c3-601d-4f06-a527-32e399787869 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:28.166607 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 191/372] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:28.167493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3e2c3-601d-4f06-a527-32e399787869 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:28.194391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6a446-5523-4f9f-b8e2-2b3c6989e664 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:28.246731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b747738-942e-426d-a779-b37dc5323730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:28.248213 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b747738-942e-426d-a779-b37dc5323730 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:28.249927 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b747738-942e-426d-a779-b37dc5323730 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:28.251167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b747738-942e-426d-a779-b37dc5323730 None admin] PATH_INFO: `/v3/groups/251a8633493b4e9ca9cbd51bba53c59f` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:28.254762 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b747738-942e-426d-a779-b37dc5323730 None admin] RBAC: Authorizing `identity:get_group(group_id=251a8633493b4e9ca9cbd51bba53c59f)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:28.257207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b747738-942e-426d-a779-b37dc5323730 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:28.259555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 182/373] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 11:41:28 2022] GET /identity/v3/groups/251a8633493b4e9ca9cbd51bba53c59f => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:28.261306 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b747738-942e-426d-a779-b37dc5323730 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:28.345761 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3e2c3-601d-4f06-a527-32e399787869 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:28.391105 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0a795-42fb-4819-aa8e-0de6ab5a851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:28.392190 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0a795-42fb-4819-aa8e-0de6ab5a851a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:28.392700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0a795-42fb-4819-aa8e-0de6ab5a851a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:28.393176 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0a795-42fb-4819-aa8e-0de6ab5a851a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:28.415106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b747738-942e-426d-a779-b37dc5323730 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:28.463998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bf08e-d417-4af9-9745-616114c5e767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:28.464929 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bf08e-d417-4af9-9745-616114c5e767 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:28.465222 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bf08e-d417-4af9-9745-616114c5e767 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:28.465446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bf08e-d417-4af9-9745-616114c5e767 None admin] PATH_INFO: `/v3/users/58bd7288a70541648df07974d8745c7f` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:28.466672 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bf08e-d417-4af9-9745-616114c5e767 None admin] RBAC: Authorizing `identity:get_user(user_id=58bd7288a70541648df07974d8745c7f)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:28.468159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bf08e-d417-4af9-9745-616114c5e767 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:28.469797 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 183/374] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:41:28 2022] GET /identity/v3/users/58bd7288a70541648df07974d8745c7f => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:28.470652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bf08e-d417-4af9-9745-616114c5e767 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:28.476888 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0a795-42fb-4819-aa8e-0de6ab5a851a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:28.478764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0a795-42fb-4819-aa8e-0de6ab5a851a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:28.591840 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 192/375] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:28.593039 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0a795-42fb-4819-aa8e-0de6ab5a851a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:28.594237 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bf08e-d417-4af9-9745-616114c5e767 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:28.635567 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64724e-8b8c-47cc-a953-1f0f1b644f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:28.636181 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64724e-8b8c-47cc-a953-1f0f1b644f9f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:28.636466 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64724e-8b8c-47cc-a953-1f0f1b644f9f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:28.636745 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64724e-8b8c-47cc-a953-1f0f1b644f9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:28.637936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64724e-8b8c-47cc-a953-1f0f1b644f9f None admin] RBAC: Adding query filter params (group.id=251a8633493b4e9ca9cbd51bba53c59f, role.id=2ca014d08f26466b980433e75e765505, scope.project.id=e3d72911271b482a9514071507315e06) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:28.638241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64724e-8b8c-47cc-a953-1f0f1b644f9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:28.641377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64724e-8b8c-47cc-a953-1f0f1b644f9f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:28.650039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 184/376] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 11:41:28 2022] GET /identity/v3/role_assignments?group.id=251a8633493b4e9ca9cbd51bba53c59f&scope.project.id=e3d72911271b482a9514071507315e06&role.id=2ca014d08f26466b980433e75e765505 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:28.651899 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64724e-8b8c-47cc-a953-1f0f1b644f9f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:28.709424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0a795-42fb-4819-aa8e-0de6ab5a851a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:28.747494 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b5fce-6c5e-4340-af10-bb10d3d56545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:28.748968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b5fce-6c5e-4340-af10-bb10d3d56545 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:28.749496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b5fce-6c5e-4340-af10-bb10d3d56545 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:28.750016 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b5fce-6c5e-4340-af10-bb10d3d56545 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:28.752052 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b5fce-6c5e-4340-af10-bb10d3d56545 None admin] RBAC: Adding query filter params (role.id=79b8f7dbdec64d1fb686ae3346c01e46, user.id=58bd7288a70541648df07974d8745c7f, scope.system=all) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:28.752941 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b5fce-6c5e-4340-af10-bb10d3d56545 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:28.756515 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b5fce-6c5e-4340-af10-bb10d3d56545 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:28.770589 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 193/377] 10.222.0.52 () {56 vars in 1308 bytes} [Tue Mar 8 11:41:28 2022] GET /identity/v3/role_assignments?user.id=58bd7288a70541648df07974d8745c7f&scope.system=all&role.id=79b8f7dbdec64d1fb686ae3346c01e46 => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:28.785291 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64724e-8b8c-47cc-a953-1f0f1b644f9f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:28.832644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dc64d-7358-4170-9777-22f19faee40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:28.833583 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dc64d-7358-4170-9777-22f19faee40b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:28.833865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dc64d-7358-4170-9777-22f19faee40b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:28.834141 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dc64d-7358-4170-9777-22f19faee40b None admin] PATH_INFO: `/v3/projects/675cf84704734f5798e386951dca511b` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:28.835375 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dc64d-7358-4170-9777-22f19faee40b None admin] RBAC: Authorizing `identity:get_project(project_id=675cf84704734f5798e386951dca511b)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:28.836875 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dc64d-7358-4170-9777-22f19faee40b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:28.838986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 185/378] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:28 2022] GET /identity/v3/projects/675cf84704734f5798e386951dca511b => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:28.844867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b5fce-6c5e-4340-af10-bb10d3d56545 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:28.981723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b5fce-6c5e-4340-af10-bb10d3d56545 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:29.034928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4313113-4ab8-46b8-8bf1-adc6a82aa8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:29.035848 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4313113-4ab8-46b8-8bf1-adc6a82aa8e6 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:29.036839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4313113-4ab8-46b8-8bf1-adc6a82aa8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:29.037347 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4313113-4ab8-46b8-8bf1-adc6a82aa8e6 None admin] PATH_INFO: `/v3/groups/23db25ed2de449ab854eb32cdfea0f93` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:29.050508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4313113-4ab8-46b8-8bf1-adc6a82aa8e6 None admin] RBAC: Authorizing `identity:get_group(group_id=23db25ed2de449ab854eb32cdfea0f93)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:29.052609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4313113-4ab8-46b8-8bf1-adc6a82aa8e6 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:29.054889 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 194/379] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 11:41:28 2022] GET /identity/v3/groups/23db25ed2de449ab854eb32cdfea0f93 => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:29.061307 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dc64d-7358-4170-9777-22f19faee40b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:29.191442 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dc64d-7358-4170-9777-22f19faee40b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:29.236495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38f864-fb6e-450c-8d73-2319e47ade44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:29.237160 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38f864-fb6e-450c-8d73-2319e47ade44 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:29.237450 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38f864-fb6e-450c-8d73-2319e47ade44 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:29.237780 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38f864-fb6e-450c-8d73-2319e47ade44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:29.238615 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38f864-fb6e-450c-8d73-2319e47ade44 None admin] RBAC: Adding query filter params (group.id=23db25ed2de449ab854eb32cdfea0f93, role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=675cf84704734f5798e386951dca511b) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:29.238932 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38f864-fb6e-450c-8d73-2319e47ade44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:29.241343 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38f864-fb6e-450c-8d73-2319e47ade44 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:29.247101 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 186/380] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 11:41:29 2022] GET /identity/v3/role_assignments?group.id=23db25ed2de449ab854eb32cdfea0f93&scope.project.id=675cf84704734f5798e386951dca511b&role.id=c2642d38bc964424a5edc330e0d4471d => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:29.988953 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2d285-64ae-4a9f-b7b6-10e680c8feff None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:29.990138 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2d285-64ae-4a9f-b7b6-10e680c8feff None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:29.990590 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2d285-64ae-4a9f-b7b6-10e680c8feff None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:29.993053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 195/381] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:29.999414 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850c5b4-7808-4fec-b71f-a9d91a3fc3a6 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:30.000032 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850c5b4-7808-4fec-b71f-a9d91a3fc3a6 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:30.000032 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850c5b4-7808-4fec-b71f-a9d91a3fc3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:30.019052 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-b850c5b4-7808-4fec-b71f-a9d91a3fc3a6 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:30.020310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b850c5b4-7808-4fec-b71f-a9d91a3fc3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:30.107186 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 187/382] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:30.147986 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2d285-64ae-4a9f-b7b6-10e680c8feff None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:30.284203 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2d285-64ae-4a9f-b7b6-10e680c8feff None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:30.325206 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea10cc-c550-4b34-a101-19e9271421ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:30.326087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea10cc-c550-4b34-a101-19e9271421ea None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:30.326377 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea10cc-c550-4b34-a101-19e9271421ea None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:30.326656 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea10cc-c550-4b34-a101-19e9271421ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:30.343254 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea10cc-c550-4b34-a101-19e9271421ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:30.351715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-02ea10cc-c550-4b34-a101-19e9271421ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 11:41:30.356168 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 196/383] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:41:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:30.360757 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850c5b4-7808-4fec-b71f-a9d91a3fc3a6 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:30.465695 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850c5b4-7808-4fec-b71f-a9d91a3fc3a6 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:30.504010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb1fe2-1e80-4101-be3b-f31b5ac57960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:30.505397 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb1fe2-1e80-4101-be3b-f31b5ac57960 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:30.516644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb1fe2-1e80-4101-be3b-f31b5ac57960 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:30.516644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb1fe2-1e80-4101-be3b-f31b5ac57960 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:30.516644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb1fe2-1e80-4101-be3b-f31b5ac57960 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:30.516644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb1fe2-1e80-4101-be3b-f31b5ac57960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:30.516644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb1fe2-1e80-4101-be3b-f31b5ac57960 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:30.520463 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 188/384] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:30.523478 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea10cc-c550-4b34-a101-19e9271421ea None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:30.656904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea10cc-c550-4b34-a101-19e9271421ea None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:30.693939 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfae70-9148-47ad-b3df-c346f52b3ab9 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:30.694253 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfae70-9148-47ad-b3df-c346f52b3ab9 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:30.694509 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfae70-9148-47ad-b3df-c346f52b3ab9 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:30.700681 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 189/385] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:30.702114 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b41fee-e666-4777-8395-94bee52b3e19 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:30.702617 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b41fee-e666-4777-8395-94bee52b3e19 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:30.703082 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b41fee-e666-4777-8395-94bee52b3e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:30.705265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4b421-34a7-49df-86b3-1b7b39ece290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:30.708631 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4b421-34a7-49df-86b3-1b7b39ece290 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:30.708631 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4b421-34a7-49df-86b3-1b7b39ece290 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:30.708631 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4b421-34a7-49df-86b3-1b7b39ece290 None admin] PATH_INFO: `/v3/groups/251a8633493b4e9ca9cbd51bba53c59f` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:30.708877 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4b421-34a7-49df-86b3-1b7b39ece290 None admin] RBAC: Authorizing `identity:get_group(group_id=251a8633493b4e9ca9cbd51bba53c59f)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:30.710471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4b421-34a7-49df-86b3-1b7b39ece290 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:30.713731 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 197/386] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 11:41:30 2022] GET /identity/v3/groups/251a8633493b4e9ca9cbd51bba53c59f => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:30.719047 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4b421-34a7-49df-86b3-1b7b39ece290 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:30.726814 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-37b41fee-e666-4777-8395-94bee52b3e19 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:30.728298 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-37b41fee-e666-4777-8395-94bee52b3e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:30.838022 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4b421-34a7-49df-86b3-1b7b39ece290 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:30.875605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 190/387] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:30.893193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8899877-2d5b-403e-ad80-5b9d39189b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:30.894067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8899877-2d5b-403e-ad80-5b9d39189b58 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:30.894354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8899877-2d5b-403e-ad80-5b9d39189b58 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:30.894636 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8899877-2d5b-403e-ad80-5b9d39189b58 None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:30.899677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8899877-2d5b-403e-ad80-5b9d39189b58 None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:30.901218 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8899877-2d5b-403e-ad80-5b9d39189b58 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:30.903613 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 198/388] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:30 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:30.909523 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b41fee-e666-4777-8395-94bee52b3e19 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:30.914542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8899877-2d5b-403e-ad80-5b9d39189b58 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:31.095810 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b41fee-e666-4777-8395-94bee52b3e19 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:31.107776 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8899877-2d5b-403e-ad80-5b9d39189b58 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:31.163484 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce6a4a-f72a-4421-8410-3c8b0f4cc3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:31.164333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce6a4a-f72a-4421-8410-3c8b0f4cc3ad None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:31.164618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce6a4a-f72a-4421-8410-3c8b0f4cc3ad None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:31.164896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce6a4a-f72a-4421-8410-3c8b0f4cc3ad None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd/groups/251a8633493b4e9ca9cbd51bba53c59f/roles/2ca014d08f26466b980433e75e765505` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:31.166572 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7f401-a599-48df-bc40-717c8de5a06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:31.167358 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7f401-a599-48df-bc40-717c8de5a06f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:31.167688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7f401-a599-48df-bc40-717c8de5a06f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:31.167964 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7f401-a599-48df-bc40-717c8de5a06f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:31.171466 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce6a4a-f72a-4421-8410-3c8b0f4cc3ad None admin] RBAC: Authorizing `identity:create_grant(project_id=2795ff37998c454597b382c5096edefd, group_id=251a8633493b4e9ca9cbd51bba53c59f, role_id=2ca014d08f26466b980433e75e765505)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:31.172942 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce6a4a-f72a-4421-8410-3c8b0f4cc3ad None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:31.188014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7f401-a599-48df-bc40-717c8de5a06f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:31.195264 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-f1d7f401-a599-48df-bc40-717c8de5a06f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:41:31.202473 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 199/389] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:31.204365 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7f401-a599-48df-bc40-717c8de5a06f None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:31.271573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 191/390] 10.222.0.52 () {58 vars in 1442 bytes} [Tue Mar 8 11:41:30 2022] PUT /identity/v3/projects/2795ff37998c454597b382c5096edefd/groups/251a8633493b4e9ca9cbd51bba53c59f/roles/2ca014d08f26466b980433e75e765505 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:41:31.318204 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7f401-a599-48df-bc40-717c8de5a06f None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:31.354778 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79774247-b9b1-4b07-a068-2e68cf714d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:31.355471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79774247-b9b1-4b07-a068-2e68cf714d33 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:31.355801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79774247-b9b1-4b07-a068-2e68cf714d33 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:31.356079 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79774247-b9b1-4b07-a068-2e68cf714d33 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:31.357056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79774247-b9b1-4b07-a068-2e68cf714d33 None admin] RBAC: Adding query filter params (name=member) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:31.357056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79774247-b9b1-4b07-a068-2e68cf714d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:31.358555 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79774247-b9b1-4b07-a068-2e68cf714d33 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:31.373429 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 200/391] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:31.374820 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce6a4a-f72a-4421-8410-3c8b0f4cc3ad None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:31.491242 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce6a4a-f72a-4421-8410-3c8b0f4cc3ad None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:31.546147 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39873f7-a734-4926-8e35-6cb7e0088123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:31.547098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39873f7-a734-4926-8e35-6cb7e0088123 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:31.547384 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39873f7-a734-4926-8e35-6cb7e0088123 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:31.547683 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39873f7-a734-4926-8e35-6cb7e0088123 None admin] PATH_INFO: `/v3/groups/251a8633493b4e9ca9cbd51bba53c59f` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:31.548997 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39873f7-a734-4926-8e35-6cb7e0088123 None admin] RBAC: Authorizing `identity:get_group(group_id=251a8633493b4e9ca9cbd51bba53c59f)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:31.550491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39873f7-a734-4926-8e35-6cb7e0088123 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:31.553355 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 192/392] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 11:41:31 2022] GET /identity/v3/groups/251a8633493b4e9ca9cbd51bba53c59f => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:31.559263 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79774247-b9b1-4b07-a068-2e68cf714d33 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:31.722763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79774247-b9b1-4b07-a068-2e68cf714d33 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:31.768611 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7643899-83be-4eb2-a45d-8181d2d9392e None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:31.768898 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7643899-83be-4eb2-a45d-8181d2d9392e None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:31.769086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7643899-83be-4eb2-a45d-8181d2d9392e None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:31.775378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 193/393] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:31.776621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eef8a-a65c-4ccd-9c5b-2a37219e13e8 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:31.776797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d41844-4868-4471-a5f4-defe1003db58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:31.776909 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eef8a-a65c-4ccd-9c5b-2a37219e13e8 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:31.777424 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eef8a-a65c-4ccd-9c5b-2a37219e13e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:31.777919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d41844-4868-4471-a5f4-defe1003db58 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:31.778202 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d41844-4868-4471-a5f4-defe1003db58 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:31.778479 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d41844-4868-4471-a5f4-defe1003db58 None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:31.779813 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d41844-4868-4471-a5f4-defe1003db58 None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:31.781343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d41844-4868-4471-a5f4-defe1003db58 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:31.783163 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 201/394] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:31 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:31.790604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d41844-4868-4471-a5f4-defe1003db58 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:31.813767 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-186eef8a-a65c-4ccd-9c5b-2a37219e13e8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:31.814962 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-186eef8a-a65c-4ccd-9c5b-2a37219e13e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:31.937523 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 194/395] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:31.959475 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d41844-4868-4471-a5f4-defe1003db58 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:31.969505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eef8a-a65c-4ccd-9c5b-2a37219e13e8 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:32.018527 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ace350-8ed0-4b8f-8fda-abdab1110c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:32.019483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ace350-8ed0-4b8f-8fda-abdab1110c24 None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:32.019740 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ace350-8ed0-4b8f-8fda-abdab1110c24 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:32.020044 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ace350-8ed0-4b8f-8fda-abdab1110c24 None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06/groups/251a8633493b4e9ca9cbd51bba53c59f/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:32.022127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ace350-8ed0-4b8f-8fda-abdab1110c24 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3d72911271b482a9514071507315e06, group_id=251a8633493b4e9ca9cbd51bba53c59f, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:32.024109 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ace350-8ed0-4b8f-8fda-abdab1110c24 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:32.082238 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eef8a-a65c-4ccd-9c5b-2a37219e13e8 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:32.089190 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 202/396] 10.222.0.52 () {58 vars in 1442 bytes} [Tue Mar 8 11:41:31 2022] PUT /identity/v3/projects/e3d72911271b482a9514071507315e06/groups/251a8633493b4e9ca9cbd51bba53c59f/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:41:32.090511 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e017232-d014-4a1a-b591-324842d5d6da None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:32.090799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e017232-d014-4a1a-b591-324842d5d6da None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:32.091079 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e017232-d014-4a1a-b591-324842d5d6da None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:32.098293 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 203/397] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:32.109047 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d152d-9076-49b1-9aa9-072040f9a409 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:32.109696 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d152d-9076-49b1-9aa9-072040f9a409 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:32.109696 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d152d-9076-49b1-9aa9-072040f9a409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:32.149725 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-e88d152d-9076-49b1-9aa9-072040f9a409 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:32.152702 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-e88d152d-9076-49b1-9aa9-072040f9a409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:32.163194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a0610-84f4-433a-a62e-5e3ac3c0429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:32.167404 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a0610-84f4-433a-a62e-5e3ac3c0429c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:32.167770 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a0610-84f4-433a-a62e-5e3ac3c0429c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:32.168059 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a0610-84f4-433a-a62e-5e3ac3c0429c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:32.197754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a0610-84f4-433a-a62e-5e3ac3c0429c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:32.214159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-1a9a0610-84f4-433a-a62e-5e3ac3c0429c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:41:32.217636 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 195/398] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:32.221745 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a0610-84f4-433a-a62e-5e3ac3c0429c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:32.294797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 204/399] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:32.315141 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d152d-9076-49b1-9aa9-072040f9a409 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:32.376468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a0610-84f4-433a-a62e-5e3ac3c0429c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:32.416611 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aef06b-484b-48a5-9d34-671829d2f2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:32.417636 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aef06b-484b-48a5-9d34-671829d2f2b8 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:32.418112 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aef06b-484b-48a5-9d34-671829d2f2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:32.418575 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aef06b-484b-48a5-9d34-671829d2f2b8 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:32.419583 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aef06b-484b-48a5-9d34-671829d2f2b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:32.420096 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aef06b-484b-48a5-9d34-671829d2f2b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:32.421659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aef06b-484b-48a5-9d34-671829d2f2b8 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:32.430789 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d152d-9076-49b1-9aa9-072040f9a409 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:32.431199 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 196/400] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:32.437043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a9492-d4d7-4815-bd42-8590c6a6b22f None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:32.437565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a9492-d4d7-4815-bd42-8590c6a6b22f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:32.438038 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a9492-d4d7-4815-bd42-8590c6a6b22f None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:32.440073 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 197/401] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:32.440981 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a9492-d4d7-4815-bd42-8590c6a6b22f None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:32.476945 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25871f67-5774-4ce0-8b16-2ca64831e298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:32.478267 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25871f67-5774-4ce0-8b16-2ca64831e298 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:32.478697 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25871f67-5774-4ce0-8b16-2ca64831e298 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:32.479905 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25871f67-5774-4ce0-8b16-2ca64831e298 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:32.497167 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25871f67-5774-4ce0-8b16-2ca64831e298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:32.507864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-25871f67-5774-4ce0-8b16-2ca64831e298 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 11:41:32.514975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 205/402] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:41:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:32.514975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7db4a-8a6a-4f4d-8ace-0e63a95ceaf0 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:32.514975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7db4a-8a6a-4f4d-8ace-0e63a95ceaf0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:32.514975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7db4a-8a6a-4f4d-8ace-0e63a95ceaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:32.539428 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-82f7db4a-8a6a-4f4d-8ace-0e63a95ceaf0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:32.541781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-82f7db4a-8a6a-4f4d-8ace-0e63a95ceaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:32.549960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a9492-d4d7-4815-bd42-8590c6a6b22f None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:32.587817 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308ae38-0d98-431e-85a2-9d00e410bc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:32.588972 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308ae38-0d98-431e-85a2-9d00e410bc53 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:32.589450 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308ae38-0d98-431e-85a2-9d00e410bc53 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:32.589895 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308ae38-0d98-431e-85a2-9d00e410bc53 None admin] PATH_INFO: `/v3/groups/251a8633493b4e9ca9cbd51bba53c59f` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:32.591276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308ae38-0d98-431e-85a2-9d00e410bc53 None admin] RBAC: Authorizing `identity:get_group(group_id=251a8633493b4e9ca9cbd51bba53c59f)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:32.592927 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308ae38-0d98-431e-85a2-9d00e410bc53 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:32.594756 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 198/403] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 11:41:32 2022] GET /identity/v3/groups/251a8633493b4e9ca9cbd51bba53c59f => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:32.595741 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308ae38-0d98-431e-85a2-9d00e410bc53 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:32.626907 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 206/404] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:32.628154 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7db4a-8a6a-4f4d-8ace-0e63a95ceaf0 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:32.696821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308ae38-0d98-431e-85a2-9d00e410bc53 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:32.730112 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df808540-6b79-4878-ae74-da1ba8ab796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:32.731134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df808540-6b79-4878-ae74-da1ba8ab796c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:32.731662 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df808540-6b79-4878-ae74-da1ba8ab796c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:32.732131 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df808540-6b79-4878-ae74-da1ba8ab796c None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:32.733067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df808540-6b79-4878-ae74-da1ba8ab796c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:32.733564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df808540-6b79-4878-ae74-da1ba8ab796c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:32.735145 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df808540-6b79-4878-ae74-da1ba8ab796c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:32.747639 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 199/405] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:32.748845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df808540-6b79-4878-ae74-da1ba8ab796c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:32.750605 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7db4a-8a6a-4f4d-8ace-0e63a95ceaf0 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:32.788457 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdff740-0d7e-4878-93e9-a314cf588e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:32.789729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdff740-0d7e-4878-93e9-a314cf588e8d None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:32.790209 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdff740-0d7e-4878-93e9-a314cf588e8d None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:32.790673 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdff740-0d7e-4878-93e9-a314cf588e8d None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:32.792087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdff740-0d7e-4878-93e9-a314cf588e8d None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:32.793816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdff740-0d7e-4878-93e9-a314cf588e8d None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:32.796104 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 207/406] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:32 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:32.797158 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdff740-0d7e-4878-93e9-a314cf588e8d None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:32.877765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df808540-6b79-4878-ae74-da1ba8ab796c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:32.898385 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdff740-0d7e-4878-93e9-a314cf588e8d None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:32.919324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f87553-02f9-4c30-a1ee-6c62befd6f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:32.920572 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f87553-02f9-4c30-a1ee-6c62befd6f68 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:32.920858 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f87553-02f9-4c30-a1ee-6c62befd6f68 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:32.921135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f87553-02f9-4c30-a1ee-6c62befd6f68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:32.934693 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ec09b-6c0b-4f6d-a869-3b3c43a1eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:32.934852 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f87553-02f9-4c30-a1ee-6c62befd6f68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:32.936040 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ec09b-6c0b-4f6d-a869-3b3c43a1eca7 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:32.936524 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ec09b-6c0b-4f6d-a869-3b3c43a1eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:32.936994 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ec09b-6c0b-4f6d-a869-3b3c43a1eca7 None admin] PATH_INFO: `/v3/groups/251a8633493b4e9ca9cbd51bba53c59f` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:32.938391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ec09b-6c0b-4f6d-a869-3b3c43a1eca7 None admin] RBAC: Authorizing `identity:get_group(group_id=251a8633493b4e9ca9cbd51bba53c59f)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:32.940217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ec09b-6c0b-4f6d-a869-3b3c43a1eca7 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:32.941878 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-98f87553-02f9-4c30-a1ee-6c62befd6f68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:41:32.942622 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 208/407] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 11:41:32 2022] GET /identity/v3/groups/251a8633493b4e9ca9cbd51bba53c59f => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:32.943352 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 200/408] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:41:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:32.943811 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ec09b-6c0b-4f6d-a869-3b3c43a1eca7 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:32.949096 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f87553-02f9-4c30-a1ee-6c62befd6f68 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:33.052678 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f87553-02f9-4c30-a1ee-6c62befd6f68 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:33.061051 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ec09b-6c0b-4f6d-a869-3b3c43a1eca7 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:33.095785 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca754f-5524-4560-905b-8f43b355fbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:33.096827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8554f41-8cc6-4fe3-8220-73c7b2e4637a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:33.097702 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca754f-5524-4560-905b-8f43b355fbc9 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:33.097947 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554f41-8cc6-4fe3-8220-73c7b2e4637a None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:33.098809 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca754f-5524-4560-905b-8f43b355fbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:33.098932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554f41-8cc6-4fe3-8220-73c7b2e4637a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:33.099333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca754f-5524-4560-905b-8f43b355fbc9 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:33.099706 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554f41-8cc6-4fe3-8220-73c7b2e4637a None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd/groups/251a8633493b4e9ca9cbd51bba53c59f/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:33.101443 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca754f-5524-4560-905b-8f43b355fbc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:33.101908 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca754f-5524-4560-905b-8f43b355fbc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:33.102081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8554f41-8cc6-4fe3-8220-73c7b2e4637a None admin] RBAC: Authorizing `identity:create_grant(project_id=2795ff37998c454597b382c5096edefd, group_id=251a8633493b4e9ca9cbd51bba53c59f, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:33.103695 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8554f41-8cc6-4fe3-8220-73c7b2e4637a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:33.107578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca754f-5524-4560-905b-8f43b355fbc9 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:33.119003 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 201/409] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:33.120281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca754f-5524-4560-905b-8f43b355fbc9 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:33.188334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 209/410] 10.222.0.52 () {58 vars in 1442 bytes} [Tue Mar 8 11:41:32 2022] PUT /identity/v3/projects/2795ff37998c454597b382c5096edefd/groups/251a8633493b4e9ca9cbd51bba53c59f/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:41:33.189344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8554f41-8cc6-4fe3-8220-73c7b2e4637a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:33.416279 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca754f-5524-4560-905b-8f43b355fbc9 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:33.476356 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8554f41-8cc6-4fe3-8220-73c7b2e4637a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:33.491002 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58aeec1-e003-4e4c-8d88-d8a7fe4b25ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:33.492274 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58aeec1-e003-4e4c-8d88-d8a7fe4b25ca None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:33.492723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58aeec1-e003-4e4c-8d88-d8a7fe4b25ca None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:33.496786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58aeec1-e003-4e4c-8d88-d8a7fe4b25ca None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:33.500471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58aeec1-e003-4e4c-8d88-d8a7fe4b25ca None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:33.504017 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58aeec1-e003-4e4c-8d88-d8a7fe4b25ca None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:33.506996 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 202/411] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:33 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:33.518132 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58aeec1-e003-4e4c-8d88-d8a7fe4b25ca None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:33.576859 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a1a53-14a6-462e-ae79-625b7af42b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:33.577985 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a1a53-14a6-462e-ae79-625b7af42b32 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:33.578293 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a1a53-14a6-462e-ae79-625b7af42b32 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:33.578672 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a1a53-14a6-462e-ae79-625b7af42b32 None admin] PATH_INFO: `/v3/groups/23db25ed2de449ab854eb32cdfea0f93` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:33.580035 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a1a53-14a6-462e-ae79-625b7af42b32 None admin] RBAC: Authorizing `identity:get_group(group_id=23db25ed2de449ab854eb32cdfea0f93)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:33.581666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a1a53-14a6-462e-ae79-625b7af42b32 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:33.589062 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 210/412] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 11:41:33 2022] GET /identity/v3/groups/23db25ed2de449ab854eb32cdfea0f93 => generated 229 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:33.590214 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a1a53-14a6-462e-ae79-625b7af42b32 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:33.698925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58aeec1-e003-4e4c-8d88-d8a7fe4b25ca None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:33.758906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd815b-8b3b-4940-8e48-f9722c36785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:33.760189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd815b-8b3b-4940-8e48-f9722c36785f None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:33.760672 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd815b-8b3b-4940-8e48-f9722c36785f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:33.761145 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd815b-8b3b-4940-8e48-f9722c36785f None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06/groups/251a8633493b4e9ca9cbd51bba53c59f/roles/2ca014d08f26466b980433e75e765505` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:33.771703 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd815b-8b3b-4940-8e48-f9722c36785f None admin] RBAC: Authorizing `identity:create_grant(project_id=e3d72911271b482a9514071507315e06, group_id=251a8633493b4e9ca9cbd51bba53c59f, role_id=2ca014d08f26466b980433e75e765505)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:33.773631 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd815b-8b3b-4940-8e48-f9722c36785f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:33.782972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a1a53-14a6-462e-ae79-625b7af42b32 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:33.816458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecd4f8-b90e-432f-b593-e9344664ee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:33.818313 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecd4f8-b90e-432f-b593-e9344664ee8e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:33.818496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecd4f8-b90e-432f-b593-e9344664ee8e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:33.818778 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecd4f8-b90e-432f-b593-e9344664ee8e None admin] PATH_INFO: `/v3/projects/675cf84704734f5798e386951dca511b` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:33.823562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecd4f8-b90e-432f-b593-e9344664ee8e None admin] RBAC: Authorizing `identity:get_project(project_id=675cf84704734f5798e386951dca511b)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:33.823562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecd4f8-b90e-432f-b593-e9344664ee8e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:33.823749 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 211/413] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:33 2022] GET /identity/v3/projects/675cf84704734f5798e386951dca511b => generated 344 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:33.828690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecd4f8-b90e-432f-b593-e9344664ee8e None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:33.884502 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 203/414] 10.222.0.52 () {58 vars in 1442 bytes} [Tue Mar 8 11:41:33 2022] PUT /identity/v3/projects/e3d72911271b482a9514071507315e06/groups/251a8633493b4e9ca9cbd51bba53c59f/roles/2ca014d08f26466b980433e75e765505 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 11:41:33.938197 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecd4f8-b90e-432f-b593-e9344664ee8e None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:33.976121 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e0f4e-d9c8-4558-9592-7541df18438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:33.977127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e0f4e-d9c8-4558-9592-7541df18438c None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:33.977415 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e0f4e-d9c8-4558-9592-7541df18438c None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:33.977695 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e0f4e-d9c8-4558-9592-7541df18438c None admin] PATH_INFO: `/v3/projects/675cf84704734f5798e386951dca511b/groups/23db25ed2de449ab854eb32cdfea0f93/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:33.979756 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e0f4e-d9c8-4558-9592-7541df18438c None admin] RBAC: Authorizing `identity:create_grant(project_id=675cf84704734f5798e386951dca511b, group_id=23db25ed2de449ab854eb32cdfea0f93, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:33.981399 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e0f4e-d9c8-4558-9592-7541df18438c None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:34.060010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e780055-db95-42ec-a57f-f77312852b54 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:34.060201 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e780055-db95-42ec-a57f-f77312852b54 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:34.060471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e780055-db95-42ec-a57f-f77312852b54 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:34.062709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 204/415] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:34.068995 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c0fc5-941b-4c99-9ceb-aa3739c533a0 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:34.069287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c0fc5-941b-4c99-9ceb-aa3739c533a0 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:34.069552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c0fc5-941b-4c99-9ceb-aa3739c533a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:34.078839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 212/416] 10.222.0.52 () {58 vars in 1442 bytes} [Tue Mar 8 11:41:33 2022] PUT /identity/v3/projects/675cf84704734f5798e386951dca511b/groups/23db25ed2de449ab854eb32cdfea0f93/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:41:34.098307 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-a91c0fc5-941b-4c99-9ceb-aa3739c533a0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:34.099658 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a91c0fc5-941b-4c99-9ceb-aa3739c533a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:34.178209 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 205/417] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:34.201804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e0f4e-d9c8-4558-9592-7541df18438c None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:34.313292 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e0f4e-d9c8-4558-9592-7541df18438c None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:34.349189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920621e5-6679-4e02-9ef2-fbd1b51cacbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:34.350004 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920621e5-6679-4e02-9ef2-fbd1b51cacbc None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:34.350284 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920621e5-6679-4e02-9ef2-fbd1b51cacbc None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:34.350548 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920621e5-6679-4e02-9ef2-fbd1b51cacbc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:34.360808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920621e5-6679-4e02-9ef2-fbd1b51cacbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:34.369126 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-920621e5-6679-4e02-9ef2-fbd1b51cacbc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 11:41:34.370372 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 213/418] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:41:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:34.376351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c0fc5-941b-4c99-9ceb-aa3739c533a0 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:34.478105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c0fc5-941b-4c99-9ceb-aa3739c533a0 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:34.520456 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f89872-f79d-45e2-ac21-0360af6e0423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:34.521155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89872-f79d-45e2-ac21-0360af6e0423 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:34.521435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89872-f79d-45e2-ac21-0360af6e0423 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:34.521708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89872-f79d-45e2-ac21-0360af6e0423 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:34.522455 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f89872-f79d-45e2-ac21-0360af6e0423 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:34.522758 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f89872-f79d-45e2-ac21-0360af6e0423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:34.524154 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f89872-f79d-45e2-ac21-0360af6e0423 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:34.539383 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 206/419] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:34.544952 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920621e5-6679-4e02-9ef2-fbd1b51cacbc None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:34.663061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0dbfd-a259-45d0-bba1-3f873771caee None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:34.663707 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0dbfd-a259-45d0-bba1-3f873771caee None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:34.664191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0dbfd-a259-45d0-bba1-3f873771caee None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:34.666425 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 207/420] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:41:34.670361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920621e5-6679-4e02-9ef2-fbd1b51cacbc None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:34.671811 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af0067-47a3-4bee-8ed5-19f15fda2c66 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:34.672307 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af0067-47a3-4bee-8ed5-19f15fda2c66 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:34.672782 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af0067-47a3-4bee-8ed5-19f15fda2c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:34.696901 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-e8af0067-47a3-4bee-8ed5-19f15fda2c66 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:34.699974 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e8af0067-47a3-4bee-8ed5-19f15fda2c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:34.732614 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e31df-4585-4d84-8fd5-95e251550d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:34.733624 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e31df-4585-4d84-8fd5-95e251550d34 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:34.734108 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e31df-4585-4d84-8fd5-95e251550d34 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:34.734579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e31df-4585-4d84-8fd5-95e251550d34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:34.827464 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e31df-4585-4d84-8fd5-95e251550d34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:34.829334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e31df-4585-4d84-8fd5-95e251550d34 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:34.845426 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 208/421] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:34.889012 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af0067-47a3-4bee-8ed5-19f15fda2c66 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:34.983307 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 214/422] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:34.989313 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e31df-4585-4d84-8fd5-95e251550d34 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:35.033741 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af0067-47a3-4bee-8ed5-19f15fda2c66 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:35.087060 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a61678-cf13-43dd-9603-dc4d0ed07e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:35.087935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a61678-cf13-43dd-9603-dc4d0ed07e7f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:35.088223 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a61678-cf13-43dd-9603-dc4d0ed07e7f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:35.088481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a61678-cf13-43dd-9603-dc4d0ed07e7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:35.108034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a61678-cf13-43dd-9603-dc4d0ed07e7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:35.119161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-77a61678-cf13-43dd-9603-dc4d0ed07e7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:41:35.120398 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 209/423] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:35.146126 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a61678-cf13-43dd-9603-dc4d0ed07e7f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:35.168429 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e31df-4585-4d84-8fd5-95e251550d34 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:35.233535 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396134f-cf49-4d42-9917-f95a36162dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:35.234321 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396134f-cf49-4d42-9917-f95a36162dd1 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:35.234599 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396134f-cf49-4d42-9917-f95a36162dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:35.234873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396134f-cf49-4d42-9917-f95a36162dd1 None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:35.236280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396134f-cf49-4d42-9917-f95a36162dd1 None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:35.237751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396134f-cf49-4d42-9917-f95a36162dd1 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:35.242908 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 215/424] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:34 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:35.252543 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396134f-cf49-4d42-9917-f95a36162dd1 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:35.291787 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a61678-cf13-43dd-9603-dc4d0ed07e7f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:35.344302 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c40dbc-a5ef-4051-be08-09ff31d83d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:35.344985 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c40dbc-a5ef-4051-be08-09ff31d83d44 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:35.345271 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c40dbc-a5ef-4051-be08-09ff31d83d44 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:35.345549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c40dbc-a5ef-4051-be08-09ff31d83d44 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:35.346302 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c40dbc-a5ef-4051-be08-09ff31d83d44 None admin] RBAC: Adding query filter params (name=member) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:35.346612 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c40dbc-a5ef-4051-be08-09ff31d83d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:35.348580 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c40dbc-a5ef-4051-be08-09ff31d83d44 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:35.372975 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 210/425] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:35.375961 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c40dbc-a5ef-4051-be08-09ff31d83d44 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:35.443165 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396134f-cf49-4d42-9917-f95a36162dd1 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:35.490423 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c40dbc-a5ef-4051-be08-09ff31d83d44 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:35.524454 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe7ebb-43df-4e55-a09a-d79095800c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:35.525217 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe7ebb-43df-4e55-a09a-d79095800c79 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:35.525509 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe7ebb-43df-4e55-a09a-d79095800c79 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:35.525789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe7ebb-43df-4e55-a09a-d79095800c79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:35.529527 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a476e5-0d3d-4730-8f59-6fcac1f69189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:35.530389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a476e5-0d3d-4730-8f59-6fcac1f69189 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:35.530669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a476e5-0d3d-4730-8f59-6fcac1f69189 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:35.530943 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a476e5-0d3d-4730-8f59-6fcac1f69189 None admin] PATH_INFO: `/v3/groups/251a8633493b4e9ca9cbd51bba53c59f` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:35.536862 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a476e5-0d3d-4730-8f59-6fcac1f69189 None admin] RBAC: Authorizing `identity:get_group(group_id=251a8633493b4e9ca9cbd51bba53c59f)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:35.541138 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a476e5-0d3d-4730-8f59-6fcac1f69189 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:35.544282 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 216/426] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 11:41:35 2022] GET /identity/v3/groups/251a8633493b4e9ca9cbd51bba53c59f => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:35.552429 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a476e5-0d3d-4730-8f59-6fcac1f69189 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:35.597315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe7ebb-43df-4e55-a09a-d79095800c79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:35.599421 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe7ebb-43df-4e55-a09a-d79095800c79 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:35.701170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 211/427] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:35.706862 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe7ebb-43df-4e55-a09a-d79095800c79 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:35.791465 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a476e5-0d3d-4730-8f59-6fcac1f69189 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:35.851053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411e420-ac8e-4414-a8ae-6854df42edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:35.852152 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411e420-ac8e-4414-a8ae-6854df42edf8 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:35.852635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411e420-ac8e-4414-a8ae-6854df42edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:35.853108 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411e420-ac8e-4414-a8ae-6854df42edf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:35.854137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411e420-ac8e-4414-a8ae-6854df42edf8 None admin] RBAC: Adding query filter params (group.id=251a8633493b4e9ca9cbd51bba53c59f, role.id=2ca014d08f26466b980433e75e765505, scope.project.id=2795ff37998c454597b382c5096edefd) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:35.854649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411e420-ac8e-4414-a8ae-6854df42edf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:35.856341 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411e420-ac8e-4414-a8ae-6854df42edf8 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:35.866826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 217/428] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 11:41:35 2022] GET /identity/v3/role_assignments?group.id=251a8633493b4e9ca9cbd51bba53c59f&scope.project.id=2795ff37998c454597b382c5096edefd&role.id=2ca014d08f26466b980433e75e765505 => generated 611 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:35.890559 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe7ebb-43df-4e55-a09a-d79095800c79 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:35.927026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2cff6-84a3-481f-ae5e-2fedf2193122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:35.928377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2cff6-84a3-481f-ae5e-2fedf2193122 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:35.928867 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2cff6-84a3-481f-ae5e-2fedf2193122 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:35.929344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2cff6-84a3-481f-ae5e-2fedf2193122 None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:35.930915 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2cff6-84a3-481f-ae5e-2fedf2193122 None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:35.932617 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2cff6-84a3-481f-ae5e-2fedf2193122 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:35.934563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 212/429] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:35 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:35.940174 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411e420-ac8e-4414-a8ae-6854df42edf8 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:36.071339 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411e420-ac8e-4414-a8ae-6854df42edf8 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:36.112919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccaffb-4ffe-489d-8707-cb3ca8979c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:36.114287 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccaffb-4ffe-489d-8707-cb3ca8979c4d None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:36.114808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccaffb-4ffe-489d-8707-cb3ca8979c4d None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:36.115288 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccaffb-4ffe-489d-8707-cb3ca8979c4d None admin] PATH_INFO: `/v3/groups/251a8633493b4e9ca9cbd51bba53c59f` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:36.116836 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccaffb-4ffe-489d-8707-cb3ca8979c4d None admin] RBAC: Authorizing `identity:get_group(group_id=251a8633493b4e9ca9cbd51bba53c59f)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:36.118579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccaffb-4ffe-489d-8707-cb3ca8979c4d None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:36.120640 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 218/430] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 11:41:35 2022] GET /identity/v3/groups/251a8633493b4e9ca9cbd51bba53c59f => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:36.126655 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2cff6-84a3-481f-ae5e-2fedf2193122 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:36.185798 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288fb32-a2cf-4c50-b201-d1eb025dfbcd None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:36.186444 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288fb32-a2cf-4c50-b201-d1eb025dfbcd None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:36.186924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288fb32-a2cf-4c50-b201-d1eb025dfbcd None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:36.188998 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 219/431] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:41:36.197017 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ade35-9d03-4078-9971-e5f38149b2ee None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:36.197549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ade35-9d03-4078-9971-e5f38149b2ee None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:36.198076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ade35-9d03-4078-9971-e5f38149b2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:36.225026 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-a66ade35-9d03-4078-9971-e5f38149b2ee None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:36.227081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a66ade35-9d03-4078-9971-e5f38149b2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:36.268016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2cff6-84a3-481f-ae5e-2fedf2193122 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:36.309143 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8423f-d20b-4bc1-9636-a2a2129dc42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:36.310247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8423f-d20b-4bc1-9636-a2a2129dc42c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:36.310725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8423f-d20b-4bc1-9636-a2a2129dc42c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:36.311233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8423f-d20b-4bc1-9636-a2a2129dc42c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:36.312340 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8423f-d20b-4bc1-9636-a2a2129dc42c None admin] RBAC: Adding query filter params (group.id=251a8633493b4e9ca9cbd51bba53c59f, role.id=54b3d96f6c9d4d3cbf19a6f0663ba935, scope.project.id=e3d72911271b482a9514071507315e06) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:36.312879 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8423f-d20b-4bc1-9636-a2a2129dc42c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:36.314553 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8423f-d20b-4bc1-9636-a2a2129dc42c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:36.318927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 220/432] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:36.323718 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 213/433] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 11:41:36 2022] GET /identity/v3/role_assignments?group.id=251a8633493b4e9ca9cbd51bba53c59f&scope.project.id=e3d72911271b482a9514071507315e06&role.id=54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:36.342458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ade35-9d03-4078-9971-e5f38149b2ee None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:36.455067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ade35-9d03-4078-9971-e5f38149b2ee None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:36.492638 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e68cb-2499-49d5-9d5a-9316bf6533a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:36.493454 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e68cb-2499-49d5-9d5a-9316bf6533a8 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:36.493735 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e68cb-2499-49d5-9d5a-9316bf6533a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:36.494009 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e68cb-2499-49d5-9d5a-9316bf6533a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:36.506571 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e68cb-2499-49d5-9d5a-9316bf6533a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:36.513815 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-184e68cb-2499-49d5-9d5a-9316bf6533a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 11:41:36.519662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 221/434] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:36.521793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8423f-d20b-4bc1-9636-a2a2129dc42c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:36.624930 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8423f-d20b-4bc1-9636-a2a2129dc42c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:36.658806 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b29cc-1edf-4e08-a2bf-b783b912217b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:36.659489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b29cc-1edf-4e08-a2bf-b783b912217b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:36.659798 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b29cc-1edf-4e08-a2bf-b783b912217b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:36.660078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b29cc-1edf-4e08-a2bf-b783b912217b None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:36.661655 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b29cc-1edf-4e08-a2bf-b783b912217b None admin] RBAC: Adding query filter params (name=member) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:36.661973 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b29cc-1edf-4e08-a2bf-b783b912217b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:36.663358 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b29cc-1edf-4e08-a2bf-b783b912217b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:36.671391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 214/435] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:41:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:36.677724 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e68cb-2499-49d5-9d5a-9316bf6533a8 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:36.684049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b758c9-e168-4af3-8372-0444ad8f53e3 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:36.684365 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b758c9-e168-4af3-8372-0444ad8f53e3 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:36.684620 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b758c9-e168-4af3-8372-0444ad8f53e3 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:36.686651 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 215/436] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:36.693165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf9bfc-f13f-42f9-a2af-828d6157b990 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:36.693501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf9bfc-f13f-42f9-a2af-828d6157b990 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:36.693722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf9bfc-f13f-42f9-a2af-828d6157b990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:36.711547 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-41cf9bfc-f13f-42f9-a2af-828d6157b990 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:36.712778 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-41cf9bfc-f13f-42f9-a2af-828d6157b990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:36.781773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 216/437] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:36.783238 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e68cb-2499-49d5-9d5a-9316bf6533a8 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:36.806864 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf9bfc-f13f-42f9-a2af-828d6157b990 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:36.819671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c735c-9e43-4e34-be19-5d9ad111a519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:36.820324 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c735c-9e43-4e34-be19-5d9ad111a519 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:36.820609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c735c-9e43-4e34-be19-5d9ad111a519 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:36.820890 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c735c-9e43-4e34-be19-5d9ad111a519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:36.888311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c735c-9e43-4e34-be19-5d9ad111a519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:36.889727 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c735c-9e43-4e34-be19-5d9ad111a519 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:36.908021 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf9bfc-f13f-42f9-a2af-828d6157b990 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:36.943428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf55b99-5aec-4f5f-b9c7-2a72584f2b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:36.944278 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf55b99-5aec-4f5f-b9c7-2a72584f2b20 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:36.944566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf55b99-5aec-4f5f-b9c7-2a72584f2b20 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:36.944843 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf55b99-5aec-4f5f-b9c7-2a72584f2b20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:36.954849 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf55b99-5aec-4f5f-b9c7-2a72584f2b20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:36.962529 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-0cf55b99-5aec-4f5f-b9c7-2a72584f2b20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 11:41:36.968568 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 217/438] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:41:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:36.969629 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf55b99-5aec-4f5f-b9c7-2a72584f2b20 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:36.991370 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 222/439] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:36.992439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c735c-9e43-4e34-be19-5d9ad111a519 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:37.068628 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf55b99-5aec-4f5f-b9c7-2a72584f2b20 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:37.090226 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c735c-9e43-4e34-be19-5d9ad111a519 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:37.101150 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc7244-6063-487e-b460-35756a74a814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:37.101821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc7244-6063-487e-b460-35756a74a814 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:37.102102 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc7244-6063-487e-b460-35756a74a814 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:37.102376 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc7244-6063-487e-b460-35756a74a814 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:37.103113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc7244-6063-487e-b460-35756a74a814 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:37.103419 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc7244-6063-487e-b460-35756a74a814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:37.104828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc7244-6063-487e-b460-35756a74a814 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:37.112440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 218/440] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:37.113772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8488f-08fd-435a-88a2-dd610b3e88c3 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:37.114059 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8488f-08fd-435a-88a2-dd610b3e88c3 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:37.114334 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8488f-08fd-435a-88a2-dd610b3e88c3 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:37.116006 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 219/441] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:37.120809 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8488f-08fd-435a-88a2-dd610b3e88c3 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:37.124676 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df002d-b642-43fa-ad22-edf9b3d95194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:37.125519 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df002d-b642-43fa-ad22-edf9b3d95194 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:37.125799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df002d-b642-43fa-ad22-edf9b3d95194 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:37.126072 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df002d-b642-43fa-ad22-edf9b3d95194 None admin] PATH_INFO: `/v3/projects/2795ff37998c454597b382c5096edefd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:37.127325 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df002d-b642-43fa-ad22-edf9b3d95194 None admin] RBAC: Authorizing `identity:get_project(project_id=2795ff37998c454597b382c5096edefd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:37.128807 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df002d-b642-43fa-ad22-edf9b3d95194 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:37.130469 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 223/442] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:36 2022] GET /identity/v3/projects/2795ff37998c454597b382c5096edefd => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:37.131610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a598eb2-a640-403e-b93b-84255df94715 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:37.131890 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a598eb2-a640-403e-b93b-84255df94715 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:37.132162 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a598eb2-a640-403e-b93b-84255df94715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:37.148967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-4a598eb2-a640-403e-b93b-84255df94715 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:37.150076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-4a598eb2-a640-403e-b93b-84255df94715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:37.211611 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 224/443] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:37.212708 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a598eb2-a640-403e-b93b-84255df94715 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:37.220359 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8488f-08fd-435a-88a2-dd610b3e88c3 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:37.252847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f8083-b19d-4466-bd7e-b13c9a84dc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:37.253481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f8083-b19d-4466-bd7e-b13c9a84dc20 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:37.253765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f8083-b19d-4466-bd7e-b13c9a84dc20 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:37.254040 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f8083-b19d-4466-bd7e-b13c9a84dc20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:37.316561 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a598eb2-a640-403e-b93b-84255df94715 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:37.318492 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f8083-b19d-4466-bd7e-b13c9a84dc20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:37.320021 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f8083-b19d-4466-bd7e-b13c9a84dc20 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:37.348910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77343bfd-ca06-4b59-8b21-ce762fc07bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:37.349753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77343bfd-ca06-4b59-8b21-ce762fc07bb6 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:37.350036 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77343bfd-ca06-4b59-8b21-ce762fc07bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:37.350312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77343bfd-ca06-4b59-8b21-ce762fc07bb6 None admin] PATH_INFO: `/v3/groups/251a8633493b4e9ca9cbd51bba53c59f` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:37.351485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77343bfd-ca06-4b59-8b21-ce762fc07bb6 None admin] RBAC: Authorizing `identity:get_group(group_id=251a8633493b4e9ca9cbd51bba53c59f)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:37.352951 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77343bfd-ca06-4b59-8b21-ce762fc07bb6 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:37.354561 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 225/444] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 11:41:37 2022] GET /identity/v3/groups/251a8633493b4e9ca9cbd51bba53c59f => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:37.355323 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77343bfd-ca06-4b59-8b21-ce762fc07bb6 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:37.415238 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 220/445] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 11:41:37.415933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f8083-b19d-4466-bd7e-b13c9a84dc20 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:37.452185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77343bfd-ca06-4b59-8b21-ce762fc07bb6 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:37.484710 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc9177-6593-41d1-9ce4-29b9cc205301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:37.485496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc9177-6593-41d1-9ce4-29b9cc205301 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:37.485778 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc9177-6593-41d1-9ce4-29b9cc205301 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:37.486053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc9177-6593-41d1-9ce4-29b9cc205301 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:37.496235 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc9177-6593-41d1-9ce4-29b9cc205301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:37.503107 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-16dc9177-6593-41d1-9ce4-29b9cc205301 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:41:37.504337 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 226/446] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:41:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:37.505283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc9177-6593-41d1-9ce4-29b9cc205301 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:37.514808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f8083-b19d-4466-bd7e-b13c9a84dc20 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:37.547171 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c9c56-6830-4833-b6ac-70da15f6116f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:37.547852 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c9c56-6830-4833-b6ac-70da15f6116f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:37.548134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c9c56-6830-4833-b6ac-70da15f6116f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:37.548410 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c9c56-6830-4833-b6ac-70da15f6116f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:37.549223 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c9c56-6830-4833-b6ac-70da15f6116f None admin] RBAC: Adding query filter params (group.id=251a8633493b4e9ca9cbd51bba53c59f, role.id=54b3d96f6c9d4d3cbf19a6f0663ba935, scope.project.id=2795ff37998c454597b382c5096edefd) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:37.549531 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c9c56-6830-4833-b6ac-70da15f6116f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:37.551618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c9c56-6830-4833-b6ac-70da15f6116f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:37.559611 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 221/447] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 11:41:37 2022] GET /identity/v3/role_assignments?group.id=251a8633493b4e9ca9cbd51bba53c59f&scope.project.id=2795ff37998c454597b382c5096edefd&role.id=54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:37.560335 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c9c56-6830-4833-b6ac-70da15f6116f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:37.608917 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc9177-6593-41d1-9ce4-29b9cc205301 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:37.645526 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26078cc-99d0-4648-9871-c697bc759c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:37.646433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26078cc-99d0-4648-9871-c697bc759c9e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:37.646709 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26078cc-99d0-4648-9871-c697bc759c9e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:37.646978 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26078cc-99d0-4648-9871-c697bc759c9e None admin] PATH_INFO: `/v3/projects/e3d72911271b482a9514071507315e06` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:37.648283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26078cc-99d0-4648-9871-c697bc759c9e None admin] RBAC: Authorizing `identity:get_project(project_id=e3d72911271b482a9514071507315e06)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:37.649757 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26078cc-99d0-4648-9871-c697bc759c9e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:37.651918 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 227/448] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:37 2022] GET /identity/v3/projects/e3d72911271b482a9514071507315e06 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:37.657284 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26078cc-99d0-4648-9871-c697bc759c9e None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:37.670255 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c9c56-6830-4833-b6ac-70da15f6116f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:37.705830 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8088e3-4c47-4a82-b30d-74ced2ed43cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:37.706507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8088e3-4c47-4a82-b30d-74ced2ed43cb None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:37.706786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8088e3-4c47-4a82-b30d-74ced2ed43cb None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:37.707054 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8088e3-4c47-4a82-b30d-74ced2ed43cb None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:37.707870 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8088e3-4c47-4a82-b30d-74ced2ed43cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:37.708333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8088e3-4c47-4a82-b30d-74ced2ed43cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:37.709744 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8088e3-4c47-4a82-b30d-74ced2ed43cb None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:37.718486 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 222/449] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:37.724732 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8088e3-4c47-4a82-b30d-74ced2ed43cb None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:37.760607 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26078cc-99d0-4648-9871-c697bc759c9e None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:37.795688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6408f5b-1531-4d32-9f23-9baf538c0cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:37.796543 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6408f5b-1531-4d32-9f23-9baf538c0cf8 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:37.796828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6408f5b-1531-4d32-9f23-9baf538c0cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:37.797104 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6408f5b-1531-4d32-9f23-9baf538c0cf8 None admin] PATH_INFO: `/v3/groups/251a8633493b4e9ca9cbd51bba53c59f` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:37.798300 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6408f5b-1531-4d32-9f23-9baf538c0cf8 None admin] RBAC: Authorizing `identity:get_group(group_id=251a8633493b4e9ca9cbd51bba53c59f)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:37.799791 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6408f5b-1531-4d32-9f23-9baf538c0cf8 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:37.802048 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 228/450] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 11:41:37 2022] GET /identity/v3/groups/251a8633493b4e9ca9cbd51bba53c59f => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:37.807968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6408f5b-1531-4d32-9f23-9baf538c0cf8 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:37.841495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8088e3-4c47-4a82-b30d-74ced2ed43cb None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:37.881316 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87da30b-8f00-4ca6-9920-c145e6e6bb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:37.881975 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da30b-8f00-4ca6-9920-c145e6e6bb82 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:37.882269 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da30b-8f00-4ca6-9920-c145e6e6bb82 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:37.882529 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da30b-8f00-4ca6-9920-c145e6e6bb82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:37.922051 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6408f5b-1531-4d32-9f23-9baf538c0cf8 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:37.960872 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d50bb8-53d7-4e60-87b0-a03122d4dbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:37.961156 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87da30b-8f00-4ca6-9920-c145e6e6bb82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:37.961523 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d50bb8-53d7-4e60-87b0-a03122d4dbb3 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:37.961813 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d50bb8-53d7-4e60-87b0-a03122d4dbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:37.962085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d50bb8-53d7-4e60-87b0-a03122d4dbb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:37.962904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d50bb8-53d7-4e60-87b0-a03122d4dbb3 None admin] RBAC: Adding query filter params (group.id=251a8633493b4e9ca9cbd51bba53c59f, role.id=2ca014d08f26466b980433e75e765505, scope.project.id=e3d72911271b482a9514071507315e06) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:37.963019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87da30b-8f00-4ca6-9920-c145e6e6bb82 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:37.963238 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d50bb8-53d7-4e60-87b0-a03122d4dbb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:37.964789 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d50bb8-53d7-4e60-87b0-a03122d4dbb3 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:37.971815 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 229/451] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 11:41:37 2022] GET /identity/v3/role_assignments?group.id=251a8633493b4e9ca9cbd51bba53c59f&scope.project.id=e3d72911271b482a9514071507315e06&role.id=2ca014d08f26466b980433e75e765505 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:38.079128 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 223/452] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 11:41:38.087697 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d50bb8-53d7-4e60-87b0-a03122d4dbb3 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:38.193700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d50bb8-53d7-4e60-87b0-a03122d4dbb3 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:38.230518 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58a76e-2ca7-4233-9431-a4af2b51c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:38.231388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58a76e-2ca7-4233-9431-a4af2b51c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:38.231700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58a76e-2ca7-4233-9431-a4af2b51c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:38.231976 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58a76e-2ca7-4233-9431-a4af2b51c0a7 None admin] PATH_INFO: `/v3/projects/675cf84704734f5798e386951dca511b` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:38.233257 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58a76e-2ca7-4233-9431-a4af2b51c0a7 None admin] RBAC: Authorizing `identity:get_project(project_id=675cf84704734f5798e386951dca511b)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:38.234704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58a76e-2ca7-4233-9431-a4af2b51c0a7 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:38.236466 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 230/453] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:41:38 2022] GET /identity/v3/projects/675cf84704734f5798e386951dca511b => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:38.242574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87da30b-8f00-4ca6-9920-c145e6e6bb82 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:38.340040 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87da30b-8f00-4ca6-9920-c145e6e6bb82 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:38.374742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b98cc1-395c-451c-b9dd-f3c5a7f66f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:38.375666 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b98cc1-395c-451c-b9dd-f3c5a7f66f90 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:38.375948 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b98cc1-395c-451c-b9dd-f3c5a7f66f90 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:38.376223 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b98cc1-395c-451c-b9dd-f3c5a7f66f90 None admin] PATH_INFO: `/v3/groups/23db25ed2de449ab854eb32cdfea0f93` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:38.377392 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b98cc1-395c-451c-b9dd-f3c5a7f66f90 None admin] RBAC: Authorizing `identity:get_group(group_id=23db25ed2de449ab854eb32cdfea0f93)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:38.378841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b98cc1-395c-451c-b9dd-f3c5a7f66f90 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:38.380875 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 224/454] 10.222.0.52 () {56 vars in 1180 bytes} [Tue Mar 8 11:41:38 2022] GET /identity/v3/groups/23db25ed2de449ab854eb32cdfea0f93 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:38.386317 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58a76e-2ca7-4233-9431-a4af2b51c0a7 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:38.482782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58a76e-2ca7-4233-9431-a4af2b51c0a7 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:38.514589 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e509f0e-7d10-47e4-bed1-e945a7da25be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:38.515234 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e509f0e-7d10-47e4-bed1-e945a7da25be None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:38.515546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e509f0e-7d10-47e4-bed1-e945a7da25be None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:38.515824 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e509f0e-7d10-47e4-bed1-e945a7da25be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:38.516643 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e509f0e-7d10-47e4-bed1-e945a7da25be None admin] RBAC: Adding query filter params (group.id=23db25ed2de449ab854eb32cdfea0f93, role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=675cf84704734f5798e386951dca511b) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:38.516956 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e509f0e-7d10-47e4-bed1-e945a7da25be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:38.518400 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e509f0e-7d10-47e4-bed1-e945a7da25be None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:38.524085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 231/455] 10.222.0.52 () {56 vars in 1376 bytes} [Tue Mar 8 11:41:38 2022] GET /identity/v3/role_assignments?group.id=23db25ed2de449ab854eb32cdfea0f93&scope.project.id=675cf84704734f5798e386951dca511b&role.id=c2642d38bc964424a5edc330e0d4471d => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:41.459789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bed1b-8735-4985-8483-d965c61823b5 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:41.460781 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bed1b-8735-4985-8483-d965c61823b5 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:41.461285 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bed1b-8735-4985-8483-d965c61823b5 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:41.463513 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 225/456] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:41.469759 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9733-d248-4f30-bd63-7bdebdd56039 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:41.470603 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9733-d248-4f30-bd63-7bdebdd56039 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:41.471077 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9733-d248-4f30-bd63-7bdebdd56039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:41.495698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-e7bf9733-d248-4f30-bd63-7bdebdd56039 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:41.497205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-e7bf9733-d248-4f30-bd63-7bdebdd56039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:41.594171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 232/457] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:41.620947 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078897e-d188-4e92-a8cf-58766f7f3758 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:41.621575 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078897e-d188-4e92-a8cf-58766f7f3758 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:41.622067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078897e-d188-4e92-a8cf-58766f7f3758 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:41.624376 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 226/458] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:41.630028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925666d0-926c-4c3f-9955-750fef2c28e4 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:41.630320 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925666d0-926c-4c3f-9955-750fef2c28e4 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:41.630601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925666d0-926c-4c3f-9955-750fef2c28e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:41.637294 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078897e-d188-4e92-a8cf-58766f7f3758 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:41.661771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-925666d0-926c-4c3f-9955-750fef2c28e4 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:41.662999 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-925666d0-926c-4c3f-9955-750fef2c28e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:41.786308 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078897e-d188-4e92-a8cf-58766f7f3758 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:41.789433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 233/459] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:41.814537 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925666d0-926c-4c3f-9955-750fef2c28e4 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:41.857170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0628a-dbf3-42ec-af02-547f313e06e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:41.857973 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0628a-dbf3-42ec-af02-547f313e06e3 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:41.858412 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0628a-dbf3-42ec-af02-547f313e06e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:41.858689 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0628a-dbf3-42ec-af02-547f313e06e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:41.872152 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0628a-dbf3-42ec-af02-547f313e06e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:41.874043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0628a-dbf3-42ec-af02-547f313e06e3 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:41.896529 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-71d0628a-dbf3-42ec-af02-547f313e06e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:41.898046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 227/460] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:41.899755 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee7e20-71a5-46f1-befa-2634d01bd481 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:41.900041 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee7e20-71a5-46f1-befa-2634d01bd481 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:41.900314 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee7e20-71a5-46f1-befa-2634d01bd481 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:41.903106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 228/461] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:41.904680 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee7e20-71a5-46f1-befa-2634d01bd481 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:41.934458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925666d0-926c-4c3f-9955-750fef2c28e4 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:41.981244 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74799de2-d5dd-4e19-930d-9cf6520bc0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:41.982117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74799de2-d5dd-4e19-930d-9cf6520bc0eb None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:41.982404 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74799de2-d5dd-4e19-930d-9cf6520bc0eb None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:41.982677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74799de2-d5dd-4e19-930d-9cf6520bc0eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:41.994291 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74799de2-d5dd-4e19-930d-9cf6520bc0eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:41.995849 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74799de2-d5dd-4e19-930d-9cf6520bc0eb None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:42.013043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-74799de2-d5dd-4e19-930d-9cf6520bc0eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:42.014564 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 234/462] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:42.015834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369fdff-73e4-4a30-969f-389cdef5caa6 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:42.016116 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369fdff-73e4-4a30-969f-389cdef5caa6 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:42.016389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369fdff-73e4-4a30-969f-389cdef5caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:42.019578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee7e20-71a5-46f1-befa-2634d01bd481 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:42.036569 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-1369fdff-73e4-4a30-969f-389cdef5caa6 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:42.038058 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-1369fdff-73e4-4a30-969f-389cdef5caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:42.056709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d1519-5ca9-48ec-a162-be53ac13b747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:42.057379 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d1519-5ca9-48ec-a162-be53ac13b747 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:42.057661 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d1519-5ca9-48ec-a162-be53ac13b747 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:42.057935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d1519-5ca9-48ec-a162-be53ac13b747 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:42.058659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d1519-5ca9-48ec-a162-be53ac13b747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:42.058970 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d1519-5ca9-48ec-a162-be53ac13b747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:42.060427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d1519-5ca9-48ec-a162-be53ac13b747 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:42.073049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 229/463] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:42.073966 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d1519-5ca9-48ec-a162-be53ac13b747 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:42.122101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 235/464] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:42.122949 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369fdff-73e4-4a30-969f-389cdef5caa6 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:42.201327 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d1519-5ca9-48ec-a162-be53ac13b747 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:42.237528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369fdff-73e4-4a30-969f-389cdef5caa6 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:42.244301 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd42b1-c807-4dd1-9dfd-73c34e26aee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:42.245167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd42b1-c807-4dd1-9dfd-73c34e26aee3 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:42.245585 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd42b1-c807-4dd1-9dfd-73c34e26aee3 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:42.245986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd42b1-c807-4dd1-9dfd-73c34e26aee3 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:42.247145 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd42b1-c807-4dd1-9dfd-73c34e26aee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:42.247629 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd42b1-c807-4dd1-9dfd-73c34e26aee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:42.249477 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd42b1-c807-4dd1-9dfd-73c34e26aee3 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:42.262937 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 230/465] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:42.263617 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd42b1-c807-4dd1-9dfd-73c34e26aee3 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:42.279088 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ea95f-1af2-4763-b461-ea2b568a281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:42.279792 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ea95f-1af2-4763-b461-ea2b568a281c None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:42.280072 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ea95f-1af2-4763-b461-ea2b568a281c None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:42.280343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ea95f-1af2-4763-b461-ea2b568a281c None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:42.281038 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ea95f-1af2-4763-b461-ea2b568a281c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:42.282475 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ea95f-1af2-4763-b461-ea2b568a281c None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:42.358761 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd42b1-c807-4dd1-9dfd-73c34e26aee3 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:42.391773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201b1ea-1a31-46e8-9dd6-33bdf4c4cfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:42.392557 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201b1ea-1a31-46e8-9dd6-33bdf4c4cfef None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:42.392836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201b1ea-1a31-46e8-9dd6-33bdf4c4cfef None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:42.393107 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201b1ea-1a31-46e8-9dd6-33bdf4c4cfef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:42.403620 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201b1ea-1a31-46e8-9dd6-33bdf4c4cfef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:42.405149 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201b1ea-1a31-46e8-9dd6-33bdf4c4cfef None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:42.407691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 236/466] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:41:42 2022] POST /identity/v3/users => generated 246 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:41:42.409268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bd2ed-de32-4bd1-a30e-3b37026de972 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:42.409755 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bd2ed-de32-4bd1-a30e-3b37026de972 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:42.410249 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bd2ed-de32-4bd1-a30e-3b37026de972 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:42.412770 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 237/467] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:42.414760 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bd2ed-de32-4bd1-a30e-3b37026de972 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:42.433500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-d201b1ea-1a31-46e8-9dd6-33bdf4c4cfef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:42.439999 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 231/468] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:42.442714 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63e9ee-3035-44d5-851d-646b58945b30 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:42.443351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63e9ee-3035-44d5-851d-646b58945b30 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:42.443849 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63e9ee-3035-44d5-851d-646b58945b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:42.464925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-3a63e9ee-3035-44d5-851d-646b58945b30 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:42.466975 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-3a63e9ee-3035-44d5-851d-646b58945b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:42.547956 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 232/469] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:42.549161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63e9ee-3035-44d5-851d-646b58945b30 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:42.554808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bd2ed-de32-4bd1-a30e-3b37026de972 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:42.592706 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e36178-bb4f-417a-b2b3-088ad631dd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:42.598506 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e36178-bb4f-417a-b2b3-088ad631dd3f None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:42.598506 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e36178-bb4f-417a-b2b3-088ad631dd3f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:42.598506 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e36178-bb4f-417a-b2b3-088ad631dd3f None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:42.598506 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e36178-bb4f-417a-b2b3-088ad631dd3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:42.598506 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e36178-bb4f-417a-b2b3-088ad631dd3f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:42.678265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63e9ee-3035-44d5-851d-646b58945b30 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:42.704024 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 238/470] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:41:42 2022] POST /identity/v3/users => generated 248 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:41:42.709043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede637d6-f0bb-488a-a227-a2469219bcea None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:42.709324 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede637d6-f0bb-488a-a227-a2469219bcea None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:42.709587 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede637d6-f0bb-488a-a227-a2469219bcea None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:42.711689 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 239/471] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:42.715719 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede637d6-f0bb-488a-a227-a2469219bcea None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:42.724260 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4fe92-8545-4bad-8e46-a755507aee3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:42.724959 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fe92-8545-4bad-8e46-a755507aee3f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:42.725243 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fe92-8545-4bad-8e46-a755507aee3f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:42.725517 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fe92-8545-4bad-8e46-a755507aee3f None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:42.726343 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4fe92-8545-4bad-8e46-a755507aee3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:42.726652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4fe92-8545-4bad-8e46-a755507aee3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:42.728313 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4fe92-8545-4bad-8e46-a755507aee3f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:42.745350 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 233/472] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:42.746746 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b25bf-931f-4da6-919d-3e5514a0b541 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:42.747086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b25bf-931f-4da6-919d-3e5514a0b541 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:42.747371 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b25bf-931f-4da6-919d-3e5514a0b541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:42.771027 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-677b25bf-931f-4da6-919d-3e5514a0b541 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:42.772481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-677b25bf-931f-4da6-919d-3e5514a0b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:42.856086 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede637d6-f0bb-488a-a227-a2469219bcea None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:42.856748 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 234/473] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:42.858093 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b25bf-931f-4da6-919d-3e5514a0b541 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:42.908453 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb6b6d-86a5-489c-823c-fe55f9ceed3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:42.909253 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb6b6d-86a5-489c-823c-fe55f9ceed3a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:42.909530 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb6b6d-86a5-489c-823c-fe55f9ceed3a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:42.909826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb6b6d-86a5-489c-823c-fe55f9ceed3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:42.923873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb6b6d-86a5-489c-823c-fe55f9ceed3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:42.925347 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb6b6d-86a5-489c-823c-fe55f9ceed3a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:42.946085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-5deb6b6d-86a5-489c-823c-fe55f9ceed3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:42.947573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 240/474] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:42.948511 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb6b6d-86a5-489c-823c-fe55f9ceed3a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:42.992101 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b25bf-931f-4da6-919d-3e5514a0b541 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:43.037943 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2dc75-7548-4f1e-9067-b784402566d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:43.038980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2dc75-7548-4f1e-9067-b784402566d3 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:43.039465 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2dc75-7548-4f1e-9067-b784402566d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:43.039963 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2dc75-7548-4f1e-9067-b784402566d3 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:43.040928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2dc75-7548-4f1e-9067-b784402566d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:43.042575 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2dc75-7548-4f1e-9067-b784402566d3 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:43.065999 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb6b6d-86a5-489c-823c-fe55f9ceed3a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:43.099508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddaf37-5cf7-417c-9553-83cb3713f147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:43.100196 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddaf37-5cf7-417c-9553-83cb3713f147 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:43.100470 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddaf37-5cf7-417c-9553-83cb3713f147 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:43.100742 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddaf37-5cf7-417c-9553-83cb3713f147 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:43.101471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddaf37-5cf7-417c-9553-83cb3713f147 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:43.102851 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddaf37-5cf7-417c-9553-83cb3713f147 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:43.166845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.sql.core [None req-adddaf37-5cf7-417c-9553-83cb3713f147 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 08 11:41:43.166845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 08 11:41:43.166845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [parameters: {'id': 'a2c3012757b64538a9d4235fdc2e3f89', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 08 11:41:43.166845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86145) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 08 11:41:43.181391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-adddaf37-5cf7-417c-9553-83cb3713f147 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 08 11:41:43.182970 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 241/475] 10.222.0.52 () {60 vars in 1131 bytes} [Tue Mar 8 11:41:42 2022] POST /identity/v3/roles => generated 144 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:43.183665 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddaf37-5cf7-417c-9553-83cb3713f147 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:43.221242 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 235/476] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:41:42 2022] POST /identity/v3/users => generated 248 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:41:43.221242 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2dc75-7548-4f1e-9067-b784402566d3 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:43.299357 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddaf37-5cf7-417c-9553-83cb3713f147 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:43.341090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394250a9-b9db-4012-9777-43f9229e9cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:43.341779 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394250a9-b9db-4012-9777-43f9229e9cc2 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:43.342054 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394250a9-b9db-4012-9777-43f9229e9cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:43.342384 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394250a9-b9db-4012-9777-43f9229e9cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:43.343131 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394250a9-b9db-4012-9777-43f9229e9cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:43.343436 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394250a9-b9db-4012-9777-43f9229e9cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:43.344906 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394250a9-b9db-4012-9777-43f9229e9cc2 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:43.372125 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 242/477] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:43.377918 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394250a9-b9db-4012-9777-43f9229e9cc2 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:43.434663 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2dc75-7548-4f1e-9067-b784402566d3 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:43.489691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfa4ab-9852-421d-84ca-f3ce162a66fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:43.490437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfa4ab-9852-421d-84ca-f3ce162a66fe None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:43.490697 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfa4ab-9852-421d-84ca-f3ce162a66fe None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:43.491071 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfa4ab-9852-421d-84ca-f3ce162a66fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:43.497742 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394250a9-b9db-4012-9777-43f9229e9cc2 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:43.501256 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfa4ab-9852-421d-84ca-f3ce162a66fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:43.509129 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-fbdfa4ab-9852-421d-84ca-f3ce162a66fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 11:41:43.510710 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 236/478] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:41:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:43.518242 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfa4ab-9852-421d-84ca-f3ce162a66fe None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:43.543160 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e709e1-32d8-4cc7-82b4-da7febaa0613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:43.543897 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e709e1-32d8-4cc7-82b4-da7febaa0613 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:43.544180 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e709e1-32d8-4cc7-82b4-da7febaa0613 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:43.544450 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e709e1-32d8-4cc7-82b4-da7febaa0613 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:43.545213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e709e1-32d8-4cc7-82b4-da7febaa0613 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:43.546668 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e709e1-32d8-4cc7-82b4-da7febaa0613 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:43.624803 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfa4ab-9852-421d-84ca-f3ce162a66fe None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:43.631133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 243/479] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:41:43 2022] POST /identity/v3/users => generated 249 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:41:43.662040 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2043eb5-b4de-4cab-a83b-ee8fb6057074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:43.662728 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2043eb5-b4de-4cab-a83b-ee8fb6057074 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:43.663081 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2043eb5-b4de-4cab-a83b-ee8fb6057074 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:43.663353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2043eb5-b4de-4cab-a83b-ee8fb6057074 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:43.664142 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2043eb5-b4de-4cab-a83b-ee8fb6057074 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:43.664449 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2043eb5-b4de-4cab-a83b-ee8fb6057074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:43.665829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2043eb5-b4de-4cab-a83b-ee8fb6057074 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:43.679700 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 237/480] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:45.173861 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0b97b-2106-4636-a280-63cea7ff987c None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:45.174408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0b97b-2106-4636-a280-63cea7ff987c None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:45.174408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0b97b-2106-4636-a280-63cea7ff987c None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:45.176520 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 244/481] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:45.194257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff38ca4-1c95-4144-8f06-a3a1a6a0aed8 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:45.194691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff38ca4-1c95-4144-8f06-a3a1a6a0aed8 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:45.194842 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff38ca4-1c95-4144-8f06-a3a1a6a0aed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:45.228535 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-6ff38ca4-1c95-4144-8f06-a3a1a6a0aed8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:45.229727 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-6ff38ca4-1c95-4144-8f06-a3a1a6a0aed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:45.310525 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 238/482] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:45.346021 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0b97b-2106-4636-a280-63cea7ff987c None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:45.453234 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0b97b-2106-4636-a280-63cea7ff987c None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:45.490006 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa2659-c73d-46a7-b0f3-13b09958da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:45.491637 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa2659-c73d-46a7-b0f3-13b09958da0e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:45.492028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa2659-c73d-46a7-b0f3-13b09958da0e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:45.492379 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa2659-c73d-46a7-b0f3-13b09958da0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:45.505525 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa2659-c73d-46a7-b0f3-13b09958da0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:45.512489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-b5fa2659-c73d-46a7-b0f3-13b09958da0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:41:45.514070 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 245/483] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:41:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:45.519508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff38ca4-1c95-4144-8f06-a3a1a6a0aed8 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:45.527171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62911f-3f7b-4e8b-b9ac-c66e576ba8d3 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:45.527453 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62911f-3f7b-4e8b-b9ac-c66e576ba8d3 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:45.527754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62911f-3f7b-4e8b-b9ac-c66e576ba8d3 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:45.529776 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 246/484] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:41:45.537302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5a3a2-bc0d-43d4-8b2b-49f37b83e912 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:45.537576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5a3a2-bc0d-43d4-8b2b-49f37b83e912 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:45.537854 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5a3a2-bc0d-43d4-8b2b-49f37b83e912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:45.556831 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-33e5a3a2-bc0d-43d4-8b2b-49f37b83e912 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:45.558056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-33e5a3a2-bc0d-43d4-8b2b-49f37b83e912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:45.646333 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 247/485] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:45.685234 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff38ca4-1c95-4144-8f06-a3a1a6a0aed8 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:45.686674 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5a3a2-bc0d-43d4-8b2b-49f37b83e912 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:45.754472 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db25985-fd68-4ca4-8c86-6b9a5538f1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:45.755189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db25985-fd68-4ca4-8c86-6b9a5538f1cb None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:45.755593 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db25985-fd68-4ca4-8c86-6b9a5538f1cb None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:45.755877 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db25985-fd68-4ca4-8c86-6b9a5538f1cb None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:45.756677 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db25985-fd68-4ca4-8c86-6b9a5538f1cb None admin] RBAC: Adding query filter params (name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:45.756981 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db25985-fd68-4ca4-8c86-6b9a5538f1cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:45.758521 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db25985-fd68-4ca4-8c86-6b9a5538f1cb None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:45.775901 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 239/486] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:41:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:45.783024 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db25985-fd68-4ca4-8c86-6b9a5538f1cb None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:45.815733 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5a3a2-bc0d-43d4-8b2b-49f37b83e912 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:45.851897 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30cbaf-0eb6-487f-b769-a76243632b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:45.852705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30cbaf-0eb6-487f-b769-a76243632b34 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:45.852987 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30cbaf-0eb6-487f-b769-a76243632b34 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:45.853262 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30cbaf-0eb6-487f-b769-a76243632b34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:45.864612 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30cbaf-0eb6-487f-b769-a76243632b34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:45.871610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-1b30cbaf-0eb6-487f-b769-a76243632b34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:41:45.873132 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 248/487] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:41:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:45.879004 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30cbaf-0eb6-487f-b769-a76243632b34 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:45.966848 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db25985-fd68-4ca4-8c86-6b9a5538f1cb None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:46.042411 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30cbaf-0eb6-487f-b769-a76243632b34 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:46.068869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a771a-5dda-49cc-b0e2-2145f690ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:46.069699 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a771a-5dda-49cc-b0e2-2145f690ef63 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:46.072688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88437773-0974-433c-b950-4f98e25acdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:46.072838 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a771a-5dda-49cc-b0e2-2145f690ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:46.072838 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a771a-5dda-49cc-b0e2-2145f690ef63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:46.072968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88437773-0974-433c-b950-4f98e25acdc4 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:46.072968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88437773-0974-433c-b950-4f98e25acdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:46.072968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88437773-0974-433c-b950-4f98e25acdc4 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:46.072968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88437773-0974-433c-b950-4f98e25acdc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:46.072968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88437773-0974-433c-b950-4f98e25acdc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:46.073676 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88437773-0974-433c-b950-4f98e25acdc4 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:46.084255 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 249/488] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:41:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:46.092654 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88437773-0974-433c-b950-4f98e25acdc4 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:46.097139 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a771a-5dda-49cc-b0e2-2145f690ef63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:46.098742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a771a-5dda-49cc-b0e2-2145f690ef63 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:46.132452 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-472a771a-5dda-49cc-b0e2-2145f690ef63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:46.141683 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 240/489] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:46.159072 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a771a-5dda-49cc-b0e2-2145f690ef63 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:46.269646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88437773-0974-433c-b950-4f98e25acdc4 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:46.330756 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a771a-5dda-49cc-b0e2-2145f690ef63 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:46.342122 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa208769-fafd-4703-b202-3962497182c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:46.342974 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa208769-fafd-4703-b202-3962497182c1 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:46.343271 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa208769-fafd-4703-b202-3962497182c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:46.343654 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa208769-fafd-4703-b202-3962497182c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:46.359157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa208769-fafd-4703-b202-3962497182c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:46.360649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa208769-fafd-4703-b202-3962497182c1 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:46.392654 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-fa208769-fafd-4703-b202-3962497182c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:46.395470 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 250/490] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:46.400318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e37f5-5487-4afe-923e-fbd51ded0cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:46.401005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e37f5-5487-4afe-923e-fbd51ded0cd7 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:46.401544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e37f5-5487-4afe-923e-fbd51ded0cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:46.401824 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e37f5-5487-4afe-923e-fbd51ded0cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:46.402556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e37f5-5487-4afe-923e-fbd51ded0cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:46.402865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e37f5-5487-4afe-923e-fbd51ded0cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:46.404292 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e37f5-5487-4afe-923e-fbd51ded0cd7 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:46.407918 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa208769-fafd-4703-b202-3962497182c1 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:46.430962 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 241/491] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:46.436142 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e37f5-5487-4afe-923e-fbd51ded0cd7 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:46.554324 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa208769-fafd-4703-b202-3962497182c1 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:46.554692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e37f5-5487-4afe-923e-fbd51ded0cd7 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:46.589649 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2219da-0425-4aa2-b698-61d90af2aa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:46.589978 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805493d-7c61-4db6-8d06-6bc8246dfb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:46.590366 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2219da-0425-4aa2-b698-61d90af2aa69 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:46.590598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805493d-7c61-4db6-8d06-6bc8246dfb8e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:46.590691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2219da-0425-4aa2-b698-61d90af2aa69 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:46.590876 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805493d-7c61-4db6-8d06-6bc8246dfb8e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:46.590967 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2219da-0425-4aa2-b698-61d90af2aa69 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:46.591149 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805493d-7c61-4db6-8d06-6bc8246dfb8e None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:46.591889 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805493d-7c61-4db6-8d06-6bc8246dfb8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:46.592194 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805493d-7c61-4db6-8d06-6bc8246dfb8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:46.593805 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805493d-7c61-4db6-8d06-6bc8246dfb8e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:46.598692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2219da-0425-4aa2-b698-61d90af2aa69 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:46.600159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2219da-0425-4aa2-b698-61d90af2aa69 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:46.609875 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 251/492] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:46.609875 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31943b-d427-4ab7-9d72-0a04bdab9a3f None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:46.609875 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31943b-d427-4ab7-9d72-0a04bdab9a3f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:46.609875 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31943b-d427-4ab7-9d72-0a04bdab9a3f None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:46.609875 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 252/493] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:46.610339 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255dcb6-9e6d-4b9a-91b9-9b1e9cbfb7b5 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:46.610558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255dcb6-9e6d-4b9a-91b9-9b1e9cbfb7b5 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:46.610929 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255dcb6-9e6d-4b9a-91b9-9b1e9cbfb7b5 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:46.612619 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 253/494] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:46.617769 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255dcb6-9e6d-4b9a-91b9-9b1e9cbfb7b5 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:46.626451 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-7f2219da-0425-4aa2-b698-61d90af2aa69 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 11:41:46.626451 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 242/495] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 11:41:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:46.626451 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4c723-74d3-4af0-a881-6bc0e4f13977 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:46.626451 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4c723-74d3-4af0-a881-6bc0e4f13977 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:46.626451 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4c723-74d3-4af0-a881-6bc0e4f13977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:46.645160 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-11b4c723-74d3-4af0-a881-6bc0e4f13977 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:46.646410 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-11b4c723-74d3-4af0-a881-6bc0e4f13977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:46.712605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 243/496] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:46.714117 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf0c06-ad19-4808-95aa-17fb12d2bba1 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:46.714545 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf0c06-ad19-4808-95aa-17fb12d2bba1 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:46.714991 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf0c06-ad19-4808-95aa-17fb12d2bba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:46.732661 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-1edf0c06-ad19-4808-95aa-17fb12d2bba1 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:46.733561 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255dcb6-9e6d-4b9a-91b9-9b1e9cbfb7b5 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:46.734315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1edf0c06-ad19-4808-95aa-17fb12d2bba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:46.772781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613e917-f22c-4af2-91d0-6e432e16e0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:46.773583 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613e917-f22c-4af2-91d0-6e432e16e0a9 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:46.773860 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613e917-f22c-4af2-91d0-6e432e16e0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:46.774167 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613e917-f22c-4af2-91d0-6e432e16e0a9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:46.786206 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613e917-f22c-4af2-91d0-6e432e16e0a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:46.787719 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613e917-f22c-4af2-91d0-6e432e16e0a9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:46.801889 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-6613e917-f22c-4af2-91d0-6e432e16e0a9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 08 11:41:46.807352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 254/497] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:46.807352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613e917-f22c-4af2-91d0-6e432e16e0a9 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:46.826701 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 244/498] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:46.828424 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf0c06-ad19-4808-95aa-17fb12d2bba1 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:46.911274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613e917-f22c-4af2-91d0-6e432e16e0a9 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:46.932322 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf0c06-ad19-4808-95aa-17fb12d2bba1 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:46.942483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88d553-e0b9-4bce-880f-035c50609145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:46.943149 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88d553-e0b9-4bce-880f-035c50609145 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:46.943429 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88d553-e0b9-4bce-880f-035c50609145 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:46.943731 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88d553-e0b9-4bce-880f-035c50609145 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:46.944556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88d553-e0b9-4bce-880f-035c50609145 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:46.944867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88d553-e0b9-4bce-880f-035c50609145 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:46.946306 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88d553-e0b9-4bce-880f-035c50609145 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:46.964598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4027f-559d-4d9a-aee0-2302248da1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:46.965388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4027f-559d-4d9a-aee0-2302248da1d6 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:46.965668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4027f-559d-4d9a-aee0-2302248da1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:46.965940 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4027f-559d-4d9a-aee0-2302248da1d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:46.976210 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4027f-559d-4d9a-aee0-2302248da1d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:46.982227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 255/499] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 11:41:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:46.983044 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88d553-e0b9-4bce-880f-035c50609145 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:46.983206 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-25a4027f-559d-4d9a-aee0-2302248da1d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:41:46.984499 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 245/500] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:41:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:46.985120 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4027f-559d-4d9a-aee0-2302248da1d6 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:47.075391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88d553-e0b9-4bce-880f-035c50609145 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:47.077863 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4027f-559d-4d9a-aee0-2302248da1d6 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:47.113845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37d9af-2483-4b44-9c83-4e4ffdbbef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:47.114061 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354c1f8-264e-46bf-ba56-59920a9f3381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:47.114648 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37d9af-2483-4b44-9c83-4e4ffdbbef92 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:47.114930 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37d9af-2483-4b44-9c83-4e4ffdbbef92 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:47.115206 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37d9af-2483-4b44-9c83-4e4ffdbbef92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:47.115350 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354c1f8-264e-46bf-ba56-59920a9f3381 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:47.115668 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354c1f8-264e-46bf-ba56-59920a9f3381 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:47.115948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354c1f8-264e-46bf-ba56-59920a9f3381 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:47.116776 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354c1f8-264e-46bf-ba56-59920a9f3381 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:47.117088 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354c1f8-264e-46bf-ba56-59920a9f3381 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:47.118755 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354c1f8-264e-46bf-ba56-59920a9f3381 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:47.125416 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37d9af-2483-4b44-9c83-4e4ffdbbef92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:47.133199 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-ba37d9af-2483-4b44-9c83-4e4ffdbbef92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:41:47.134404 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 246/501] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:41:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:47.135627 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b1530-d9c9-4c0f-a5c2-ea2ff272bd00 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:47.135916 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b1530-d9c9-4c0f-a5c2-ea2ff272bd00 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:47.136196 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b1530-d9c9-4c0f-a5c2-ea2ff272bd00 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:47.138026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 247/502] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:47.138312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 256/503] 10.222.0.52 () {56 vars in 1137 bytes} [Tue Mar 8 11:41:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:47.139389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354c1f8-264e-46bf-ba56-59920a9f3381 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:47.140745 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b1530-d9c9-4c0f-a5c2-ea2ff272bd00 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:47.234093 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354c1f8-264e-46bf-ba56-59920a9f3381 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:47.236339 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b1530-d9c9-4c0f-a5c2-ea2ff272bd00 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:47.266102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a08bd-2b8c-4c5a-9fe8-1b2fef5f5699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:47.266745 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a08bd-2b8c-4c5a-9fe8-1b2fef5f5699 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:47.267027 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a08bd-2b8c-4c5a-9fe8-1b2fef5f5699 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:47.267306 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a08bd-2b8c-4c5a-9fe8-1b2fef5f5699 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:47.267786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecea57-23d2-4866-9fad-053e25b5a95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:47.268447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecea57-23d2-4866-9fad-053e25b5a95b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:47.268724 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecea57-23d2-4866-9fad-053e25b5a95b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:47.269617 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecea57-23d2-4866-9fad-053e25b5a95b None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:47.270347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecea57-23d2-4866-9fad-053e25b5a95b None admin] RBAC: Adding query filter params (name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:47.270650 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecea57-23d2-4866-9fad-053e25b5a95b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:47.272043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecea57-23d2-4866-9fad-053e25b5a95b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:47.279881 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 248/504] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:41:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:47.280659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecea57-23d2-4866-9fad-053e25b5a95b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:47.335412 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a08bd-2b8c-4c5a-9fe8-1b2fef5f5699 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:47.336927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a08bd-2b8c-4c5a-9fe8-1b2fef5f5699 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:47.382563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecea57-23d2-4866-9fad-053e25b5a95b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:47.424961 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd284ef-b583-41c3-b9e0-3717f3299a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:47.425687 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd284ef-b583-41c3-b9e0-3717f3299a89 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:47.425971 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd284ef-b583-41c3-b9e0-3717f3299a89 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:47.426251 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd284ef-b583-41c3-b9e0-3717f3299a89 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:47.428730 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd284ef-b583-41c3-b9e0-3717f3299a89 None admin] RBAC: Adding query filter params (name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:47.429062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd284ef-b583-41c3-b9e0-3717f3299a89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:47.430457 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd284ef-b583-41c3-b9e0-3717f3299a89 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:47.432520 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 257/505] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:47.433374 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a08bd-2b8c-4c5a-9fe8-1b2fef5f5699 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:47.443911 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 249/506] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:41:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:47.445198 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4724d-334a-4313-9886-8f0e435cd9f0 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:47.445501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4724d-334a-4313-9886-8f0e435cd9f0 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:47.445758 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4724d-334a-4313-9886-8f0e435cd9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:47.462441 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-15b4724d-334a-4313-9886-8f0e435cd9f0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:47.463661 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-15b4724d-334a-4313-9886-8f0e435cd9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:47.527047 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 250/507] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:47.527892 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4724d-334a-4313-9886-8f0e435cd9f0 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:47.527995 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a08bd-2b8c-4c5a-9fe8-1b2fef5f5699 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:47.560017 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62f27b-beb7-488d-b90f-3ec82df60bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:47.560663 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62f27b-beb7-488d-b90f-3ec82df60bb2 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:47.560943 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62f27b-beb7-488d-b90f-3ec82df60bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:47.561215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62f27b-beb7-488d-b90f-3ec82df60bb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:47.627251 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62f27b-beb7-488d-b90f-3ec82df60bb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:47.629738 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62f27b-beb7-488d-b90f-3ec82df60bb2 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:47.633280 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4724d-334a-4313-9886-8f0e435cd9f0 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:47.665429 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda85b6b-910a-45cd-a29e-bad5c4a12c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:47.666232 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda85b6b-910a-45cd-a29e-bad5c4a12c8b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:47.666511 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda85b6b-910a-45cd-a29e-bad5c4a12c8b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:47.666785 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda85b6b-910a-45cd-a29e-bad5c4a12c8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:47.676884 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda85b6b-910a-45cd-a29e-bad5c4a12c8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:47.678333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda85b6b-910a-45cd-a29e-bad5c4a12c8b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:47.695230 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-fda85b6b-910a-45cd-a29e-bad5c4a12c8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:47.696533 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 251/508] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:47.697132 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda85b6b-910a-45cd-a29e-bad5c4a12c8b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:47.721322 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 258/509] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:47.722170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62f27b-beb7-488d-b90f-3ec82df60bb2 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:47.792840 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda85b6b-910a-45cd-a29e-bad5c4a12c8b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:47.814677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62f27b-beb7-488d-b90f-3ec82df60bb2 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:47.825336 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b0297-f980-41af-8bd7-cc5729b0cf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:47.826118 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b0297-f980-41af-8bd7-cc5729b0cf09 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:47.826396 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b0297-f980-41af-8bd7-cc5729b0cf09 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:47.826665 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b0297-f980-41af-8bd7-cc5729b0cf09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:47.836422 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b0297-f980-41af-8bd7-cc5729b0cf09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:47.837887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b0297-f980-41af-8bd7-cc5729b0cf09 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:47.846729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352ce0c-c411-4570-b745-c8df6b717fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:47.847746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352ce0c-c411-4570-b745-c8df6b717fbf None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:47.848025 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352ce0c-c411-4570-b745-c8df6b717fbf None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:47.848339 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352ce0c-c411-4570-b745-c8df6b717fbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:47.854227 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-138b0297-f980-41af-8bd7-cc5729b0cf09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:47.855567 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 252/510] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:47.856265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b0297-f980-41af-8bd7-cc5729b0cf09 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:47.857972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352ce0c-c411-4570-b745-c8df6b717fbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:47.859465 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352ce0c-c411-4570-b745-c8df6b717fbf None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:47.876324 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-d352ce0c-c411-4570-b745-c8df6b717fbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:47.877669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 259/511] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:47.878911 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352ce0c-c411-4570-b745-c8df6b717fbf None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:47.950698 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b0297-f980-41af-8bd7-cc5729b0cf09 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:47.969912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352ce0c-c411-4570-b745-c8df6b717fbf None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:47.982291 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be83ba-ac06-4785-92d8-64a91aa6079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:47.983071 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be83ba-ac06-4785-92d8-64a91aa6079e None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:47.983345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be83ba-ac06-4785-92d8-64a91aa6079e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:47.983644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be83ba-ac06-4785-92d8-64a91aa6079e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:47.993775 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be83ba-ac06-4785-92d8-64a91aa6079e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:47.995236 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be83ba-ac06-4785-92d8-64a91aa6079e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:48.001853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393ac2d-8585-4171-9fbb-33b278e7035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:48.002500 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393ac2d-8585-4171-9fbb-33b278e7035f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:48.002782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393ac2d-8585-4171-9fbb-33b278e7035f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:48.003060 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393ac2d-8585-4171-9fbb-33b278e7035f None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:48.003933 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393ac2d-8585-4171-9fbb-33b278e7035f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:48.004245 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393ac2d-8585-4171-9fbb-33b278e7035f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:48.005621 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393ac2d-8585-4171-9fbb-33b278e7035f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:48.012399 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-79be83ba-ac06-4785-92d8-64a91aa6079e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:48.013551 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 253/512] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:48.014310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be83ba-ac06-4785-92d8-64a91aa6079e None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:48.016821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 260/513] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:48.017612 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393ac2d-8585-4171-9fbb-33b278e7035f None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:48.109609 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be83ba-ac06-4785-92d8-64a91aa6079e None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:48.110370 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393ac2d-8585-4171-9fbb-33b278e7035f None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:48.141646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c969a-19b5-45fb-8c9d-5a611d6bd71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:48.142177 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888527e-b5bf-4c4d-b165-f035ced12563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:48.142312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c969a-19b5-45fb-8c9d-5a611d6bd71a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:48.142558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c969a-19b5-45fb-8c9d-5a611d6bd71a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:48.142832 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c969a-19b5-45fb-8c9d-5a611d6bd71a None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:48.142960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888527e-b5bf-4c4d-b165-f035ced12563 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:48.143246 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888527e-b5bf-4c4d-b165-f035ced12563 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:48.143544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888527e-b5bf-4c4d-b165-f035ced12563 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:48.143644 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c969a-19b5-45fb-8c9d-5a611d6bd71a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:48.143884 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c969a-19b5-45fb-8c9d-5a611d6bd71a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:48.145260 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c969a-19b5-45fb-8c9d-5a611d6bd71a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:48.153615 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888527e-b5bf-4c4d-b165-f035ced12563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:48.155048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888527e-b5bf-4c4d-b165-f035ced12563 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:48.155996 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 261/514] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:48.156856 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c969a-19b5-45fb-8c9d-5a611d6bd71a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:48.172992 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-b888527e-b5bf-4c4d-b165-f035ced12563 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:48.174165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 254/515] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:48.174934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888527e-b5bf-4c4d-b165-f035ced12563 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:48.252567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c969a-19b5-45fb-8c9d-5a611d6bd71a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:48.267660 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888527e-b5bf-4c4d-b165-f035ced12563 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:48.285887 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813da29f-1592-403d-91aa-5d48efe5b84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:48.286550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813da29f-1592-403d-91aa-5d48efe5b84a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:48.286831 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813da29f-1592-403d-91aa-5d48efe5b84a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:48.287105 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813da29f-1592-403d-91aa-5d48efe5b84a None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:48.287851 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813da29f-1592-403d-91aa-5d48efe5b84a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:48.288164 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813da29f-1592-403d-91aa-5d48efe5b84a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:48.289539 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813da29f-1592-403d-91aa-5d48efe5b84a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:48.300486 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189cebd-37f3-4f0b-9272-d9ac53816488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:48.301149 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189cebd-37f3-4f0b-9272-d9ac53816488 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:48.301273 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 262/516] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:48.301465 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189cebd-37f3-4f0b-9272-d9ac53816488 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:48.301694 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189cebd-37f3-4f0b-9272-d9ac53816488 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:48.302411 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189cebd-37f3-4f0b-9272-d9ac53816488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:48.302718 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189cebd-37f3-4f0b-9272-d9ac53816488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:48.304132 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189cebd-37f3-4f0b-9272-d9ac53816488 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:48.304398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813da29f-1592-403d-91aa-5d48efe5b84a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:48.319799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 255/517] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:48.319799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189cebd-37f3-4f0b-9272-d9ac53816488 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:48.397107 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813da29f-1592-403d-91aa-5d48efe5b84a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:48.413635 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189cebd-37f3-4f0b-9272-d9ac53816488 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:48.429781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c04563-33a9-4b5b-94a5-c31d14916cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:48.430575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c04563-33a9-4b5b-94a5-c31d14916cde None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:48.430858 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c04563-33a9-4b5b-94a5-c31d14916cde None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:48.431135 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c04563-33a9-4b5b-94a5-c31d14916cde None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:48.437979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c04563-33a9-4b5b-94a5-c31d14916cde None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:48.439421 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c04563-33a9-4b5b-94a5-c31d14916cde None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:48.445350 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a001b2e-3ea9-4eeb-ab7f-7fb19a4f4493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:48.446131 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a001b2e-3ea9-4eeb-ab7f-7fb19a4f4493 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:48.446410 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a001b2e-3ea9-4eeb-ab7f-7fb19a4f4493 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:48.446684 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a001b2e-3ea9-4eeb-ab7f-7fb19a4f4493 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:48.453039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a001b2e-3ea9-4eeb-ab7f-7fb19a4f4493 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:48.453382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-00c04563-33a9-4b5b-94a5-c31d14916cde None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 08 11:41:48.454462 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a001b2e-3ea9-4eeb-ab7f-7fb19a4f4493 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:48.454549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 263/518] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:41:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:48.455309 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c04563-33a9-4b5b-94a5-c31d14916cde None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:48.468349 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-7a001b2e-3ea9-4eeb-ab7f-7fb19a4f4493 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:41:48.469515 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 256/519] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:48.470268 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a001b2e-3ea9-4eeb-ab7f-7fb19a4f4493 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:48.551820 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c04563-33a9-4b5b-94a5-c31d14916cde None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:48.563229 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a001b2e-3ea9-4eeb-ab7f-7fb19a4f4493 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:48.584191 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca408c-d4dd-4311-933a-aad6cd215a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:48.584851 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca408c-d4dd-4311-933a-aad6cd215a5b None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:48.585138 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca408c-d4dd-4311-933a-aad6cd215a5b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:48.585400 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca408c-d4dd-4311-933a-aad6cd215a5b None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:48.586112 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca408c-d4dd-4311-933a-aad6cd215a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:48.586416 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca408c-d4dd-4311-933a-aad6cd215a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:48.587867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca408c-d4dd-4311-933a-aad6cd215a5b None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:48.595716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a5984-f934-4a7d-b5ad-7a5f62cf3de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:48.596507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a5984-f934-4a7d-b5ad-7a5f62cf3de3 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:48.596782 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a5984-f934-4a7d-b5ad-7a5f62cf3de3 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:48.597597 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a5984-f934-4a7d-b5ad-7a5f62cf3de3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:48.599793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 264/520] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:48.600561 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca408c-d4dd-4311-933a-aad6cd215a5b None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:48.604805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a5984-f934-4a7d-b5ad-7a5f62cf3de3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:48.606258 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a5984-f934-4a7d-b5ad-7a5f62cf3de3 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:48.619834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-d84a5984-f934-4a7d-b5ad-7a5f62cf3de3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 11:41:48.620996 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 257/521] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:48.621748 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a5984-f934-4a7d-b5ad-7a5f62cf3de3 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:48.692604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca408c-d4dd-4311-933a-aad6cd215a5b None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:48.715213 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a5984-f934-4a7d-b5ad-7a5f62cf3de3 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:48.724931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194362f9-296c-45fd-ae1a-bcebc307a9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:48.725587 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194362f9-296c-45fd-ae1a-bcebc307a9b5 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:48.725870 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194362f9-296c-45fd-ae1a-bcebc307a9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:48.726140 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194362f9-296c-45fd-ae1a-bcebc307a9b5 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:48.726833 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194362f9-296c-45fd-ae1a-bcebc307a9b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:48.728315 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194362f9-296c-45fd-ae1a-bcebc307a9b5 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:48.746541 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b39e8c-500b-4920-9416-a960bc2d4cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:48.747204 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39e8c-500b-4920-9416-a960bc2d4cfa None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:48.747486 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39e8c-500b-4920-9416-a960bc2d4cfa None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:48.747801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39e8c-500b-4920-9416-a960bc2d4cfa None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:48.748624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b39e8c-500b-4920-9416-a960bc2d4cfa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:48.748933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b39e8c-500b-4920-9416-a960bc2d4cfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:48.750362 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b39e8c-500b-4920-9416-a960bc2d4cfa None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:48.787232 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 258/522] 10.222.0.52 () {56 vars in 1139 bytes} [Tue Mar 8 11:41:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:48.793675 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b39e8c-500b-4920-9416-a960bc2d4cfa None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:48.818617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 265/523] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:41:48 2022] POST /identity/v3/users => generated 247 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:41:48.819371 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194362f9-296c-45fd-ae1a-bcebc307a9b5 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:48.890135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b39e8c-500b-4920-9416-a960bc2d4cfa None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:48.928612 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374fc20-0611-4951-8abd-d5423ced7784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:48.929296 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374fc20-0611-4951-8abd-d5423ced7784 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:48.929862 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374fc20-0611-4951-8abd-d5423ced7784 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:48.930140 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374fc20-0611-4951-8abd-d5423ced7784 None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:48.930934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374fc20-0611-4951-8abd-d5423ced7784 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:48.931247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374fc20-0611-4951-8abd-d5423ced7784 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:48.932766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374fc20-0611-4951-8abd-d5423ced7784 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:48.939291 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194362f9-296c-45fd-ae1a-bcebc307a9b5 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:48.957754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 259/524] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:41:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:48.957754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374fc20-0611-4951-8abd-d5423ced7784 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:48.993094 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3ada1-5d6f-4ac1-87f2-bb166e114266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:48.994305 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3ada1-5d6f-4ac1-87f2-bb166e114266 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:48.994763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3ada1-5d6f-4ac1-87f2-bb166e114266 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:48.995209 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3ada1-5d6f-4ac1-87f2-bb166e114266 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:49.006410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3ada1-5d6f-4ac1-87f2-bb166e114266 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:49.008390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3ada1-5d6f-4ac1-87f2-bb166e114266 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:49.026205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-ccf3ada1-5d6f-4ac1-87f2-bb166e114266 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:41:49.027735 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 266/525] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:49.028534 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3ada1-5d6f-4ac1-87f2-bb166e114266 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:49.082955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374fc20-0611-4951-8abd-d5423ced7784 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:49.116703 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570f892-6c72-4a7e-857f-2f7fbe732654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:49.117413 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570f892-6c72-4a7e-857f-2f7fbe732654 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:49.117675 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570f892-6c72-4a7e-857f-2f7fbe732654 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:49.117955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570f892-6c72-4a7e-857f-2f7fbe732654 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:49.118801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570f892-6c72-4a7e-857f-2f7fbe732654 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:49.119116 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570f892-6c72-4a7e-857f-2f7fbe732654 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:49.120615 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570f892-6c72-4a7e-857f-2f7fbe732654 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:49.131765 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3ada1-5d6f-4ac1-87f2-bb166e114266 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:49.142708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 260/526] 10.222.0.52 () {56 vars in 1137 bytes} [Tue Mar 8 11:41:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:49.142708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570f892-6c72-4a7e-857f-2f7fbe732654 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:49.168700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fc39e-8973-4742-b58c-dee2544d6569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:49.169352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc39e-8973-4742-b58c-dee2544d6569 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:49.169633 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc39e-8973-4742-b58c-dee2544d6569 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:49.169910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc39e-8973-4742-b58c-dee2544d6569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:49.237164 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fc39e-8973-4742-b58c-dee2544d6569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:49.239565 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fc39e-8973-4742-b58c-dee2544d6569 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:49.240745 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570f892-6c72-4a7e-857f-2f7fbe732654 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:49.273140 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc1878-51d4-40f9-b0ef-3a0322aa677e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:49.273802 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc1878-51d4-40f9-b0ef-3a0322aa677e None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:49.274085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc1878-51d4-40f9-b0ef-3a0322aa677e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:49.274362 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc1878-51d4-40f9-b0ef-3a0322aa677e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:49.275184 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc1878-51d4-40f9-b0ef-3a0322aa677e None admin] RBAC: Adding query filter params (role.id=b34db25ec52b41a7bb7691d839e68c53, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=534fd902f96043068e99ca0537cf57c5) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:49.275498 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc1878-51d4-40f9-b0ef-3a0322aa677e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:49.277227 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc1878-51d4-40f9-b0ef-3a0322aa677e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:49.287558 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 261/527] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:49 2022] GET /identity/v3/role_assignments?user.id=534fd902f96043068e99ca0537cf57c5&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=b34db25ec52b41a7bb7691d839e68c53 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:49.287558 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc1878-51d4-40f9-b0ef-3a0322aa677e None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:49.343972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 267/528] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:49.344840 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fc39e-8973-4742-b58c-dee2544d6569 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:49.397581 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc1878-51d4-40f9-b0ef-3a0322aa677e None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:49.434299 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632924b-d939-4f2b-a690-7f71bd731a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:49.435127 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632924b-d939-4f2b-a690-7f71bd731a75 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:49.435507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632924b-d939-4f2b-a690-7f71bd731a75 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:49.436812 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632924b-d939-4f2b-a690-7f71bd731a75 None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:49.439312 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632924b-d939-4f2b-a690-7f71bd731a75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:49.439312 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632924b-d939-4f2b-a690-7f71bd731a75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:49.441703 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632924b-d939-4f2b-a690-7f71bd731a75 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:49.447547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fc39e-8973-4742-b58c-dee2544d6569 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:49.453760 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 262/529] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:41:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:49.454757 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632924b-d939-4f2b-a690-7f71bd731a75 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:49.482680 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796e6be-a454-40be-8b19-ddbe7524565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:49.483341 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796e6be-a454-40be-8b19-ddbe7524565e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:49.483665 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796e6be-a454-40be-8b19-ddbe7524565e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:49.483941 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796e6be-a454-40be-8b19-ddbe7524565e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:49.559793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796e6be-a454-40be-8b19-ddbe7524565e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:49.561611 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796e6be-a454-40be-8b19-ddbe7524565e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:49.571373 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632924b-d939-4f2b-a690-7f71bd731a75 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:49.613164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca482ac-4905-43b9-a0c0-651aee07a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:49.614836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca482ac-4905-43b9-a0c0-651aee07a984 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:49.615265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca482ac-4905-43b9-a0c0-651aee07a984 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:49.615854 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca482ac-4905-43b9-a0c0-651aee07a984 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:49.630682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca482ac-4905-43b9-a0c0-651aee07a984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:49.633171 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca482ac-4905-43b9-a0c0-651aee07a984 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:49.656454 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-4ca482ac-4905-43b9-a0c0-651aee07a984 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:49.658059 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 263/530] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:49.658997 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca482ac-4905-43b9-a0c0-651aee07a984 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:49.673278 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 268/531] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:49.674273 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796e6be-a454-40be-8b19-ddbe7524565e None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:49.768041 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca482ac-4905-43b9-a0c0-651aee07a984 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:49.793627 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796e6be-a454-40be-8b19-ddbe7524565e None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:49.803336 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957cb29-23b1-4c4d-bb99-d14fe52f5fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:49.804246 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957cb29-23b1-4c4d-bb99-d14fe52f5fa0 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:49.804677 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957cb29-23b1-4c4d-bb99-d14fe52f5fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:49.805098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957cb29-23b1-4c4d-bb99-d14fe52f5fa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:49.806051 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957cb29-23b1-4c4d-bb99-d14fe52f5fa0 None admin] RBAC: Adding query filter params (role.id=b34db25ec52b41a7bb7691d839e68c53, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=b65583446d2e40a69dff534b73e8fa7a) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:49.806525 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957cb29-23b1-4c4d-bb99-d14fe52f5fa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:49.808138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957cb29-23b1-4c4d-bb99-d14fe52f5fa0 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:49.813600 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 264/532] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:49 2022] GET /identity/v3/role_assignments?user.id=b65583446d2e40a69dff534b73e8fa7a&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=b34db25ec52b41a7bb7691d839e68c53 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:49.814526 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957cb29-23b1-4c4d-bb99-d14fe52f5fa0 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:49.849610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c33cb-0afe-4e34-9731-b7a844efae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:49.850921 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c33cb-0afe-4e34-9731-b7a844efae16 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:49.851506 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c33cb-0afe-4e34-9731-b7a844efae16 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:49.851942 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c33cb-0afe-4e34-9731-b7a844efae16 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:49.852767 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c33cb-0afe-4e34-9731-b7a844efae16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:49.853176 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c33cb-0afe-4e34-9731-b7a844efae16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:49.854677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c33cb-0afe-4e34-9731-b7a844efae16 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:49.880781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 269/533] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:49.885718 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c33cb-0afe-4e34-9731-b7a844efae16 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:49.937364 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957cb29-23b1-4c4d-bb99-d14fe52f5fa0 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:49.984912 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541097-1675-48ef-8eea-37a6e7a8bd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:49.986044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541097-1675-48ef-8eea-37a6e7a8bd4e None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:49.986482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541097-1675-48ef-8eea-37a6e7a8bd4e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:49.986904 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541097-1675-48ef-8eea-37a6e7a8bd4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:50.010310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce541097-1675-48ef-8eea-37a6e7a8bd4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:50.012085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce541097-1675-48ef-8eea-37a6e7a8bd4e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:50.031600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c33cb-0afe-4e34-9731-b7a844efae16 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:50.043052 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-ce541097-1675-48ef-8eea-37a6e7a8bd4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:50.044737 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 265/534] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:50.050254 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541097-1675-48ef-8eea-37a6e7a8bd4e None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:50.073153 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c0d55-8a74-45af-af5d-efe5634b782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:50.073970 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c0d55-8a74-45af-af5d-efe5634b782a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:50.074313 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c0d55-8a74-45af-af5d-efe5634b782a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:50.074587 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c0d55-8a74-45af-af5d-efe5634b782a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:50.086908 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c0d55-8a74-45af-af5d-efe5634b782a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:50.088428 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c0d55-8a74-45af-af5d-efe5634b782a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:50.111885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-5f6c0d55-8a74-45af-af5d-efe5634b782a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:41:50.113704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 270/535] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:50.124545 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c0d55-8a74-45af-af5d-efe5634b782a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:50.214276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541097-1675-48ef-8eea-37a6e7a8bd4e None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:50.257637 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09802e-fa6c-485d-8d31-ee4bc4918534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:50.258313 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09802e-fa6c-485d-8d31-ee4bc4918534 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:50.258595 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09802e-fa6c-485d-8d31-ee4bc4918534 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:50.258872 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09802e-fa6c-485d-8d31-ee4bc4918534 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:50.259617 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09802e-fa6c-485d-8d31-ee4bc4918534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:50.259929 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09802e-fa6c-485d-8d31-ee4bc4918534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:50.261325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09802e-fa6c-485d-8d31-ee4bc4918534 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:50.268176 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c0d55-8a74-45af-af5d-efe5634b782a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:50.283659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 266/536] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:50.289379 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09802e-fa6c-485d-8d31-ee4bc4918534 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:50.303008 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188a315-4589-40ff-8335-0301805360a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:50.303698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188a315-4589-40ff-8335-0301805360a4 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:50.303980 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188a315-4589-40ff-8335-0301805360a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:50.304253 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188a315-4589-40ff-8335-0301805360a4 None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:50.305029 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188a315-4589-40ff-8335-0301805360a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:50.305334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188a315-4589-40ff-8335-0301805360a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:50.306772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188a315-4589-40ff-8335-0301805360a4 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:50.324986 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 271/537] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:41:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:50.330600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188a315-4589-40ff-8335-0301805360a4 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:50.430050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188a315-4589-40ff-8335-0301805360a4 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:50.464378 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33092d1f-2626-4500-9eb1-66e9bd8ec7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:50.464973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33092d1f-2626-4500-9eb1-66e9bd8ec7f2 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:50.465202 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33092d1f-2626-4500-9eb1-66e9bd8ec7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:50.465476 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33092d1f-2626-4500-9eb1-66e9bd8ec7f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:50.466292 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33092d1f-2626-4500-9eb1-66e9bd8ec7f2 None admin] RBAC: Adding query filter params (role.id=b34db25ec52b41a7bb7691d839e68c53, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=a5f8507c0ae342f7a3e97b48363ad606) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:50.466599 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33092d1f-2626-4500-9eb1-66e9bd8ec7f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:50.468075 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33092d1f-2626-4500-9eb1-66e9bd8ec7f2 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:50.474304 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 272/538] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:50 2022] GET /identity/v3/role_assignments?user.id=a5f8507c0ae342f7a3e97b48363ad606&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=b34db25ec52b41a7bb7691d839e68c53 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:50.531351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09802e-fa6c-485d-8d31-ee4bc4918534 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:50.578805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d223cc-9acc-43b4-90f8-2d44ae859b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:50.579656 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d223cc-9acc-43b4-90f8-2d44ae859b90 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:50.579941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d223cc-9acc-43b4-90f8-2d44ae859b90 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:50.580219 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d223cc-9acc-43b4-90f8-2d44ae859b90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:50.587886 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d223cc-9acc-43b4-90f8-2d44ae859b90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:50.589375 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d223cc-9acc-43b4-90f8-2d44ae859b90 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:50.603281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-d6d223cc-9acc-43b4-90f8-2d44ae859b90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:41:50.608836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 267/539] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:50.610865 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33092d1f-2626-4500-9eb1-66e9bd8ec7f2 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:50.724671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33092d1f-2626-4500-9eb1-66e9bd8ec7f2 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:50.768111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c58c6-3566-442d-b51e-3245e5f6b6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:50.768808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c58c6-3566-442d-b51e-3245e5f6b6f0 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:50.769092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c58c6-3566-442d-b51e-3245e5f6b6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:50.769372 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c58c6-3566-442d-b51e-3245e5f6b6f0 None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:50.770153 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c58c6-3566-442d-b51e-3245e5f6b6f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:50.770465 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c58c6-3566-442d-b51e-3245e5f6b6f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:50.771932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c58c6-3566-442d-b51e-3245e5f6b6f0 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:50.789951 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 273/540] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:41:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:50.795778 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d223cc-9acc-43b4-90f8-2d44ae859b90 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:50.919940 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d223cc-9acc-43b4-90f8-2d44ae859b90 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:50.964942 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4c856-ab78-4640-8957-865b67a9da2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:50.965980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4c856-ab78-4640-8957-865b67a9da2b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:50.966463 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4c856-ab78-4640-8957-865b67a9da2b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:50.966933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4c856-ab78-4640-8957-865b67a9da2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:50.967992 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4c856-ab78-4640-8957-865b67a9da2b None admin] RBAC: Adding query filter params (role.id=b34db25ec52b41a7bb7691d839e68c53, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=1c5631271ed54eacbbbbbb5c8d14d764) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:50.968528 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4c856-ab78-4640-8957-865b67a9da2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:50.970164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4c856-ab78-4640-8957-865b67a9da2b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:50.979684 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 268/541] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:50 2022] GET /identity/v3/role_assignments?user.id=1c5631271ed54eacbbbbbb5c8d14d764&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=b34db25ec52b41a7bb7691d839e68c53 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:51.435055 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f639f-80ca-449f-8378-f4645d234ff9 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:51.435755 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f639f-80ca-449f-8378-f4645d234ff9 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:51.436259 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f639f-80ca-449f-8378-f4645d234ff9 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:51.438476 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 274/542] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:51.444605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df214b-5b5b-4674-867e-5354c7df99c3 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:51.445147 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df214b-5b5b-4674-867e-5354c7df99c3 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:51.445630 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df214b-5b5b-4674-867e-5354c7df99c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:51.463688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-71df214b-5b5b-4674-867e-5354c7df99c3 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:51.465207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-71df214b-5b5b-4674-867e-5354c7df99c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:51.543413 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 269/543] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:51.568707 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f639f-80ca-449f-8378-f4645d234ff9 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:51.709620 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f639f-80ca-449f-8378-f4645d234ff9 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:51.752072 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a55c1-cc23-47ee-b7c8-0fff389b0379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:51.754050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a55c1-cc23-47ee-b7c8-0fff389b0379 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:51.754548 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a55c1-cc23-47ee-b7c8-0fff389b0379 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:51.755024 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a55c1-cc23-47ee-b7c8-0fff389b0379 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:51.776820 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a55c1-cc23-47ee-b7c8-0fff389b0379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:51.784400 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-c32a55c1-cc23-47ee-b7c8-0fff389b0379 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:41:51.786171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 275/544] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:41:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:51.792141 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df214b-5b5b-4674-867e-5354c7df99c3 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:51.896468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df214b-5b5b-4674-867e-5354c7df99c3 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:51.931361 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3eafa-3446-4636-a8db-71d88f82878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:51.932469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3eafa-3446-4636-a8db-71d88f82878c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:51.932952 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3eafa-3446-4636-a8db-71d88f82878c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:51.933426 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3eafa-3446-4636-a8db-71d88f82878c None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:51.934387 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3eafa-3446-4636-a8db-71d88f82878c None admin] RBAC: Adding query filter params (name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:51.934891 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3eafa-3446-4636-a8db-71d88f82878c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:51.936514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3eafa-3446-4636-a8db-71d88f82878c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:51.945843 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 270/545] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:41:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:51.951391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a55c1-cc23-47ee-b7c8-0fff389b0379 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:52.024149 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bcc4b-fba9-4e3d-983d-ca6a0c2f1ef7 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:52.024748 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bcc4b-fba9-4e3d-983d-ca6a0c2f1ef7 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:52.025236 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bcc4b-fba9-4e3d-983d-ca6a0c2f1ef7 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:52.027459 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 271/546] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:41:52.035218 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940384e-7f06-4519-be4a-a4c335a86124 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:52.035501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940384e-7f06-4519-be4a-a4c335a86124 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:52.035801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940384e-7f06-4519-be4a-a4c335a86124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:52.062354 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-c940384e-7f06-4519-be4a-a4c335a86124 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:52.063856 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c940384e-7f06-4519-be4a-a4c335a86124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:52.119182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a55c1-cc23-47ee-b7c8-0fff389b0379 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:52.141335 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 272/547] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:52.167062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940384e-7f06-4519-be4a-a4c335a86124 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:52.176109 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6765d-2e75-4df4-83d1-3ac3d9f8ef07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:52.177179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6765d-2e75-4df4-83d1-3ac3d9f8ef07 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:52.177655 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6765d-2e75-4df4-83d1-3ac3d9f8ef07 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:52.178135 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6765d-2e75-4df4-83d1-3ac3d9f8ef07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:52.202496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6765d-2e75-4df4-83d1-3ac3d9f8ef07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:52.204234 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6765d-2e75-4df4-83d1-3ac3d9f8ef07 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:52.232659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-5eb6765d-2e75-4df4-83d1-3ac3d9f8ef07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:52.234491 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 276/548] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:52.247856 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6765d-2e75-4df4-83d1-3ac3d9f8ef07 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:52.283892 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940384e-7f06-4519-be4a-a4c335a86124 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:52.321924 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b354f7-8f58-460a-8449-d96965c94b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:52.321924 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b354f7-8f58-460a-8449-d96965c94b56 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:52.321924 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b354f7-8f58-460a-8449-d96965c94b56 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:52.321924 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b354f7-8f58-460a-8449-d96965c94b56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:52.331847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b354f7-8f58-460a-8449-d96965c94b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:52.339694 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-51b354f7-8f58-460a-8449-d96965c94b56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:41:52.340260 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 273/549] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:41:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:52.347589 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b354f7-8f58-460a-8449-d96965c94b56 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:52.429225 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6765d-2e75-4df4-83d1-3ac3d9f8ef07 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:52.456556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b354f7-8f58-460a-8449-d96965c94b56 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:52.494434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38cae3-effc-4d29-8e3b-1465927e2b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:52.495246 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38cae3-effc-4d29-8e3b-1465927e2b94 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:52.495549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38cae3-effc-4d29-8e3b-1465927e2b94 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:52.495841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38cae3-effc-4d29-8e3b-1465927e2b94 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:52.496591 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38cae3-effc-4d29-8e3b-1465927e2b94 None admin] RBAC: Adding query filter params (name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:52.496905 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38cae3-effc-4d29-8e3b-1465927e2b94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:52.498731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38cae3-effc-4d29-8e3b-1465927e2b94 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:52.508128 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 274/550] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:41:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:52.513580 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38cae3-effc-4d29-8e3b-1465927e2b94 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:52.515031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb1573-015f-46e8-b03c-1ab1e77723e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:52.516052 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb1573-015f-46e8-b03c-1ab1e77723e1 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:52.516528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb1573-015f-46e8-b03c-1ab1e77723e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:52.516993 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb1573-015f-46e8-b03c-1ab1e77723e1 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:52.517905 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb1573-015f-46e8-b03c-1ab1e77723e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:52.518418 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb1573-015f-46e8-b03c-1ab1e77723e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:52.524211 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb1573-015f-46e8-b03c-1ab1e77723e1 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:52.550581 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 277/551] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:52.568207 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb1573-015f-46e8-b03c-1ab1e77723e1 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:52.630331 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38cae3-effc-4d29-8e3b-1465927e2b94 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:52.670794 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a71962-f823-491d-953d-fcc4c57d4088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:52.671609 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a71962-f823-491d-953d-fcc4c57d4088 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:52.671893 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a71962-f823-491d-953d-fcc4c57d4088 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:52.672190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a71962-f823-491d-953d-fcc4c57d4088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:52.686769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a71962-f823-491d-953d-fcc4c57d4088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:52.688443 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a71962-f823-491d-953d-fcc4c57d4088 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:52.707725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-26a71962-f823-491d-953d-fcc4c57d4088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:52.709471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 275/552] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:52.715356 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a71962-f823-491d-953d-fcc4c57d4088 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:52.773164 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb1573-015f-46e8-b03c-1ab1e77723e1 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:52.818346 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5f15f-a10c-4134-9f16-26fc6ef54038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:52.819082 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5f15f-a10c-4134-9f16-26fc6ef54038 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:52.819370 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5f15f-a10c-4134-9f16-26fc6ef54038 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:52.819683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5f15f-a10c-4134-9f16-26fc6ef54038 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:52.833864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5f15f-a10c-4134-9f16-26fc6ef54038 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:52.835344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5f15f-a10c-4134-9f16-26fc6ef54038 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:52.856076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-ddb5f15f-a10c-4134-9f16-26fc6ef54038 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 11:41:52.857648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 278/553] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:41:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:52.863768 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5f15f-a10c-4134-9f16-26fc6ef54038 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:52.947824 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a71962-f823-491d-953d-fcc4c57d4088 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:53.011696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b21a7-b6f3-433d-a741-98dc0175c517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:53.012716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b21a7-b6f3-433d-a741-98dc0175c517 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:53.013191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b21a7-b6f3-433d-a741-98dc0175c517 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:53.013659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b21a7-b6f3-433d-a741-98dc0175c517 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:53.014566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b21a7-b6f3-433d-a741-98dc0175c517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:53.015089 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b21a7-b6f3-433d-a741-98dc0175c517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:53.016179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5f15f-a10c-4134-9f16-26fc6ef54038 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:53.016909 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b21a7-b6f3-433d-a741-98dc0175c517 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:53.030004 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 276/554] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:53.035784 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734cf65-3d1c-48b5-a5af-adbf5d407c23 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:53.036354 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734cf65-3d1c-48b5-a5af-adbf5d407c23 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:53.036833 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734cf65-3d1c-48b5-a5af-adbf5d407c23 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:53.039079 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 277/555] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:53.040080 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734cf65-3d1c-48b5-a5af-adbf5d407c23 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:53.055995 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d5603-ea89-41a0-b2dc-a47e59b19427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:53.056818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d5603-ea89-41a0-b2dc-a47e59b19427 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:53.057211 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d5603-ea89-41a0-b2dc-a47e59b19427 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:53.057548 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d5603-ea89-41a0-b2dc-a47e59b19427 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:53.058386 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d5603-ea89-41a0-b2dc-a47e59b19427 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:53.058854 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d5603-ea89-41a0-b2dc-a47e59b19427 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:53.060623 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d5603-ea89-41a0-b2dc-a47e59b19427 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:53.084312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 279/556] 10.222.0.52 () {56 vars in 1135 bytes} [Tue Mar 8 11:41:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:53.088039 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72946baf-8aee-4801-afd5-85f230d70e32 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:53.088524 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72946baf-8aee-4801-afd5-85f230d70e32 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:53.088991 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72946baf-8aee-4801-afd5-85f230d70e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:53.111743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-72946baf-8aee-4801-afd5-85f230d70e32 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:53.113730 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-72946baf-8aee-4801-afd5-85f230d70e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:53.149777 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734cf65-3d1c-48b5-a5af-adbf5d407c23 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:53.184390 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3d77f-8d91-4b12-a8b5-29c082594050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:53.185183 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3d77f-8d91-4b12-a8b5-29c082594050 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:53.185467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3d77f-8d91-4b12-a8b5-29c082594050 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:53.185739 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3d77f-8d91-4b12-a8b5-29c082594050 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:53.191147 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 280/557] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:53.192212 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72946baf-8aee-4801-afd5-85f230d70e32 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:53.200755 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3d77f-8d91-4b12-a8b5-29c082594050 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:53.208637 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3d77f-8d91-4b12-a8b5-29c082594050 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:53.225615 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-62e3d77f-8d91-4b12-a8b5-29c082594050 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 11:41:53.226848 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 278/558] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 11:41:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:53.228160 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03478fcb-3719-42da-af65-f2439ce95040 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:53.228442 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03478fcb-3719-42da-af65-f2439ce95040 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:53.235055 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03478fcb-3719-42da-af65-f2439ce95040 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:53.235055 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 279/559] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:53.235055 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03478fcb-3719-42da-af65-f2439ce95040 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:53.301857 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72946baf-8aee-4801-afd5-85f230d70e32 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:53.335600 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03478fcb-3719-42da-af65-f2439ce95040 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:53.336029 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06046cca-94ff-4e32-9557-865e8866c61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:53.336674 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06046cca-94ff-4e32-9557-865e8866c61c None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:53.336955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06046cca-94ff-4e32-9557-865e8866c61c None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:53.337233 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06046cca-94ff-4e32-9557-865e8866c61c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:53.370366 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd431b3-a912-4ff8-95db-898137185553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:53.371161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd431b3-a912-4ff8-95db-898137185553 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:53.371468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd431b3-a912-4ff8-95db-898137185553 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:53.371770 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd431b3-a912-4ff8-95db-898137185553 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:53.382188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd431b3-a912-4ff8-95db-898137185553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:53.389144 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-5cd431b3-a912-4ff8-95db-898137185553 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:41:53.390334 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 280/560] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:41:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:53.391091 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd431b3-a912-4ff8-95db-898137185553 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:53.414286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06046cca-94ff-4e32-9557-865e8866c61c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:53.416612 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06046cca-94ff-4e32-9557-865e8866c61c None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:53.486960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd431b3-a912-4ff8-95db-898137185553 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:53.518864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 281/561] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:41:53.520467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f35291-5d1a-4d56-bdce-05451bc0adea None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:53.520751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f35291-5d1a-4d56-bdce-05451bc0adea None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:53.521020 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f35291-5d1a-4d56-bdce-05451bc0adea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:53.522137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b068df1-5a51-4d6f-b09b-45700c744fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:53.522815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b068df1-5a51-4d6f-b09b-45700c744fe3 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:53.523101 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b068df1-5a51-4d6f-b09b-45700c744fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:53.523378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b068df1-5a51-4d6f-b09b-45700c744fe3 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:53.524246 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b068df1-5a51-4d6f-b09b-45700c744fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:53.524562 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b068df1-5a51-4d6f-b09b-45700c744fe3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:53.526268 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b068df1-5a51-4d6f-b09b-45700c744fe3 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:53.539864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-84f35291-5d1a-4d56-bdce-05451bc0adea None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:53.541105 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-84f35291-5d1a-4d56-bdce-05451bc0adea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:53.544879 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 281/562] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 11:41:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:53.545708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b068df1-5a51-4d6f-b09b-45700c744fe3 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:53.609943 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 282/563] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:53.611130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f35291-5d1a-4d56-bdce-05451bc0adea None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:53.652710 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b068df1-5a51-4d6f-b09b-45700c744fe3 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:53.687106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0edc6-79c1-42d2-8fc6-4af13b26672a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:53.687814 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0edc6-79c1-42d2-8fc6-4af13b26672a None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:53.688095 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0edc6-79c1-42d2-8fc6-4af13b26672a None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:53.688365 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0edc6-79c1-42d2-8fc6-4af13b26672a None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:53.689104 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0edc6-79c1-42d2-8fc6-4af13b26672a None admin] RBAC: Adding query filter params (name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:53.689406 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0edc6-79c1-42d2-8fc6-4af13b26672a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:53.690883 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0edc6-79c1-42d2-8fc6-4af13b26672a None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:53.700202 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 282/564] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:41:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:53.701815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0edc6-79c1-42d2-8fc6-4af13b26672a None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:53.728129 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f35291-5d1a-4d56-bdce-05451bc0adea None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:53.763547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28745a5-0e4c-432b-af5a-ef9eaefa61f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:53.764358 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28745a5-0e4c-432b-af5a-ef9eaefa61f4 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:53.764640 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28745a5-0e4c-432b-af5a-ef9eaefa61f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:53.764914 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28745a5-0e4c-432b-af5a-ef9eaefa61f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:53.774682 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28745a5-0e4c-432b-af5a-ef9eaefa61f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:53.776492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28745a5-0e4c-432b-af5a-ef9eaefa61f4 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:53.792977 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-a28745a5-0e4c-432b-af5a-ef9eaefa61f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:53.798767 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 283/565] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:53.798767 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28745a5-0e4c-432b-af5a-ef9eaefa61f4 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:53.805904 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0edc6-79c1-42d2-8fc6-4af13b26672a None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:53.839689 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32497e8e-6b97-42a8-a612-a5d0267e098f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:53.840491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32497e8e-6b97-42a8-a612-a5d0267e098f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:53.840772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32497e8e-6b97-42a8-a612-a5d0267e098f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:53.841211 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32497e8e-6b97-42a8-a612-a5d0267e098f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:53.851681 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32497e8e-6b97-42a8-a612-a5d0267e098f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:53.853211 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32497e8e-6b97-42a8-a612-a5d0267e098f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:53.869721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-32497e8e-6b97-42a8-a612-a5d0267e098f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:53.875466 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 283/566] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:53.875466 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32497e8e-6b97-42a8-a612-a5d0267e098f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:53.902584 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28745a5-0e4c-432b-af5a-ef9eaefa61f4 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:53.936399 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efb130-30ed-4ea6-97c0-7c8c167ff9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:53.937191 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efb130-30ed-4ea6-97c0-7c8c167ff9e7 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:53.937465 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efb130-30ed-4ea6-97c0-7c8c167ff9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:53.937735 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efb130-30ed-4ea6-97c0-7c8c167ff9e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:53.947842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efb130-30ed-4ea6-97c0-7c8c167ff9e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:53.954766 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-53efb130-30ed-4ea6-97c0-7c8c167ff9e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:41:53.956768 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 284/567] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:41:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:53.956983 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efb130-30ed-4ea6-97c0-7c8c167ff9e7 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:53.974764 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32497e8e-6b97-42a8-a612-a5d0267e098f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:54.008457 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436aa71a-3305-4f88-b415-6cc807b69adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:54.009253 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436aa71a-3305-4f88-b415-6cc807b69adf None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:54.009544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436aa71a-3305-4f88-b415-6cc807b69adf None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:54.009822 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436aa71a-3305-4f88-b415-6cc807b69adf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:54.021327 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436aa71a-3305-4f88-b415-6cc807b69adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:54.022784 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436aa71a-3305-4f88-b415-6cc807b69adf None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:54.040019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-436aa71a-3305-4f88-b415-6cc807b69adf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:54.041233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 284/568] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:54.042121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436aa71a-3305-4f88-b415-6cc807b69adf None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:54.057817 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efb130-30ed-4ea6-97c0-7c8c167ff9e7 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:54.089496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210514d-4cbc-493c-9225-9e58670dbdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:54.090157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210514d-4cbc-493c-9225-9e58670dbdef None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:54.090436 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210514d-4cbc-493c-9225-9e58670dbdef None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:54.090779 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210514d-4cbc-493c-9225-9e58670dbdef None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:54.091501 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210514d-4cbc-493c-9225-9e58670dbdef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:54.091844 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210514d-4cbc-493c-9225-9e58670dbdef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:54.093215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210514d-4cbc-493c-9225-9e58670dbdef None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:54.105005 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 285/569] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:54.105791 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210514d-4cbc-493c-9225-9e58670dbdef None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:54.137695 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436aa71a-3305-4f88-b415-6cc807b69adf None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:54.169305 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014408a-4e05-4088-99cb-1b26f9a04020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:54.169960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014408a-4e05-4088-99cb-1b26f9a04020 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:54.170241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014408a-4e05-4088-99cb-1b26f9a04020 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:54.170510 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014408a-4e05-4088-99cb-1b26f9a04020 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:54.171216 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014408a-4e05-4088-99cb-1b26f9a04020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:54.171550 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014408a-4e05-4088-99cb-1b26f9a04020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:54.172909 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014408a-4e05-4088-99cb-1b26f9a04020 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:54.184775 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 285/570] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:54.185978 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cda40-6e4c-40e0-ac42-d43bf3560970 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:54.186263 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cda40-6e4c-40e0-ac42-d43bf3560970 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:54.186533 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cda40-6e4c-40e0-ac42-d43bf3560970 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:54.190786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 286/571] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:54.190786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cda40-6e4c-40e0-ac42-d43bf3560970 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:54.209124 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210514d-4cbc-493c-9225-9e58670dbdef None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:54.242481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c13e98-c8c8-419d-96a4-3e2f9ceb3a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:54.243143 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c13e98-c8c8-419d-96a4-3e2f9ceb3a1f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:54.243427 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c13e98-c8c8-419d-96a4-3e2f9ceb3a1f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:54.243732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c13e98-c8c8-419d-96a4-3e2f9ceb3a1f None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:54.244469 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c13e98-c8c8-419d-96a4-3e2f9ceb3a1f None admin] RBAC: Adding query filter params (name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:54.244778 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c13e98-c8c8-419d-96a4-3e2f9ceb3a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:54.246156 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c13e98-c8c8-419d-96a4-3e2f9ceb3a1f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:54.253785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 286/572] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:41:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:54.254563 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c13e98-c8c8-419d-96a4-3e2f9ceb3a1f None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:54.291320 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cda40-6e4c-40e0-ac42-d43bf3560970 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:54.323539 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b4851-8b4f-455d-a9d9-f055c30ae068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:54.324292 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b4851-8b4f-455d-a9d9-f055c30ae068 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:54.324585 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b4851-8b4f-455d-a9d9-f055c30ae068 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:54.324860 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b4851-8b4f-455d-a9d9-f055c30ae068 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:54.325636 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b4851-8b4f-455d-a9d9-f055c30ae068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:54.326047 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b4851-8b4f-455d-a9d9-f055c30ae068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:54.327461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b4851-8b4f-455d-a9d9-f055c30ae068 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:54.338774 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 287/573] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:54.339582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b4851-8b4f-455d-a9d9-f055c30ae068 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:54.348787 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c13e98-c8c8-419d-96a4-3e2f9ceb3a1f None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:54.379643 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920161ee-1006-45af-bbaf-e72c4866aca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:54.380425 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920161ee-1006-45af-bbaf-e72c4866aca6 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:54.380705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920161ee-1006-45af-bbaf-e72c4866aca6 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:54.380980 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920161ee-1006-45af-bbaf-e72c4866aca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:54.387269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920161ee-1006-45af-bbaf-e72c4866aca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:54.388819 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920161ee-1006-45af-bbaf-e72c4866aca6 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:54.402402 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-920161ee-1006-45af-bbaf-e72c4866aca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:41:54.403572 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 287/574] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:54.404713 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecda13-6b50-4676-8759-e0e164b9ca7f None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:54.404997 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecda13-6b50-4676-8759-e0e164b9ca7f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:54.405266 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecda13-6b50-4676-8759-e0e164b9ca7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:54.421449 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-efecda13-6b50-4676-8759-e0e164b9ca7f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:54.422627 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-efecda13-6b50-4676-8759-e0e164b9ca7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:54.436734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b4851-8b4f-455d-a9d9-f055c30ae068 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:54.468022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107040a-7626-406b-9a7c-2d1e61dfe713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:54.468806 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107040a-7626-406b-9a7c-2d1e61dfe713 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:54.469084 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107040a-7626-406b-9a7c-2d1e61dfe713 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:54.469358 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107040a-7626-406b-9a7c-2d1e61dfe713 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:54.476575 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107040a-7626-406b-9a7c-2d1e61dfe713 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:54.478034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107040a-7626-406b-9a7c-2d1e61dfe713 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:54.484275 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 288/575] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:54.484928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecda13-6b50-4676-8759-e0e164b9ca7f None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:54.491179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-d107040a-7626-406b-9a7c-2d1e61dfe713 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:41:54.496869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 288/576] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:54.496869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107040a-7626-406b-9a7c-2d1e61dfe713 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:54.575667 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecda13-6b50-4676-8759-e0e164b9ca7f None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:54.590160 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107040a-7626-406b-9a7c-2d1e61dfe713 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:54.607353 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c3360-e086-4c76-bc72-9378a50c68e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:54.608150 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c3360-e086-4c76-bc72-9378a50c68e8 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:54.608425 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c3360-e086-4c76-bc72-9378a50c68e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:54.608694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c3360-e086-4c76-bc72-9378a50c68e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:54.618073 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c3360-e086-4c76-bc72-9378a50c68e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:54.619537 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c3360-e086-4c76-bc72-9378a50c68e8 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:54.622148 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa76246-b856-4c3b-84fb-9384c6e3e8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:54.622932 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa76246-b856-4c3b-84fb-9384c6e3e8d2 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:54.623208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa76246-b856-4c3b-84fb-9384c6e3e8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:54.623481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa76246-b856-4c3b-84fb-9384c6e3e8d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:54.631027 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa76246-b856-4c3b-84fb-9384c6e3e8d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:54.632473 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa76246-b856-4c3b-84fb-9384c6e3e8d2 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:54.636039 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-b42c3360-e086-4c76-bc72-9378a50c68e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:54.637206 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 289/577] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:54.637968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c3360-e086-4c76-bc72-9378a50c68e8 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:54.646783 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-ffa76246-b856-4c3b-84fb-9384c6e3e8d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 08 11:41:54.647954 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 289/578] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:41:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:54.648898 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa76246-b856-4c3b-84fb-9384c6e3e8d2 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:54.730752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c3360-e086-4c76-bc72-9378a50c68e8 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:54.746024 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa76246-b856-4c3b-84fb-9384c6e3e8d2 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:54.761967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7d19b-7014-4646-a60f-4d889efbb506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:54.762624 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7d19b-7014-4646-a60f-4d889efbb506 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:54.762905 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7d19b-7014-4646-a60f-4d889efbb506 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:54.763182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7d19b-7014-4646-a60f-4d889efbb506 None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:54.763988 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7d19b-7014-4646-a60f-4d889efbb506 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:54.764299 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7d19b-7014-4646-a60f-4d889efbb506 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:54.765753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7d19b-7014-4646-a60f-4d889efbb506 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:54.778021 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 290/579] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:41:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:54.778801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7d19b-7014-4646-a60f-4d889efbb506 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:54.779416 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c50b7-ad0b-4945-859e-315d0df51419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:54.780123 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c50b7-ad0b-4945-859e-315d0df51419 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:54.780407 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c50b7-ad0b-4945-859e-315d0df51419 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:54.780681 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c50b7-ad0b-4945-859e-315d0df51419 None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:54.781457 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c50b7-ad0b-4945-859e-315d0df51419 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:54.781767 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c50b7-ad0b-4945-859e-315d0df51419 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:54.783395 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c50b7-ad0b-4945-859e-315d0df51419 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:54.794696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 290/580] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:41:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:54.795482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c50b7-ad0b-4945-859e-315d0df51419 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:54.878448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7d19b-7014-4646-a60f-4d889efbb506 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:54.893115 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c50b7-ad0b-4945-859e-315d0df51419 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:54.910395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea181b02-0d4d-41ef-9969-e25d87128257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:54.911127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea181b02-0d4d-41ef-9969-e25d87128257 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:54.911433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea181b02-0d4d-41ef-9969-e25d87128257 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:54.911736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea181b02-0d4d-41ef-9969-e25d87128257 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:54.921253 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea181b02-0d4d-41ef-9969-e25d87128257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:54.925142 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4c6b4-cd8f-4a7f-998a-1361a5b612a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:54.925710 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4c6b4-cd8f-4a7f-998a-1361a5b612a4 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:54.925995 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4c6b4-cd8f-4a7f-998a-1361a5b612a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:54.926273 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4c6b4-cd8f-4a7f-998a-1361a5b612a4 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:54.926985 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4c6b4-cd8f-4a7f-998a-1361a5b612a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:54.927291 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4c6b4-cd8f-4a7f-998a-1361a5b612a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:54.928173 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-ea181b02-0d4d-41ef-9969-e25d87128257 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:41:54.928678 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4c6b4-cd8f-4a7f-998a-1361a5b612a4 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:54.929349 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 291/581] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:41:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:54.930110 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea181b02-0d4d-41ef-9969-e25d87128257 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:54.939972 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 291/582] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:54.941344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4c6b4-cd8f-4a7f-998a-1361a5b612a4 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:55.028971 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea181b02-0d4d-41ef-9969-e25d87128257 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:55.033653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4c6b4-cd8f-4a7f-998a-1361a5b612a4 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:55.060360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755fff7-08be-42d9-bd9e-84aa8ecd144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:55.061033 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755fff7-08be-42d9-bd9e-84aa8ecd144b None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:55.061317 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755fff7-08be-42d9-bd9e-84aa8ecd144b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:55.061593 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755fff7-08be-42d9-bd9e-84aa8ecd144b None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:55.062410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755fff7-08be-42d9-bd9e-84aa8ecd144b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:55.062719 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755fff7-08be-42d9-bd9e-84aa8ecd144b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:55.064188 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755fff7-08be-42d9-bd9e-84aa8ecd144b None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:55.065144 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd405c4-db41-4658-8a33-28f4f572f787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:55.066388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd405c4-db41-4658-8a33-28f4f572f787 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:55.066667 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd405c4-db41-4658-8a33-28f4f572f787 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:55.066939 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd405c4-db41-4658-8a33-28f4f572f787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:55.067789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd405c4-db41-4658-8a33-28f4f572f787 None admin] RBAC: Adding query filter params (role.id=b34db25ec52b41a7bb7691d839e68c53, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=869feb4577be48a683997eab827b1062) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:55.068103 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd405c4-db41-4658-8a33-28f4f572f787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:55.069514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd405c4-db41-4658-8a33-28f4f572f787 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:55.074688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 292/583] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:41:54 2022] GET /identity/v3/role_assignments?user.id=869feb4577be48a683997eab827b1062&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=b34db25ec52b41a7bb7691d839e68c53 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:55.075435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd405c4-db41-4658-8a33-28f4f572f787 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:55.085913 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 292/584] 10.222.0.52 () {56 vars in 1139 bytes} [Tue Mar 8 11:41:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:55.085913 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755fff7-08be-42d9-bd9e-84aa8ecd144b None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:55.191301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755fff7-08be-42d9-bd9e-84aa8ecd144b None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:55.193957 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd405c4-db41-4658-8a33-28f4f572f787 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:55.229088 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed54d-2178-462f-99fd-b18c36a69fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:55.229780 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed54d-2178-462f-99fd-b18c36a69fe0 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:55.230065 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed54d-2178-462f-99fd-b18c36a69fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:55.230343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed54d-2178-462f-99fd-b18c36a69fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:55.231093 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ed54d-2178-462f-99fd-b18c36a69fe0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:55.231400 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ed54d-2178-462f-99fd-b18c36a69fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:55.232290 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21601b46-76d7-40ee-9c54-18eced95abce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:55.232847 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ed54d-2178-462f-99fd-b18c36a69fe0 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:55.233334 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21601b46-76d7-40ee-9c54-18eced95abce None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:55.233684 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21601b46-76d7-40ee-9c54-18eced95abce None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:55.234027 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21601b46-76d7-40ee-9c54-18eced95abce None admin] PATH_INFO: `/v3/projects/7c390663688b466f98ff480c31ba21bc/users/534fd902f96043068e99ca0537cf57c5/roles/b34db25ec52b41a7bb7691d839e68c53` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:55.242271 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 293/585] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:41:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:55.243291 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed54d-2178-462f-99fd-b18c36a69fe0 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:55.253957 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21601b46-76d7-40ee-9c54-18eced95abce None admin] RBAC: Authorizing `identity:create_grant(project_id=7c390663688b466f98ff480c31ba21bc, user_id=534fd902f96043068e99ca0537cf57c5, role_id=b34db25ec52b41a7bb7691d839e68c53)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:55.255407 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21601b46-76d7-40ee-9c54-18eced95abce None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:55.326136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 293/586] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:41:55 2022] PUT /identity/v3/projects/7c390663688b466f98ff480c31ba21bc/users/534fd902f96043068e99ca0537cf57c5/roles/b34db25ec52b41a7bb7691d839e68c53 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:41:55.327196 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21601b46-76d7-40ee-9c54-18eced95abce None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:55.364213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed54d-2178-462f-99fd-b18c36a69fe0 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:55.405855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264de5fa-50c7-4259-a2c1-afe814ba64f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:55.406717 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264de5fa-50c7-4259-a2c1-afe814ba64f5 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:55.407016 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264de5fa-50c7-4259-a2c1-afe814ba64f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:55.407296 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264de5fa-50c7-4259-a2c1-afe814ba64f5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:55.416588 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264de5fa-50c7-4259-a2c1-afe814ba64f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:55.418099 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264de5fa-50c7-4259-a2c1-afe814ba64f5 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:55.433381 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-264de5fa-50c7-4259-a2c1-afe814ba64f5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 08 11:41:55.439099 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 294/587] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:55.439099 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264de5fa-50c7-4259-a2c1-afe814ba64f5 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:55.458200 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21601b46-76d7-40ee-9c54-18eced95abce None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:55.496118 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f30214-ced9-4969-940c-b51e74e23167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:55.497235 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f30214-ced9-4969-940c-b51e74e23167 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:55.497706 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f30214-ced9-4969-940c-b51e74e23167 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:55.498133 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f30214-ced9-4969-940c-b51e74e23167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:55.510019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f30214-ced9-4969-940c-b51e74e23167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:55.512401 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f30214-ced9-4969-940c-b51e74e23167 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:55.532246 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-67f30214-ced9-4969-940c-b51e74e23167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:55.534107 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 294/588] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:55.535139 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f30214-ced9-4969-940c-b51e74e23167 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:55.549024 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264de5fa-50c7-4259-a2c1-afe814ba64f5 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:55.584130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e81bc2-8b6d-4201-be42-fd6ccb2bd158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:55.584867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e81bc2-8b6d-4201-be42-fd6ccb2bd158 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:55.585157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e81bc2-8b6d-4201-be42-fd6ccb2bd158 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:55.585435 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e81bc2-8b6d-4201-be42-fd6ccb2bd158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:55.596705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e81bc2-8b6d-4201-be42-fd6ccb2bd158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:55.598261 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e81bc2-8b6d-4201-be42-fd6ccb2bd158 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:55.614787 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-e8e81bc2-8b6d-4201-be42-fd6ccb2bd158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:55.616314 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 295/589] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:55.617115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e81bc2-8b6d-4201-be42-fd6ccb2bd158 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:55.639162 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f30214-ced9-4969-940c-b51e74e23167 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:55.677900 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a6d2a-ace5-490e-b995-3bc88e6d827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:55.678916 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a6d2a-ace5-490e-b995-3bc88e6d827b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:55.679386 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a6d2a-ace5-490e-b995-3bc88e6d827b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:55.679880 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a6d2a-ace5-490e-b995-3bc88e6d827b None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:55.680932 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a6d2a-ace5-490e-b995-3bc88e6d827b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:55.681420 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a6d2a-ace5-490e-b995-3bc88e6d827b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:55.683066 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a6d2a-ace5-490e-b995-3bc88e6d827b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:55.701111 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 295/590] 10.222.0.52 () {56 vars in 1137 bytes} [Tue Mar 8 11:41:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:55.702319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a6d2a-ace5-490e-b995-3bc88e6d827b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:55.722305 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e81bc2-8b6d-4201-be42-fd6ccb2bd158 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:55.756837 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd9bcb-2a31-4f31-83e1-da44f7d555d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:55.757550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd9bcb-2a31-4f31-83e1-da44f7d555d3 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:55.757785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd9bcb-2a31-4f31-83e1-da44f7d555d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:55.758067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd9bcb-2a31-4f31-83e1-da44f7d555d3 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:55.758792 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd9bcb-2a31-4f31-83e1-da44f7d555d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:55.759104 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd9bcb-2a31-4f31-83e1-da44f7d555d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:55.760534 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd9bcb-2a31-4f31-83e1-da44f7d555d3 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:55.773545 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 296/591] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:55.774400 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd9bcb-2a31-4f31-83e1-da44f7d555d3 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:55.805216 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a6d2a-ace5-490e-b995-3bc88e6d827b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:55.839680 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cb094-7501-45a3-b791-cf69a2c28014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:55.840718 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cb094-7501-45a3-b791-cf69a2c28014 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:55.841197 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cb094-7501-45a3-b791-cf69a2c28014 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:55.841665 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cb094-7501-45a3-b791-cf69a2c28014 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:55.842578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06cb094-7501-45a3-b791-cf69a2c28014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:55.843079 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06cb094-7501-45a3-b791-cf69a2c28014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:55.844701 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06cb094-7501-45a3-b791-cf69a2c28014 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:55.858883 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 296/592] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:55.860230 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cb094-7501-45a3-b791-cf69a2c28014 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:55.875021 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd9bcb-2a31-4f31-83e1-da44f7d555d3 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:55.910835 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb2aec-1b47-42a0-972e-f278955ec2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:55.911683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb2aec-1b47-42a0-972e-f278955ec2c6 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:55.912259 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb2aec-1b47-42a0-972e-f278955ec2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:55.912259 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb2aec-1b47-42a0-972e-f278955ec2c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:55.922583 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb2aec-1b47-42a0-972e-f278955ec2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:55.924106 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb2aec-1b47-42a0-972e-f278955ec2c6 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:55.941971 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-1fcb2aec-1b47-42a0-972e-f278955ec2c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:55.943481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 297/593] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:55.944374 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb2aec-1b47-42a0-972e-f278955ec2c6 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:55.970842 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cb094-7501-45a3-b791-cf69a2c28014 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:56.004685 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b9b1b-9caa-46ec-b93c-2802c7e2c225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:56.005813 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9b1b-9caa-46ec-b93c-2802c7e2c225 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:56.006307 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9b1b-9caa-46ec-b93c-2802c7e2c225 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:56.006769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9b1b-9caa-46ec-b93c-2802c7e2c225 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:56.013686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b9b1b-9caa-46ec-b93c-2802c7e2c225 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:56.015347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b9b1b-9caa-46ec-b93c-2802c7e2c225 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:56.030037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-a94b9b1b-9caa-46ec-b93c-2802c7e2c225 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:41:56.031834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 297/594] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:56.032948 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b9b1b-9caa-46ec-b93c-2802c7e2c225 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:56.045713 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb2aec-1b47-42a0-972e-f278955ec2c6 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:56.081274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73316e67-f223-41a6-8663-43c66e0e8c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:56.082298 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73316e67-f223-41a6-8663-43c66e0e8c61 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:56.082583 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73316e67-f223-41a6-8663-43c66e0e8c61 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:56.082914 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73316e67-f223-41a6-8663-43c66e0e8c61 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:56.091005 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73316e67-f223-41a6-8663-43c66e0e8c61 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:56.092592 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73316e67-f223-41a6-8663-43c66e0e8c61 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:56.107701 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-73316e67-f223-41a6-8663-43c66e0e8c61 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 11:41:56.109220 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 298/595] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:41:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:56.110079 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73316e67-f223-41a6-8663-43c66e0e8c61 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:56.137172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b9b1b-9caa-46ec-b93c-2802c7e2c225 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:56.172126 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97145ae-710e-45b4-a8eb-eb65c5217779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:56.173235 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97145ae-710e-45b4-a8eb-eb65c5217779 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:56.173719 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97145ae-710e-45b4-a8eb-eb65c5217779 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:56.174192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97145ae-710e-45b4-a8eb-eb65c5217779 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:56.175309 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97145ae-710e-45b4-a8eb-eb65c5217779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:56.175843 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97145ae-710e-45b4-a8eb-eb65c5217779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:56.177416 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97145ae-710e-45b4-a8eb-eb65c5217779 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:56.189579 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 298/596] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:56.191653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97145ae-710e-45b4-a8eb-eb65c5217779 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:56.224673 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73316e67-f223-41a6-8663-43c66e0e8c61 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:56.262657 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad8ed6-7448-4dd5-b6ee-b1cfb8d0290d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:56.263254 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad8ed6-7448-4dd5-b6ee-b1cfb8d0290d None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:56.263557 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad8ed6-7448-4dd5-b6ee-b1cfb8d0290d None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:56.263841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad8ed6-7448-4dd5-b6ee-b1cfb8d0290d None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:56.264630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad8ed6-7448-4dd5-b6ee-b1cfb8d0290d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:56.264943 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad8ed6-7448-4dd5-b6ee-b1cfb8d0290d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:56.266467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad8ed6-7448-4dd5-b6ee-b1cfb8d0290d None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:56.280630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 299/597] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:41:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:56.281628 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad8ed6-7448-4dd5-b6ee-b1cfb8d0290d None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:56.316997 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97145ae-710e-45b4-a8eb-eb65c5217779 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:56.351989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e5d3a-7e90-46d5-85a3-7167a4f88524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:56.353005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e5d3a-7e90-46d5-85a3-7167a4f88524 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:56.353498 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e5d3a-7e90-46d5-85a3-7167a4f88524 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:56.353966 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e5d3a-7e90-46d5-85a3-7167a4f88524 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:56.354986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e5d3a-7e90-46d5-85a3-7167a4f88524 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:56.355624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e5d3a-7e90-46d5-85a3-7167a4f88524 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:56.357963 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e5d3a-7e90-46d5-85a3-7167a4f88524 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:56.381170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 299/598] 10.222.0.52 () {56 vars in 1137 bytes} [Tue Mar 8 11:41:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:56.382117 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e5d3a-7e90-46d5-85a3-7167a4f88524 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:56.383972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad8ed6-7448-4dd5-b6ee-b1cfb8d0290d None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:56.426959 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc94b3c-2315-44e9-9e72-6217b7ce27fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:56.428592 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc94b3c-2315-44e9-9e72-6217b7ce27fc None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:56.429079 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc94b3c-2315-44e9-9e72-6217b7ce27fc None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:56.429777 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc94b3c-2315-44e9-9e72-6217b7ce27fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:56.438398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc94b3c-2315-44e9-9e72-6217b7ce27fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:56.440635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc94b3c-2315-44e9-9e72-6217b7ce27fc None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:56.456554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-ccc94b3c-2315-44e9-9e72-6217b7ce27fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:41:56.458083 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 300/599] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:56.458881 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc94b3c-2315-44e9-9e72-6217b7ce27fc None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:56.484880 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e5d3a-7e90-46d5-85a3-7167a4f88524 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:56.520309 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d390239-f199-4fd6-91d0-27f683a05e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:56.521521 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d390239-f199-4fd6-91d0-27f683a05e47 None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:56.521994 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d390239-f199-4fd6-91d0-27f683a05e47 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:56.522510 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d390239-f199-4fd6-91d0-27f683a05e47 None admin] PATH_INFO: `/v3/projects/7c390663688b466f98ff480c31ba21bc/users/a5f8507c0ae342f7a3e97b48363ad606/roles/b34db25ec52b41a7bb7691d839e68c53` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:56.539016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d390239-f199-4fd6-91d0-27f683a05e47 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c390663688b466f98ff480c31ba21bc, user_id=a5f8507c0ae342f7a3e97b48363ad606, role_id=b34db25ec52b41a7bb7691d839e68c53)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:56.541011 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d390239-f199-4fd6-91d0-27f683a05e47 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:56.561850 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc94b3c-2315-44e9-9e72-6217b7ce27fc None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:56.597653 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1035ef7-3751-4b4c-a9bc-426ec710c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:56.598971 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1035ef7-3751-4b4c-a9bc-426ec710c853 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:56.599434 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1035ef7-3751-4b4c-a9bc-426ec710c853 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:56.599928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1035ef7-3751-4b4c-a9bc-426ec710c853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:56.612850 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1035ef7-3751-4b4c-a9bc-426ec710c853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:56.615324 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1035ef7-3751-4b4c-a9bc-426ec710c853 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:56.632246 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 300/600] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:41:56 2022] PUT /identity/v3/projects/7c390663688b466f98ff480c31ba21bc/users/a5f8507c0ae342f7a3e97b48363ad606/roles/b34db25ec52b41a7bb7691d839e68c53 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:41:56.633275 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d390239-f199-4fd6-91d0-27f683a05e47 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:56.646724 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-b1035ef7-3751-4b4c-a9bc-426ec710c853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:56.649253 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 301/601] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:56.654608 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1035ef7-3751-4b4c-a9bc-426ec710c853 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:56.770417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1035ef7-3751-4b4c-a9bc-426ec710c853 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:56.813081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc273fe3-8cc8-4790-8614-46f88cb035e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:56.814009 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc273fe3-8cc8-4790-8614-46f88cb035e4 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:56.815896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc273fe3-8cc8-4790-8614-46f88cb035e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:56.817764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc273fe3-8cc8-4790-8614-46f88cb035e4 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:56.818699 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc273fe3-8cc8-4790-8614-46f88cb035e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:56.821010 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc273fe3-8cc8-4790-8614-46f88cb035e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:56.822593 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc273fe3-8cc8-4790-8614-46f88cb035e4 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:56.859216 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 302/602] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:56.860492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc273fe3-8cc8-4790-8614-46f88cb035e4 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:56.888934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d390239-f199-4fd6-91d0-27f683a05e47 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:56.929912 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48997cd5-e445-4f7d-976d-547decdce28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:56.930633 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48997cd5-e445-4f7d-976d-547decdce28d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:56.930852 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48997cd5-e445-4f7d-976d-547decdce28d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:56.931127 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48997cd5-e445-4f7d-976d-547decdce28d None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:56.932043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48997cd5-e445-4f7d-976d-547decdce28d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:56.932308 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48997cd5-e445-4f7d-976d-547decdce28d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:56.933805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48997cd5-e445-4f7d-976d-547decdce28d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:56.950703 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 301/603] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:41:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:56.952381 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48997cd5-e445-4f7d-976d-547decdce28d None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:56.978094 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc273fe3-8cc8-4790-8614-46f88cb035e4 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:57.015703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8b27f-9717-46bd-a3ff-63f8bbfe7686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:57.016674 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8b27f-9717-46bd-a3ff-63f8bbfe7686 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:57.017060 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8b27f-9717-46bd-a3ff-63f8bbfe7686 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:57.017532 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8b27f-9717-46bd-a3ff-63f8bbfe7686 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:57.024710 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8b27f-9717-46bd-a3ff-63f8bbfe7686 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:57.032975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8b27f-9717-46bd-a3ff-63f8bbfe7686 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:57.047455 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-00d8b27f-9717-46bd-a3ff-63f8bbfe7686 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:41:57.049124 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 303/604] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:57.055450 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8b27f-9717-46bd-a3ff-63f8bbfe7686 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:57.057469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48997cd5-e445-4f7d-976d-547decdce28d None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:57.091573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627bccc-4dc0-447d-baa1-f9f2b7c4687c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:57.092754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627bccc-4dc0-447d-baa1-f9f2b7c4687c None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:57.093182 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627bccc-4dc0-447d-baa1-f9f2b7c4687c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:57.093598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627bccc-4dc0-447d-baa1-f9f2b7c4687c None admin] PATH_INFO: `/v3/projects/7c390663688b466f98ff480c31ba21bc/users/b65583446d2e40a69dff534b73e8fa7a/roles/b34db25ec52b41a7bb7691d839e68c53` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:57.110467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627bccc-4dc0-447d-baa1-f9f2b7c4687c None admin] RBAC: Authorizing `identity:create_grant(project_id=7c390663688b466f98ff480c31ba21bc, user_id=b65583446d2e40a69dff534b73e8fa7a, role_id=b34db25ec52b41a7bb7691d839e68c53)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:57.112812 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627bccc-4dc0-447d-baa1-f9f2b7c4687c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:57.167554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8b27f-9717-46bd-a3ff-63f8bbfe7686 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:57.215107 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a25d9-1be4-4889-a6e2-ea26d8a5d1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:57.215857 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a25d9-1be4-4889-a6e2-ea26d8a5d1b9 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:57.216146 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a25d9-1be4-4889-a6e2-ea26d8a5d1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:57.216424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a25d9-1be4-4889-a6e2-ea26d8a5d1b9 None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:57.217217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a25d9-1be4-4889-a6e2-ea26d8a5d1b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:57.217532 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a25d9-1be4-4889-a6e2-ea26d8a5d1b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:57.218993 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a25d9-1be4-4889-a6e2-ea26d8a5d1b9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:57.233788 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 304/605] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:41:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:57.240535 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a25d9-1be4-4889-a6e2-ea26d8a5d1b9 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:57.242950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 302/606] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:41:56 2022] PUT /identity/v3/projects/7c390663688b466f98ff480c31ba21bc/users/b65583446d2e40a69dff534b73e8fa7a/roles/b34db25ec52b41a7bb7691d839e68c53 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 11:41:57.357839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a25d9-1be4-4889-a6e2-ea26d8a5d1b9 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:57.405129 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ac716-9447-4009-991f-ea7439ecdea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:57.406043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ac716-9447-4009-991f-ea7439ecdea8 None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:57.406326 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ac716-9447-4009-991f-ea7439ecdea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:57.406602 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ac716-9447-4009-991f-ea7439ecdea8 None admin] PATH_INFO: `/v3/projects/7c390663688b466f98ff480c31ba21bc/users/1c5631271ed54eacbbbbbb5c8d14d764/roles/b34db25ec52b41a7bb7691d839e68c53` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:57.428348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ac716-9447-4009-991f-ea7439ecdea8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c390663688b466f98ff480c31ba21bc, user_id=1c5631271ed54eacbbbbbb5c8d14d764, role_id=b34db25ec52b41a7bb7691d839e68c53)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:57.429816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ac716-9447-4009-991f-ea7439ecdea8 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:57.501938 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dd1bd-2b5e-466d-bbc5-9859ea81cbdd None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:57.502255 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dd1bd-2b5e-466d-bbc5-9859ea81cbdd None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:57.503085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dd1bd-2b5e-466d-bbc5-9859ea81cbdd None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:57.505531 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 303/607] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:41:57.511241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92c7e2-a329-4310-a97e-af71a94ef197 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:57.511542 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92c7e2-a329-4310-a97e-af71a94ef197 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:57.511842 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92c7e2-a329-4310-a97e-af71a94ef197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:57.521412 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 305/608] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:41:57 2022] PUT /identity/v3/projects/7c390663688b466f98ff480c31ba21bc/users/1c5631271ed54eacbbbbbb5c8d14d764/roles/b34db25ec52b41a7bb7691d839e68c53 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:41:57.539059 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-ec92c7e2-a329-4310-a97e-af71a94ef197 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:57.540317 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ec92c7e2-a329-4310-a97e-af71a94ef197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:57.629079 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 304/609] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:57.653064 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ac716-9447-4009-991f-ea7439ecdea8 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:57.764841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ac716-9447-4009-991f-ea7439ecdea8 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:57.802405 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f17f19-9020-4873-a3cb-c7101953211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:57.803218 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f17f19-9020-4873-a3cb-c7101953211b None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:57.803502 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f17f19-9020-4873-a3cb-c7101953211b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:57.803855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f17f19-9020-4873-a3cb-c7101953211b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:57.814540 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f17f19-9020-4873-a3cb-c7101953211b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:57.822571 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-01f17f19-9020-4873-a3cb-c7101953211b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:41:57.824205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 306/610] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:41:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:57.829894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92c7e2-a329-4310-a97e-af71a94ef197 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:57.861895 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eacede-a48d-4df5-9559-9f44f874213a None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:57.862646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eacede-a48d-4df5-9559-9f44f874213a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:57.862906 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eacede-a48d-4df5-9559-9f44f874213a None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:57.864921 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 307/611] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:41:57.870149 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f0f0f-169e-4312-8d18-c48e2ec1bd9f None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:57.870436 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f0f0f-169e-4312-8d18-c48e2ec1bd9f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:57.870773 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f0f0f-169e-4312-8d18-c48e2ec1bd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:57.890138 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-570f0f0f-169e-4312-8d18-c48e2ec1bd9f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:57.891278 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-570f0f0f-169e-4312-8d18-c48e2ec1bd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:57.948709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92c7e2-a329-4310-a97e-af71a94ef197 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:57.986243 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752df9ea-bd02-461a-bd7b-61eb40fe3e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:57.987848 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752df9ea-bd02-461a-bd7b-61eb40fe3e5b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:57.988347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752df9ea-bd02-461a-bd7b-61eb40fe3e5b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:57.988820 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752df9ea-bd02-461a-bd7b-61eb40fe3e5b None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:57.989363 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 308/612] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:41:57.990312 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752df9ea-bd02-461a-bd7b-61eb40fe3e5b None admin] RBAC: Adding query filter params (name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:57.990827 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752df9ea-bd02-461a-bd7b-61eb40fe3e5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:57.996529 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752df9ea-bd02-461a-bd7b-61eb40fe3e5b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:58.009767 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 305/613] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:41:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:58.014886 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f0f0f-169e-4312-8d18-c48e2ec1bd9f None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:58.027361 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752df9ea-bd02-461a-bd7b-61eb40fe3e5b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:58.138125 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f0f0f-169e-4312-8d18-c48e2ec1bd9f None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:58.147399 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752df9ea-bd02-461a-bd7b-61eb40fe3e5b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:58.173485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b7a72-e3c2-451c-9c32-15ada1ab6e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:58.174973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b7a72-e3c2-451c-9c32-15ada1ab6e19 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:58.174973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b7a72-e3c2-451c-9c32-15ada1ab6e19 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:58.174973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b7a72-e3c2-451c-9c32-15ada1ab6e19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:58.186429 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b7a72-e3c2-451c-9c32-15ada1ab6e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:58.191816 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc786df-edd8-4caa-99ff-96cd5cee9415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:58.193134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc786df-edd8-4caa-99ff-96cd5cee9415 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:58.193239 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b7a72-e3c2-451c-9c32-15ada1ab6e19 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:58.193868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc786df-edd8-4caa-99ff-96cd5cee9415 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:58.194333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc786df-edd8-4caa-99ff-96cd5cee9415 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:58.207184 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc786df-edd8-4caa-99ff-96cd5cee9415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:41:58.214729 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-1fc786df-edd8-4caa-99ff-96cd5cee9415 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:41:58.216475 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 306/614] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:41:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:58.221841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-5e1b7a72-e3c2-451c-9c32-15ada1ab6e19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:58.221841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 309/615] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:58.223009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc786df-edd8-4caa-99ff-96cd5cee9415 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:58.224515 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b7a72-e3c2-451c-9c32-15ada1ab6e19 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:58.334926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc786df-edd8-4caa-99ff-96cd5cee9415 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:58.343090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b7a72-e3c2-451c-9c32-15ada1ab6e19 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:58.373330 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646b647-5f6c-4158-8067-02c4f65ae917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:58.374042 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646b647-5f6c-4158-8067-02c4f65ae917 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:58.374326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646b647-5f6c-4158-8067-02c4f65ae917 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:58.374604 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646b647-5f6c-4158-8067-02c4f65ae917 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:58.375353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646b647-5f6c-4158-8067-02c4f65ae917 None admin] RBAC: Adding query filter params (name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:58.379553 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646b647-5f6c-4158-8067-02c4f65ae917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:58.379553 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646b647-5f6c-4158-8067-02c4f65ae917 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:58.396362 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 307/616] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:41:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:58.400524 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646b647-5f6c-4158-8067-02c4f65ae917 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:58.415017 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb5d25-9fbd-480f-814b-6c301430dbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:58.415714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb5d25-9fbd-480f-814b-6c301430dbae None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:58.415997 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb5d25-9fbd-480f-814b-6c301430dbae None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:58.416271 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb5d25-9fbd-480f-814b-6c301430dbae None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:58.416991 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb5d25-9fbd-480f-814b-6c301430dbae None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:58.417301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb5d25-9fbd-480f-814b-6c301430dbae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:58.418678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb5d25-9fbd-480f-814b-6c301430dbae None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:58.442025 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 310/617] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:58.447263 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb5d25-9fbd-480f-814b-6c301430dbae None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:58.537918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646b647-5f6c-4158-8067-02c4f65ae917 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:58.577738 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcc4fb-e549-44fb-a109-499b194749c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:58.578546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcc4fb-e549-44fb-a109-499b194749c0 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:58.578831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcc4fb-e549-44fb-a109-499b194749c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:58.579107 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcc4fb-e549-44fb-a109-499b194749c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:58.591656 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcc4fb-e549-44fb-a109-499b194749c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:58.593102 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcc4fb-e549-44fb-a109-499b194749c0 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:58.611406 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-0cfcc4fb-e549-44fb-a109-499b194749c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:58.613038 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 308/618] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:58.618934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcc4fb-e549-44fb-a109-499b194749c0 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:58.636873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb5d25-9fbd-480f-814b-6c301430dbae None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:58.698842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486bc13-d8a4-4d81-8e4a-926c6829f606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:58.699664 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486bc13-d8a4-4d81-8e4a-926c6829f606 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:58.699944 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486bc13-d8a4-4d81-8e4a-926c6829f606 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:58.700222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486bc13-d8a4-4d81-8e4a-926c6829f606 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:58.707700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486bc13-d8a4-4d81-8e4a-926c6829f606 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:58.709155 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486bc13-d8a4-4d81-8e4a-926c6829f606 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:58.723793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-e486bc13-d8a4-4d81-8e4a-926c6829f606 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 11:41:58.725346 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 311/619] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:41:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:41:58.730624 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486bc13-d8a4-4d81-8e4a-926c6829f606 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:58.825808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcc4fb-e549-44fb-a109-499b194749c0 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:58.846163 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486bc13-d8a4-4d81-8e4a-926c6829f606 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:58.885547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd9a80-49f2-4894-b877-be49f6229262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:58.886222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd9a80-49f2-4894-b877-be49f6229262 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:58.886503 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd9a80-49f2-4894-b877-be49f6229262 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:58.886777 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd9a80-49f2-4894-b877-be49f6229262 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:58.887634 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd9a80-49f2-4894-b877-be49f6229262 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:58.888082 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd9a80-49f2-4894-b877-be49f6229262 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:58.889678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd9a80-49f2-4894-b877-be49f6229262 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:58.910151 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 312/620] 10.222.0.52 () {56 vars in 1135 bytes} [Tue Mar 8 11:41:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:58.917759 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd9a80-49f2-4894-b877-be49f6229262 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:58.918735 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce8d8b-18a5-45c2-871f-fdb9100d8814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:58.919407 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce8d8b-18a5-45c2-871f-fdb9100d8814 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:58.919725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce8d8b-18a5-45c2-871f-fdb9100d8814 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:58.920004 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce8d8b-18a5-45c2-871f-fdb9100d8814 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:58.920732 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce8d8b-18a5-45c2-871f-fdb9100d8814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:58.921042 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce8d8b-18a5-45c2-871f-fdb9100d8814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:58.922420 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce8d8b-18a5-45c2-871f-fdb9100d8814 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:58.946596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 309/621] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:58.957019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce8d8b-18a5-45c2-871f-fdb9100d8814 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:59.039595 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd9a80-49f2-4894-b877-be49f6229262 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:59.105162 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbc439-d6c9-4e83-888c-ac550639f4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:59.106350 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbc439-d6c9-4e83-888c-ac550639f4b4 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:59.106823 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbc439-d6c9-4e83-888c-ac550639f4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:59.107312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbc439-d6c9-4e83-888c-ac550639f4b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:59.115914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce8d8b-18a5-45c2-871f-fdb9100d8814 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:59.132610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbc439-d6c9-4e83-888c-ac550639f4b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:59.134416 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbc439-d6c9-4e83-888c-ac550639f4b4 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:59.158340 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-99fbc439-d6c9-4e83-888c-ac550639f4b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:41:59.161590 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 313/622] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:59.162762 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea62e7-6691-4989-9426-348da5f2a868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:59.163599 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea62e7-6691-4989-9426-348da5f2a868 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:59.163934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea62e7-6691-4989-9426-348da5f2a868 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:59.164223 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea62e7-6691-4989-9426-348da5f2a868 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:59.168583 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbc439-d6c9-4e83-888c-ac550639f4b4 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:59.172924 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea62e7-6691-4989-9426-348da5f2a868 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:59.174592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea62e7-6691-4989-9426-348da5f2a868 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:59.195668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-6aea62e7-6691-4989-9426-348da5f2a868 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 11:41:59.197270 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 310/623] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 11:41:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:59.205028 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea62e7-6691-4989-9426-348da5f2a868 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:59.366177 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbc439-d6c9-4e83-888c-ac550639f4b4 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:59.377639 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea62e7-6691-4989-9426-348da5f2a868 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:59.427075 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8422c3-7f52-4dfe-b94f-f4a9a783d7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:59.428221 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8422c3-7f52-4dfe-b94f-f4a9a783d7c1 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:59.428723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8422c3-7f52-4dfe-b94f-f4a9a783d7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:59.429190 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8422c3-7f52-4dfe-b94f-f4a9a783d7c1 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:59.430193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8422c3-7f52-4dfe-b94f-f4a9a783d7c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:59.430712 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8422c3-7f52-4dfe-b94f-f4a9a783d7c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:59.432302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8422c3-7f52-4dfe-b94f-f4a9a783d7c1 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:59.437109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53ce67-bf4e-4674-af2f-d2fd802df4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:59.437788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53ce67-bf4e-4674-af2f-d2fd802df4cf None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:59.438062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53ce67-bf4e-4674-af2f-d2fd802df4cf None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:59.438331 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53ce67-bf4e-4674-af2f-d2fd802df4cf None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:59.439163 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53ce67-bf4e-4674-af2f-d2fd802df4cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:59.439468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53ce67-bf4e-4674-af2f-d2fd802df4cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:59.441024 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53ce67-bf4e-4674-af2f-d2fd802df4cf None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:59.446379 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 314/624] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:59.451446 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8422c3-7f52-4dfe-b94f-f4a9a783d7c1 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:59.483240 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 311/625] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 11:41:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:41:59.484764 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53ce67-bf4e-4674-af2f-d2fd802df4cf None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:59.565345 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8422c3-7f52-4dfe-b94f-f4a9a783d7c1 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:59.644347 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548d3aa-b5a0-40aa-a4c8-b86c288b74ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:59.645085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548d3aa-b5a0-40aa-a4c8-b86c288b74ba None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:59.645369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548d3aa-b5a0-40aa-a4c8-b86c288b74ba None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:59.645644 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548d3aa-b5a0-40aa-a4c8-b86c288b74ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:59.656049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53ce67-bf4e-4674-af2f-d2fd802df4cf None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:59.660645 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548d3aa-b5a0-40aa-a4c8-b86c288b74ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:59.662131 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548d3aa-b5a0-40aa-a4c8-b86c288b74ba None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:59.689642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-4548d3aa-b5a0-40aa-a4c8-b86c288b74ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:41:59.692649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 315/626] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:41:59.700121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe162121-466b-4b85-86d7-0d0a6b738f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:59.700721 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548d3aa-b5a0-40aa-a4c8-b86c288b74ba None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:59.701646 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe162121-466b-4b85-86d7-0d0a6b738f09 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:59.702061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe162121-466b-4b85-86d7-0d0a6b738f09 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:59.702456 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe162121-466b-4b85-86d7-0d0a6b738f09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:59.775011 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe162121-466b-4b85-86d7-0d0a6b738f09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:59.776893 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe162121-466b-4b85-86d7-0d0a6b738f09 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:59.820938 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548d3aa-b5a0-40aa-a4c8-b86c288b74ba None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:41:59.853861 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d3847-0d45-4737-8e56-a57e37294942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:41:59.854520 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d3847-0d45-4737-8e56-a57e37294942 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:59.854799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d3847-0d45-4737-8e56-a57e37294942 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:59.855071 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d3847-0d45-4737-8e56-a57e37294942 None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:59.855876 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d3847-0d45-4737-8e56-a57e37294942 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:41:59.856222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d3847-0d45-4737-8e56-a57e37294942 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:41:59.857723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d3847-0d45-4737-8e56-a57e37294942 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:41:59.872182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 316/627] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:41:59.873558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d6ebc-3ee5-4199-a2be-99b1d8f4d716 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:59.873844 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d6ebc-3ee5-4199-a2be-99b1d8f4d716 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:59.874115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d6ebc-3ee5-4199-a2be-99b1d8f4d716 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:59.876139 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 317/628] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:41:59.882009 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d6ebc-3ee5-4199-a2be-99b1d8f4d716 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:41:59.887289 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 312/629] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:41:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 11:41:59.888676 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38089d-c20b-4c8c-a796-3acfcb23693a None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:41:59.889009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38089d-c20b-4c8c-a796-3acfcb23693a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:41:59.889287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38089d-c20b-4c8c-a796-3acfcb23693a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:41:59.910361 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-af38089d-c20b-4c8c-a796-3acfcb23693a None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:41:59.912128 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-af38089d-c20b-4c8c-a796-3acfcb23693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:41:59.995086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 313/630] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:41:59.996176 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38089d-c20b-4c8c-a796-3acfcb23693a None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:00.018524 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d6ebc-3ee5-4199-a2be-99b1d8f4d716 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:00.063542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332db3d-9827-4c43-a96c-6b5e12f1242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:00.064462 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332db3d-9827-4c43-a96c-6b5e12f1242b None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:00.064859 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332db3d-9827-4c43-a96c-6b5e12f1242b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:00.065522 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332db3d-9827-4c43-a96c-6b5e12f1242b None admin] PATH_INFO: `/v3/projects/7c390663688b466f98ff480c31ba21bc/users/869feb4577be48a683997eab827b1062/roles/b34db25ec52b41a7bb7691d839e68c53` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:00.082182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332db3d-9827-4c43-a96c-6b5e12f1242b None admin] RBAC: Authorizing `identity:create_grant(project_id=7c390663688b466f98ff480c31ba21bc, user_id=869feb4577be48a683997eab827b1062, role_id=b34db25ec52b41a7bb7691d839e68c53)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:00.084462 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332db3d-9827-4c43-a96c-6b5e12f1242b None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:00.133217 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38089d-c20b-4c8c-a796-3acfcb23693a None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:00.168409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78552d26-1c02-47f3-a420-d38280b6987e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:00.169193 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78552d26-1c02-47f3-a420-d38280b6987e None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:00.169472 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78552d26-1c02-47f3-a420-d38280b6987e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:00.169742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78552d26-1c02-47f3-a420-d38280b6987e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:00.180753 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78552d26-1c02-47f3-a420-d38280b6987e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:00.182218 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78552d26-1c02-47f3-a420-d38280b6987e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:00.188866 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 318/631] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:41:59 2022] PUT /identity/v3/projects/7c390663688b466f98ff480c31ba21bc/users/869feb4577be48a683997eab827b1062/roles/b34db25ec52b41a7bb7691d839e68c53 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:42:00.190039 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332db3d-9827-4c43-a96c-6b5e12f1242b None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:00.204059 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-78552d26-1c02-47f3-a420-d38280b6987e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:00.205420 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 314/632] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:00.206807 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3489a0-a8ca-43d9-be53-86529fea22ee None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:00.207100 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3489a0-a8ca-43d9-be53-86529fea22ee None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:00.207377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3489a0-a8ca-43d9-be53-86529fea22ee None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:00.209450 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 315/633] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:00.214001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3489a0-a8ca-43d9-be53-86529fea22ee None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:00.309641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332db3d-9827-4c43-a96c-6b5e12f1242b None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:00.322220 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3489a0-a8ca-43d9-be53-86529fea22ee None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:00.347352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b406e-7bf2-4f36-830d-d06c4c67f9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:00.348148 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b406e-7bf2-4f36-830d-d06c4c67f9e4 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:00.348425 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b406e-7bf2-4f36-830d-d06c4c67f9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:00.348699 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b406e-7bf2-4f36-830d-d06c4c67f9e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:00.361675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b406e-7bf2-4f36-830d-d06c4c67f9e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:00.365931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968810f5-6116-4313-a5bc-87d5f90cc686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:00.365931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968810f5-6116-4313-a5bc-87d5f90cc686 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:00.366194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968810f5-6116-4313-a5bc-87d5f90cc686 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:00.366397 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968810f5-6116-4313-a5bc-87d5f90cc686 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:00.367099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968810f5-6116-4313-a5bc-87d5f90cc686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:00.367411 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968810f5-6116-4313-a5bc-87d5f90cc686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:00.370526 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968810f5-6116-4313-a5bc-87d5f90cc686 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:00.370645 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-533b406e-7bf2-4f36-830d-d06c4c67f9e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:42:00.377211 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 319/634] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:42:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:00.379038 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507326a-1219-4da1-b569-15aec3b09716 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:00.379322 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507326a-1219-4da1-b569-15aec3b09716 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:00.380750 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507326a-1219-4da1-b569-15aec3b09716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:00.383546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 316/635] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:00.384476 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968810f5-6116-4313-a5bc-87d5f90cc686 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:00.399610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-1507326a-1219-4da1-b569-15aec3b09716 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:00.401065 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-1507326a-1219-4da1-b569-15aec3b09716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:00.488436 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 320/636] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:42:00.495549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507326a-1219-4da1-b569-15aec3b09716 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:00.495675 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968810f5-6116-4313-a5bc-87d5f90cc686 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:00.530560 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380b515-83df-4af6-b761-e276556a36ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:00.531825 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380b515-83df-4af6-b761-e276556a36ef None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:00.532111 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380b515-83df-4af6-b761-e276556a36ef None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:00.532574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380b515-83df-4af6-b761-e276556a36ef None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:00.533297 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380b515-83df-4af6-b761-e276556a36ef None admin] RBAC: Adding query filter params (name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:00.533662 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380b515-83df-4af6-b761-e276556a36ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:00.535032 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380b515-83df-4af6-b761-e276556a36ef None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:00.543324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 317/637] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:42:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:00.544467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfb7dc-8405-4942-ad74-d8011dc9c131 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:00.544758 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfb7dc-8405-4942-ad74-d8011dc9c131 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:00.545038 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfb7dc-8405-4942-ad74-d8011dc9c131 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:00.551052 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 318/638] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:00.551052 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfb7dc-8405-4942-ad74-d8011dc9c131 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:00.606477 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507326a-1219-4da1-b569-15aec3b09716 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:00.639828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341b59f-e42f-4e68-9cef-17d6acbe6155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:00.640629 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341b59f-e42f-4e68-9cef-17d6acbe6155 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:00.640905 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341b59f-e42f-4e68-9cef-17d6acbe6155 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:00.641181 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341b59f-e42f-4e68-9cef-17d6acbe6155 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:00.646768 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfb7dc-8405-4942-ad74-d8011dc9c131 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:00.648001 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341b59f-e42f-4e68-9cef-17d6acbe6155 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:00.649470 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341b59f-e42f-4e68-9cef-17d6acbe6155 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:00.663000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-3341b59f-e42f-4e68-9cef-17d6acbe6155 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:00.668581 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 321/639] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:00.668581 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341b59f-e42f-4e68-9cef-17d6acbe6155 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:00.683672 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551446c-ba5e-4be1-9294-4898e2f661b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:00.684467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551446c-ba5e-4be1-9294-4898e2f661b0 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:00.684744 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551446c-ba5e-4be1-9294-4898e2f661b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:00.685015 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551446c-ba5e-4be1-9294-4898e2f661b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:00.695729 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551446c-ba5e-4be1-9294-4898e2f661b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:00.702615 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-2551446c-ba5e-4be1-9294-4898e2f661b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:42:00.708647 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 319/640] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:42:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:00.708647 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7294f2-5445-4500-8820-5566811e6aa2 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:00.708647 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7294f2-5445-4500-8820-5566811e6aa2 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:00.708647 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7294f2-5445-4500-8820-5566811e6aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:00.723603 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-2f7294f2-5445-4500-8820-5566811e6aa2 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:00.724779 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-2f7294f2-5445-4500-8820-5566811e6aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:00.766825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341b59f-e42f-4e68-9cef-17d6acbe6155 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:00.798510 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 320/641] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:42:00.799285 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7294f2-5445-4500-8820-5566811e6aa2 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:00.808858 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a599a-639b-4308-9d1e-b1e9373be350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:00.809888 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a599a-639b-4308-9d1e-b1e9373be350 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:00.810352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a599a-639b-4308-9d1e-b1e9373be350 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:00.810624 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a599a-639b-4308-9d1e-b1e9373be350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:00.824061 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a599a-639b-4308-9d1e-b1e9373be350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:00.825510 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a599a-639b-4308-9d1e-b1e9373be350 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:00.842162 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-f88a599a-639b-4308-9d1e-b1e9373be350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:00.843501 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 322/642] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:00.844433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a599a-639b-4308-9d1e-b1e9373be350 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:00.912246 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7294f2-5445-4500-8820-5566811e6aa2 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:00.941182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a599a-639b-4308-9d1e-b1e9373be350 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:00.944849 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f72b3-f8e6-4b23-8ad7-90c8986c43bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:00.945519 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f72b3-f8e6-4b23-8ad7-90c8986c43bf None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:00.945800 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f72b3-f8e6-4b23-8ad7-90c8986c43bf None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:00.946076 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f72b3-f8e6-4b23-8ad7-90c8986c43bf None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:00.946860 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f72b3-f8e6-4b23-8ad7-90c8986c43bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:00.947169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f72b3-f8e6-4b23-8ad7-90c8986c43bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:00.948648 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f72b3-f8e6-4b23-8ad7-90c8986c43bf None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:00.964552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 321/643] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:00.964552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f72b3-f8e6-4b23-8ad7-90c8986c43bf None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:00.979080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498bc02-15c4-4634-893f-3e4229541dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:00.979893 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498bc02-15c4-4634-893f-3e4229541dbf None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:00.980234 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498bc02-15c4-4634-893f-3e4229541dbf None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:00.980674 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498bc02-15c4-4634-893f-3e4229541dbf None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:00.981505 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498bc02-15c4-4634-893f-3e4229541dbf None admin] RBAC: Adding query filter params (name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:00.981883 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498bc02-15c4-4634-893f-3e4229541dbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:00.983328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498bc02-15c4-4634-893f-3e4229541dbf None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:00.997003 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 323/644] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:42:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:00.997003 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498bc02-15c4-4634-893f-3e4229541dbf None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:01.063629 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f72b3-f8e6-4b23-8ad7-90c8986c43bf None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:01.094095 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498bc02-15c4-4634-893f-3e4229541dbf None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:01.101641 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b69d81-386b-41bc-b405-08ab4f77512a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:01.102810 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b69d81-386b-41bc-b405-08ab4f77512a None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:01.103095 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b69d81-386b-41bc-b405-08ab4f77512a None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:01.103368 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b69d81-386b-41bc-b405-08ab4f77512a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:01.116375 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b69d81-386b-41bc-b405-08ab4f77512a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:01.123494 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-49b69d81-386b-41bc-b405-08ab4f77512a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:42:01.128053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ff4b1-020a-4d5f-9a6a-c91e938826fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:01.128713 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ff4b1-020a-4d5f-9a6a-c91e938826fe None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:01.128997 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ff4b1-020a-4d5f-9a6a-c91e938826fe None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:01.129272 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ff4b1-020a-4d5f-9a6a-c91e938826fe None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:01.129860 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 322/645] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:42:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:01.130021 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ff4b1-020a-4d5f-9a6a-c91e938826fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:01.130291 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ff4b1-020a-4d5f-9a6a-c91e938826fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:01.130451 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b69d81-386b-41bc-b405-08ab4f77512a None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:01.131705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ff4b1-020a-4d5f-9a6a-c91e938826fe None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:01.145385 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 324/646] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:01.146228 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ff4b1-020a-4d5f-9a6a-c91e938826fe None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:01.242146 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ff4b1-020a-4d5f-9a6a-c91e938826fe None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:01.243225 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b69d81-386b-41bc-b405-08ab4f77512a None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:01.275368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e477d6e-f4aa-4006-82d7-367f837e2cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:01.276283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e477d6e-f4aa-4006-82d7-367f837e2cd3 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:01.276573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e477d6e-f4aa-4006-82d7-367f837e2cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:01.276843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e477d6e-f4aa-4006-82d7-367f837e2cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:01.278038 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78e321-1bfa-4180-a92f-f2ecf045bafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:01.279036 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78e321-1bfa-4180-a92f-f2ecf045bafc None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:01.279803 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78e321-1bfa-4180-a92f-f2ecf045bafc None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:01.280227 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78e321-1bfa-4180-a92f-f2ecf045bafc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:01.281193 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78e321-1bfa-4180-a92f-f2ecf045bafc None admin] RBAC: Adding query filter params (role.id=b34db25ec52b41a7bb7691d839e68c53, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=534fd902f96043068e99ca0537cf57c5) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:01.281649 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78e321-1bfa-4180-a92f-f2ecf045bafc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:01.284411 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78e321-1bfa-4180-a92f-f2ecf045bafc None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:01.287437 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e477d6e-f4aa-4006-82d7-367f837e2cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:01.288927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e477d6e-f4aa-4006-82d7-367f837e2cd3 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:01.299865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 323/647] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:01 2022] GET /identity/v3/role_assignments?user.id=534fd902f96043068e99ca0537cf57c5&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=b34db25ec52b41a7bb7691d839e68c53 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:01.299865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78e321-1bfa-4180-a92f-f2ecf045bafc None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:01.322685 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-6e477d6e-f4aa-4006-82d7-367f837e2cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:01.324509 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 325/648] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:01.325369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e477d6e-f4aa-4006-82d7-367f837e2cd3 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:01.417679 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78e321-1bfa-4180-a92f-f2ecf045bafc None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:01.454167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb596-6d8d-4df5-aa60-bacae3b222a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:01.454925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb596-6d8d-4df5-aa60-bacae3b222a1 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:01.455243 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb596-6d8d-4df5-aa60-bacae3b222a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:01.455561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb596-6d8d-4df5-aa60-bacae3b222a1 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:01.456340 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fb596-6d8d-4df5-aa60-bacae3b222a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:01.456653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fb596-6d8d-4df5-aa60-bacae3b222a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:01.458056 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fb596-6d8d-4df5-aa60-bacae3b222a1 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:01.464607 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e477d6e-f4aa-4006-82d7-367f837e2cd3 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:01.469489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 324/649] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:42:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:01.470469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb596-6d8d-4df5-aa60-bacae3b222a1 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:01.518129 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade9ac7-223c-4b9a-9738-0fadcefb1152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:01.519021 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade9ac7-223c-4b9a-9738-0fadcefb1152 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:01.519302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade9ac7-223c-4b9a-9738-0fadcefb1152 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:01.520343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade9ac7-223c-4b9a-9738-0fadcefb1152 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:01.529036 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade9ac7-223c-4b9a-9738-0fadcefb1152 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:01.530501 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade9ac7-223c-4b9a-9738-0fadcefb1152 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:01.544987 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-3ade9ac7-223c-4b9a-9738-0fadcefb1152 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 08 11:42:01.546351 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 326/650] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:42:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:01.547050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade9ac7-223c-4b9a-9738-0fadcefb1152 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:01.599791 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb596-6d8d-4df5-aa60-bacae3b222a1 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:01.639415 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afabea6-87f5-400d-91a1-e9a9a72df250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:01.640132 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afabea6-87f5-400d-91a1-e9a9a72df250 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:01.640414 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afabea6-87f5-400d-91a1-e9a9a72df250 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:01.640692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afabea6-87f5-400d-91a1-e9a9a72df250 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:01.641410 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afabea6-87f5-400d-91a1-e9a9a72df250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:01.641723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afabea6-87f5-400d-91a1-e9a9a72df250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:01.647687 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afabea6-87f5-400d-91a1-e9a9a72df250 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:01.655849 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade9ac7-223c-4b9a-9738-0fadcefb1152 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:01.659762 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 325/651] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:01.660826 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afabea6-87f5-400d-91a1-e9a9a72df250 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:01.690280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affa540-71db-4f43-a909-d4890db39ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:01.691281 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affa540-71db-4f43-a909-d4890db39ac8 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:01.691726 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affa540-71db-4f43-a909-d4890db39ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:01.691965 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affa540-71db-4f43-a909-d4890db39ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:01.704655 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affa540-71db-4f43-a909-d4890db39ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:01.707237 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affa540-71db-4f43-a909-d4890db39ac8 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:01.727955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-6affa540-71db-4f43-a909-d4890db39ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:01.735571 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 327/652] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:01.735571 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affa540-71db-4f43-a909-d4890db39ac8 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:01.787352 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afabea6-87f5-400d-91a1-e9a9a72df250 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:01.822200 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f885f-ccf7-4ac5-ba62-224729399849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:01.822882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f885f-ccf7-4ac5-ba62-224729399849 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:01.823164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f885f-ccf7-4ac5-ba62-224729399849 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:01.823438 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f885f-ccf7-4ac5-ba62-224729399849 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:01.824310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f885f-ccf7-4ac5-ba62-224729399849 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:01.824616 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f885f-ccf7-4ac5-ba62-224729399849 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:01.826053 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f885f-ccf7-4ac5-ba62-224729399849 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:01.837950 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affa540-71db-4f43-a909-d4890db39ac8 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:01.844121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 326/653] 10.222.0.52 () {56 vars in 1139 bytes} [Tue Mar 8 11:42:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:01.844967 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f885f-ccf7-4ac5-ba62-224729399849 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:01.876546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a835b67-88e8-471e-be1d-b8be1a704a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:01.877908 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a835b67-88e8-471e-be1d-b8be1a704a1f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:01.878196 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a835b67-88e8-471e-be1d-b8be1a704a1f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:01.878542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a835b67-88e8-471e-be1d-b8be1a704a1f None admin] PATH_INFO: `/v3/users/glance` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:01.887541 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a835b67-88e8-471e-be1d-b8be1a704a1f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:01.889109 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a835b67-88e8-471e-be1d-b8be1a704a1f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:01.903473 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-5a835b67-88e8-471e-be1d-b8be1a704a1f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 08 11:42:01.905045 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 328/654] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:42:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:01.905830 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a835b67-88e8-471e-be1d-b8be1a704a1f None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:01.947465 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f885f-ccf7-4ac5-ba62-224729399849 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:01.983140 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b6bac-3a74-46ef-91cf-670c63835cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:01.983842 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b6bac-3a74-46ef-91cf-670c63835cf5 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:01.984123 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b6bac-3a74-46ef-91cf-670c63835cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:01.984400 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b6bac-3a74-46ef-91cf-670c63835cf5 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:01.985117 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b6bac-3a74-46ef-91cf-670c63835cf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:01.985424 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b6bac-3a74-46ef-91cf-670c63835cf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:01.986857 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b6bac-3a74-46ef-91cf-670c63835cf5 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:02.003179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 327/655] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:02.004167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b6bac-3a74-46ef-91cf-670c63835cf5 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:02.026678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a835b67-88e8-471e-be1d-b8be1a704a1f None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:02.079590 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c31f52-7033-4daf-8a5d-e8f2965d6724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:02.082432 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c31f52-7033-4daf-8a5d-e8f2965d6724 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:02.082717 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c31f52-7033-4daf-8a5d-e8f2965d6724 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:02.082998 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c31f52-7033-4daf-8a5d-e8f2965d6724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:02.113998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b6bac-3a74-46ef-91cf-670c63835cf5 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:02.155068 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d002f5d-f613-4c47-a11c-a64c25deedac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:02.155692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d002f5d-f613-4c47-a11c-a64c25deedac None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:02.156039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d002f5d-f613-4c47-a11c-a64c25deedac None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:02.156318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d002f5d-f613-4c47-a11c-a64c25deedac None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:02.157212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d002f5d-f613-4c47-a11c-a64c25deedac None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:02.157525 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d002f5d-f613-4c47-a11c-a64c25deedac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:02.159412 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d002f5d-f613-4c47-a11c-a64c25deedac None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:02.166876 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c31f52-7033-4daf-8a5d-e8f2965d6724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:02.168549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c31f52-7033-4daf-8a5d-e8f2965d6724 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:02.177827 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 328/656] 10.222.0.52 () {56 vars in 1137 bytes} [Tue Mar 8 11:42:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:02.178941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d002f5d-f613-4c47-a11c-a64c25deedac None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:02.292295 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d002f5d-f613-4c47-a11c-a64c25deedac None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:02.303680 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 329/657] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:42:02.304559 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c31f52-7033-4daf-8a5d-e8f2965d6724 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:02.331793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef8436-73b4-4aaa-8d01-fb77dafa1bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:02.332880 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef8436-73b4-4aaa-8d01-fb77dafa1bc2 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:02.333167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef8436-73b4-4aaa-8d01-fb77dafa1bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:02.333446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef8436-73b4-4aaa-8d01-fb77dafa1bc2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:02.342894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef8436-73b4-4aaa-8d01-fb77dafa1bc2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:02.345351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef8436-73b4-4aaa-8d01-fb77dafa1bc2 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:02.364362 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-63ef8436-73b4-4aaa-8d01-fb77dafa1bc2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 11:42:02.367604 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 329/658] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:42:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:02.368448 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef8436-73b4-4aaa-8d01-fb77dafa1bc2 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:02.433211 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c31f52-7033-4daf-8a5d-e8f2965d6724 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:02.467083 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb2386-0467-4e06-8653-837803a8af22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:02.467772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb2386-0467-4e06-8653-837803a8af22 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:02.468050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb2386-0467-4e06-8653-837803a8af22 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:02.468320 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb2386-0467-4e06-8653-837803a8af22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:02.493926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef8436-73b4-4aaa-8d01-fb77dafa1bc2 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:02.539740 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb2386-0467-4e06-8653-837803a8af22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:02.540818 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b92ae-7f5b-4fef-9bbd-d778d81f1129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:02.541198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb2386-0467-4e06-8653-837803a8af22 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:02.541619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b92ae-7f5b-4fef-9bbd-d778d81f1129 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:02.541903 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b92ae-7f5b-4fef-9bbd-d778d81f1129 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:02.542179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b92ae-7f5b-4fef-9bbd-d778d81f1129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:02.554965 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b92ae-7f5b-4fef-9bbd-d778d81f1129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:02.557099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b92ae-7f5b-4fef-9bbd-d778d81f1129 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:02.579187 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-217b92ae-7f5b-4fef-9bbd-d778d81f1129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:02.582284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 330/659] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:02.583241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b92ae-7f5b-4fef-9bbd-d778d81f1129 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:02.648671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 330/660] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:42:02.648671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb2386-0467-4e06-8653-837803a8af22 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:02.694318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b92ae-7f5b-4fef-9bbd-d778d81f1129 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:02.745355 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b942d-477e-4d66-9578-c5e88790553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:02.746039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b942d-477e-4d66-9578-c5e88790553a None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:02.746325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b942d-477e-4d66-9578-c5e88790553a None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:02.746601 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b942d-477e-4d66-9578-c5e88790553a None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:02.747443 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b942d-477e-4d66-9578-c5e88790553a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:02.747785 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b942d-477e-4d66-9578-c5e88790553a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:02.749226 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b942d-477e-4d66-9578-c5e88790553a None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:02.762491 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb2386-0467-4e06-8653-837803a8af22 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:02.772137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 331/661] 10.222.0.52 () {56 vars in 1137 bytes} [Tue Mar 8 11:42:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:02.772137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c1313-2d22-4ba2-8d73-d50e3f144df5 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:02.772137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c1313-2d22-4ba2-8d73-d50e3f144df5 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:02.772137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c1313-2d22-4ba2-8d73-d50e3f144df5 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:02.772137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 332/662] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:02.772860 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c1313-2d22-4ba2-8d73-d50e3f144df5 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:02.804401 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01352858-88da-4569-862e-e4a4ac34fc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:02.805065 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01352858-88da-4569-862e-e4a4ac34fc79 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:02.805344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01352858-88da-4569-862e-e4a4ac34fc79 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:02.805625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01352858-88da-4569-862e-e4a4ac34fc79 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:02.806334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01352858-88da-4569-862e-e4a4ac34fc79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:02.806641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01352858-88da-4569-862e-e4a4ac34fc79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:02.808053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01352858-88da-4569-862e-e4a4ac34fc79 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:02.821320 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 331/663] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:02.822114 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01352858-88da-4569-862e-e4a4ac34fc79 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:02.882950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c1313-2d22-4ba2-8d73-d50e3f144df5 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:02.915487 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e54192-7e56-4473-815a-94179b2494c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:02.916303 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e54192-7e56-4473-815a-94179b2494c1 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:02.916580 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e54192-7e56-4473-815a-94179b2494c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:02.916994 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e54192-7e56-4473-815a-94179b2494c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:02.923894 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01352858-88da-4569-862e-e4a4ac34fc79 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:02.927996 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e54192-7e56-4473-815a-94179b2494c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:02.929440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e54192-7e56-4473-815a-94179b2494c1 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:02.946491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-58e54192-7e56-4473-815a-94179b2494c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:02.951991 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 333/664] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:02.951991 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a416f-6dfd-49a9-b343-955ce4bcf6af None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:02.951991 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a416f-6dfd-49a9-b343-955ce4bcf6af None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:02.951991 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a416f-6dfd-49a9-b343-955ce4bcf6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:02.961565 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500e45-c070-458e-ad98-ca7d74af4a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:02.962253 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500e45-c070-458e-ad98-ca7d74af4a93 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:02.962492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500e45-c070-458e-ad98-ca7d74af4a93 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:02.962764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500e45-c070-458e-ad98-ca7d74af4a93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:02.966379 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-793a416f-6dfd-49a9-b343-955ce4bcf6af None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:02.967580 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-793a416f-6dfd-49a9-b343-955ce4bcf6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:03.031459 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1500e45-c070-458e-ad98-ca7d74af4a93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:03.034233 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1500e45-c070-458e-ad98-ca7d74af4a93 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:03.035379 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 334/665] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:42:03.036425 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a416f-6dfd-49a9-b343-955ce4bcf6af None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:03.135637 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 332/666] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:42:03.136850 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500e45-c070-458e-ad98-ca7d74af4a93 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:03.153110 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a416f-6dfd-49a9-b343-955ce4bcf6af None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:03.198264 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce7285-f770-44c9-9de2-9f7ff31c176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:03.199013 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce7285-f770-44c9-9de2-9f7ff31c176b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:03.199294 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce7285-f770-44c9-9de2-9f7ff31c176b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:03.199594 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce7285-f770-44c9-9de2-9f7ff31c176b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:03.207616 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce7285-f770-44c9-9de2-9f7ff31c176b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:03.209097 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce7285-f770-44c9-9de2-9f7ff31c176b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:03.222166 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-69ce7285-f770-44c9-9de2-9f7ff31c176b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:03.227846 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 335/667] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:03.227846 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce7285-f770-44c9-9de2-9f7ff31c176b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:03.243249 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500e45-c070-458e-ad98-ca7d74af4a93 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:03.277811 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c4a19-5003-4b67-a358-6fc25e689647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:03.278482 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c4a19-5003-4b67-a358-6fc25e689647 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:03.278759 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c4a19-5003-4b67-a358-6fc25e689647 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:03.279034 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c4a19-5003-4b67-a358-6fc25e689647 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:03.279777 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c4a19-5003-4b67-a358-6fc25e689647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:03.280090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c4a19-5003-4b67-a358-6fc25e689647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:03.281498 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c4a19-5003-4b67-a358-6fc25e689647 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:03.292394 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 333/668] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:03.293195 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c4a19-5003-4b67-a358-6fc25e689647 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:03.328986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce7285-f770-44c9-9de2-9f7ff31c176b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:03.366212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef3a4e-aae6-4373-8e20-321772180e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:03.367011 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3a4e-aae6-4373-8e20-321772180e15 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:03.367293 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3a4e-aae6-4373-8e20-321772180e15 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:03.367586 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3a4e-aae6-4373-8e20-321772180e15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:03.379178 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef3a4e-aae6-4373-8e20-321772180e15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:03.386226 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-b0ef3a4e-aae6-4373-8e20-321772180e15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:42:03.387413 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 336/669] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:03.391729 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef3a4e-aae6-4373-8e20-321772180e15 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:03.394456 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c4a19-5003-4b67-a358-6fc25e689647 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:03.427176 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac488669-ebca-412b-be6b-8974d0e1f6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:03.427989 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac488669-ebca-412b-be6b-8974d0e1f6e1 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:03.428270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac488669-ebca-412b-be6b-8974d0e1f6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:03.428545 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac488669-ebca-412b-be6b-8974d0e1f6e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:03.438878 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac488669-ebca-412b-be6b-8974d0e1f6e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:03.440965 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac488669-ebca-412b-be6b-8974d0e1f6e1 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:03.458196 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-ac488669-ebca-412b-be6b-8974d0e1f6e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:03.464217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 334/670] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:03.464217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac488669-ebca-412b-be6b-8974d0e1f6e1 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:03.500629 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef3a4e-aae6-4373-8e20-321772180e15 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:03.535323 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fec5b-6b93-4be0-9555-6edc1480494b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:03.536017 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fec5b-6b93-4be0-9555-6edc1480494b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:03.536301 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fec5b-6b93-4be0-9555-6edc1480494b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:03.536575 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fec5b-6b93-4be0-9555-6edc1480494b None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:03.537346 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fec5b-6b93-4be0-9555-6edc1480494b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:03.537655 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fec5b-6b93-4be0-9555-6edc1480494b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:03.539085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fec5b-6b93-4be0-9555-6edc1480494b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:03.555981 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 337/671] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:03.555981 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fec5b-6b93-4be0-9555-6edc1480494b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:03.562481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac488669-ebca-412b-be6b-8974d0e1f6e1 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:03.595117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd72ff-746d-48eb-9948-656f71ccb955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:03.595972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd72ff-746d-48eb-9948-656f71ccb955 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:03.596251 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd72ff-746d-48eb-9948-656f71ccb955 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:03.596521 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd72ff-746d-48eb-9948-656f71ccb955 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:03.603235 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd72ff-746d-48eb-9948-656f71ccb955 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:03.604838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd72ff-746d-48eb-9948-656f71ccb955 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:03.618605 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-27fd72ff-746d-48eb-9948-656f71ccb955 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:03.624453 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 335/672] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:03.624453 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd72ff-746d-48eb-9948-656f71ccb955 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:03.655193 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fec5b-6b93-4be0-9555-6edc1480494b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:03.689911 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c98a44-ef51-4ae8-a1d7-1e350bfdb302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:03.690819 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c98a44-ef51-4ae8-a1d7-1e350bfdb302 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:03.691175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c98a44-ef51-4ae8-a1d7-1e350bfdb302 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:03.691511 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c98a44-ef51-4ae8-a1d7-1e350bfdb302 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:03.692348 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c98a44-ef51-4ae8-a1d7-1e350bfdb302 None admin] RBAC: Adding query filter params (name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:03.692658 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c98a44-ef51-4ae8-a1d7-1e350bfdb302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:03.694042 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c98a44-ef51-4ae8-a1d7-1e350bfdb302 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:03.701783 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 338/673] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:42:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:03.702540 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c98a44-ef51-4ae8-a1d7-1e350bfdb302 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:03.731498 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd72ff-746d-48eb-9948-656f71ccb955 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:03.764438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96220a-6bd1-404a-95d9-22a1b53093e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:03.765093 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96220a-6bd1-404a-95d9-22a1b53093e9 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:03.765373 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96220a-6bd1-404a-95d9-22a1b53093e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:03.765644 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96220a-6bd1-404a-95d9-22a1b53093e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:03.766352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96220a-6bd1-404a-95d9-22a1b53093e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:03.766659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96220a-6bd1-404a-95d9-22a1b53093e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:03.768400 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96220a-6bd1-404a-95d9-22a1b53093e9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:03.785090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 336/674] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:03.785090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96220a-6bd1-404a-95d9-22a1b53093e9 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:03.806447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c98a44-ef51-4ae8-a1d7-1e350bfdb302 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:03.841824 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcedeb-bd7c-4095-a4f4-c5eef378bda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:03.842482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcedeb-bd7c-4095-a4f4-c5eef378bda1 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:03.842765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcedeb-bd7c-4095-a4f4-c5eef378bda1 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:03.843042 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcedeb-bd7c-4095-a4f4-c5eef378bda1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:03.843890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bcedeb-bd7c-4095-a4f4-c5eef378bda1 None admin] RBAC: Adding query filter params (role.id=b34db25ec52b41a7bb7691d839e68c53, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=a5f8507c0ae342f7a3e97b48363ad606) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:03.844203 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bcedeb-bd7c-4095-a4f4-c5eef378bda1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:03.846185 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bcedeb-bd7c-4095-a4f4-c5eef378bda1 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:03.852019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 339/675] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:03 2022] GET /identity/v3/role_assignments?user.id=a5f8507c0ae342f7a3e97b48363ad606&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=b34db25ec52b41a7bb7691d839e68c53 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:03.852674 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcedeb-bd7c-4095-a4f4-c5eef378bda1 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:03.885704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96220a-6bd1-404a-95d9-22a1b53093e9 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:03.922004 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa35970-32b9-40e5-abcd-93ba17c5c00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:03.922675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa35970-32b9-40e5-abcd-93ba17c5c00e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:03.922955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa35970-32b9-40e5-abcd-93ba17c5c00e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:03.923303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa35970-32b9-40e5-abcd-93ba17c5c00e None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:03.924732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa35970-32b9-40e5-abcd-93ba17c5c00e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:03.925038 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa35970-32b9-40e5-abcd-93ba17c5c00e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:03.926659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa35970-32b9-40e5-abcd-93ba17c5c00e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:03.940257 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 337/676] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:03.941900 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa35970-32b9-40e5-abcd-93ba17c5c00e None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:03.960596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcedeb-bd7c-4095-a4f4-c5eef378bda1 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:03.996769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af68bd3-07c0-4482-aae5-914a7bf29eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:03.997505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af68bd3-07c0-4482-aae5-914a7bf29eb4 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:03.997794 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af68bd3-07c0-4482-aae5-914a7bf29eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:03.998073 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af68bd3-07c0-4482-aae5-914a7bf29eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:04.009665 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af68bd3-07c0-4482-aae5-914a7bf29eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:04.011752 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af68bd3-07c0-4482-aae5-914a7bf29eb4 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:04.031093 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-7af68bd3-07c0-4482-aae5-914a7bf29eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:04.032969 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 340/677] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:04.033691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b6f44-3496-4b12-963e-576944f141a0 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:04.034287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b6f44-3496-4b12-963e-576944f141a0 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:04.034287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b6f44-3496-4b12-963e-576944f141a0 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:04.039610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 341/678] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:04.040516 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b6f44-3496-4b12-963e-576944f141a0 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:04.049963 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa35970-32b9-40e5-abcd-93ba17c5c00e None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:04.087331 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0832c-6116-4085-b50d-4c287f635949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:04.088168 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0832c-6116-4085-b50d-4c287f635949 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:04.088449 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0832c-6116-4085-b50d-4c287f635949 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:04.088740 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0832c-6116-4085-b50d-4c287f635949 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:04.095541 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0832c-6116-4085-b50d-4c287f635949 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:04.097064 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0832c-6116-4085-b50d-4c287f635949 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:04.109928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-a3e0832c-6116-4085-b50d-4c287f635949 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:04.111159 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 338/679] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:04.112488 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0832c-6116-4085-b50d-4c287f635949 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:04.159325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b6f44-3496-4b12-963e-576944f141a0 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:04.194420 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b34e5-310c-473b-947e-0c5060cb5d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:04.195133 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b34e5-310c-473b-947e-0c5060cb5d11 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:04.195414 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b34e5-310c-473b-947e-0c5060cb5d11 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:04.195762 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b34e5-310c-473b-947e-0c5060cb5d11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:04.196587 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b34e5-310c-473b-947e-0c5060cb5d11 None admin] RBAC: Adding query filter params (role.id=b34db25ec52b41a7bb7691d839e68c53, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=b65583446d2e40a69dff534b73e8fa7a) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:04.196897 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b34e5-310c-473b-947e-0c5060cb5d11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:04.198366 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b34e5-310c-473b-947e-0c5060cb5d11 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:04.211923 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 342/680] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:04 2022] GET /identity/v3/role_assignments?user.id=b65583446d2e40a69dff534b73e8fa7a&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=b34db25ec52b41a7bb7691d839e68c53 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:04.214497 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d1e42-7e9b-4cab-81b8-81b802b619ca None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:04.215029 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d1e42-7e9b-4cab-81b8-81b802b619ca None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:04.215489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d1e42-7e9b-4cab-81b8-81b802b619ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:04.216189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0832c-6116-4085-b50d-4c287f635949 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:04.242601 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-a50d1e42-7e9b-4cab-81b8-81b802b619ca None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:04.244932 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a50d1e42-7e9b-4cab-81b8-81b802b619ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:04.255442 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0984541-4e4d-44fc-b6b1-fca107eb4a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:04.256207 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0984541-4e4d-44fc-b6b1-fca107eb4a0b None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:04.257001 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0984541-4e4d-44fc-b6b1-fca107eb4a0b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:04.257001 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0984541-4e4d-44fc-b6b1-fca107eb4a0b None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:04.257759 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0984541-4e4d-44fc-b6b1-fca107eb4a0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:04.258135 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0984541-4e4d-44fc-b6b1-fca107eb4a0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:04.259831 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0984541-4e4d-44fc-b6b1-fca107eb4a0b None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:04.274026 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 339/681] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:04.275269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0984541-4e4d-44fc-b6b1-fca107eb4a0b None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:04.335546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 343/682] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:42:04.335546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d1e42-7e9b-4cab-81b8-81b802b619ca None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:04.409897 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0984541-4e4d-44fc-b6b1-fca107eb4a0b None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:04.457834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa746b7-1bf9-4bae-842b-928d7ae3a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:04.459283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa746b7-1bf9-4bae-842b-928d7ae3a142 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:04.459756 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa746b7-1bf9-4bae-842b-928d7ae3a142 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:04.460398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa746b7-1bf9-4bae-842b-928d7ae3a142 None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:04.461473 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa746b7-1bf9-4bae-842b-928d7ae3a142 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:04.462208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa746b7-1bf9-4bae-842b-928d7ae3a142 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:04.463831 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa746b7-1bf9-4bae-842b-928d7ae3a142 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:04.467648 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d1e42-7e9b-4cab-81b8-81b802b619ca None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:04.477673 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 340/683] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:04.478732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa746b7-1bf9-4bae-842b-928d7ae3a142 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:04.508902 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4bb9b-b14b-4c5a-a245-8c455a1c8451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:04.509243 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4bb9b-b14b-4c5a-a245-8c455a1c8451 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:04.509520 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4bb9b-b14b-4c5a-a245-8c455a1c8451 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:04.509789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4bb9b-b14b-4c5a-a245-8c455a1c8451 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:04.518353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4bb9b-b14b-4c5a-a245-8c455a1c8451 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:04.519848 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4bb9b-b14b-4c5a-a245-8c455a1c8451 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:04.536410 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-3cb4bb9b-b14b-4c5a-a245-8c455a1c8451 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 11:42:04.537906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 344/684] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:42:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:04.539360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4bb9b-b14b-4c5a-a245-8c455a1c8451 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:04.600556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa746b7-1bf9-4bae-842b-928d7ae3a142 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:04.642820 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d6c6d-5f28-4524-b0e3-333eae665ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:04.644162 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d6c6d-5f28-4524-b0e3-333eae665ac5 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:04.644582 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d6c6d-5f28-4524-b0e3-333eae665ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:04.644996 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d6c6d-5f28-4524-b0e3-333eae665ac5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:04.645508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4bb9b-b14b-4c5a-a245-8c455a1c8451 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:04.657950 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d6c6d-5f28-4524-b0e3-333eae665ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:04.667196 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-e10d6c6d-5f28-4524-b0e3-333eae665ac5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:42:04.669341 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 341/685] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:42:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:04.670682 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d6c6d-5f28-4524-b0e3-333eae665ac5 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:04.682304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5b568-737e-4d67-8221-75d394ce9abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:04.683150 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b568-737e-4d67-8221-75d394ce9abe None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:04.683551 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b568-737e-4d67-8221-75d394ce9abe None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:04.683965 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b568-737e-4d67-8221-75d394ce9abe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:04.684931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5b568-737e-4d67-8221-75d394ce9abe None admin] RBAC: Adding query filter params (role.id=b34db25ec52b41a7bb7691d839e68c53, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=1c5631271ed54eacbbbbbb5c8d14d764) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:04.685432 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5b568-737e-4d67-8221-75d394ce9abe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:04.687047 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5b568-737e-4d67-8221-75d394ce9abe None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:04.699690 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 345/686] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:04 2022] GET /identity/v3/role_assignments?user.id=1c5631271ed54eacbbbbbb5c8d14d764&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=b34db25ec52b41a7bb7691d839e68c53 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:04.700813 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5b568-737e-4d67-8221-75d394ce9abe None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:04.815409 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d6c6d-5f28-4524-b0e3-333eae665ac5 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:04.859658 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5b568-737e-4d67-8221-75d394ce9abe None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:04.902751 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369d438-e166-420a-ad76-1e5411c9e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:04.903851 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369d438-e166-420a-ad76-1e5411c9e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:04.904344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369d438-e166-420a-ad76-1e5411c9e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:04.904953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369d438-e166-420a-ad76-1e5411c9e2b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:04.905896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369d438-e166-420a-ad76-1e5411c9e2b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:04.906393 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369d438-e166-420a-ad76-1e5411c9e2b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:04.908012 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369d438-e166-420a-ad76-1e5411c9e2b6 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:04.909430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e91b3-4c7b-4cb7-af6a-25e2ff2947c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:04.910108 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e91b3-4c7b-4cb7-af6a-25e2ff2947c6 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:04.910387 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e91b3-4c7b-4cb7-af6a-25e2ff2947c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:04.910661 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e91b3-4c7b-4cb7-af6a-25e2ff2947c6 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:04.911702 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e91b3-4c7b-4cb7-af6a-25e2ff2947c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:04.912776 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e91b3-4c7b-4cb7-af6a-25e2ff2947c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:04.914208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e91b3-4c7b-4cb7-af6a-25e2ff2947c6 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:04.919747 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 346/687] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:42:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:04.925692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369d438-e166-420a-ad76-1e5411c9e2b6 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:04.934106 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 342/688] 10.222.0.52 () {56 vars in 1135 bytes} [Tue Mar 8 11:42:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:04.941188 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e91b3-4c7b-4cb7-af6a-25e2ff2947c6 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:05.040228 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369d438-e166-420a-ad76-1e5411c9e2b6 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:05.041777 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e91b3-4c7b-4cb7-af6a-25e2ff2947c6 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:05.075487 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c4ca1-bc44-48f8-82c7-94a9d69d981d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:05.076336 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c4ca1-bc44-48f8-82c7-94a9d69d981d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:05.076624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c4ca1-bc44-48f8-82c7-94a9d69d981d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:05.076907 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c4ca1-bc44-48f8-82c7-94a9d69d981d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:05.078300 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc100a0b-2322-4445-a41a-96205145a03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:05.079170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc100a0b-2322-4445-a41a-96205145a03a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:05.079675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc100a0b-2322-4445-a41a-96205145a03a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:05.080212 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc100a0b-2322-4445-a41a-96205145a03a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:05.089309 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c4ca1-bc44-48f8-82c7-94a9d69d981d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:05.091811 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c4ca1-bc44-48f8-82c7-94a9d69d981d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:05.108465 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-228c4ca1-bc44-48f8-82c7-94a9d69d981d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:05.110012 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 347/689] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:05.115562 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c4ca1-bc44-48f8-82c7-94a9d69d981d None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:05.177724 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc100a0b-2322-4445-a41a-96205145a03a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:05.179212 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc100a0b-2322-4445-a41a-96205145a03a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:05.280090 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c4ca1-bc44-48f8-82c7-94a9d69d981d None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:05.342809 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 343/690] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:42:05.350096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc100a0b-2322-4445-a41a-96205145a03a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:05.358571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce58719-f435-42a5-8e4c-c724662d2791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:05.359254 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce58719-f435-42a5-8e4c-c724662d2791 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:05.359552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce58719-f435-42a5-8e4c-c724662d2791 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:05.359837 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce58719-f435-42a5-8e4c-c724662d2791 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:05.360578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce58719-f435-42a5-8e4c-c724662d2791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:05.360887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce58719-f435-42a5-8e4c-c724662d2791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:05.363085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce58719-f435-42a5-8e4c-c724662d2791 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:05.393084 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 348/691] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:05.400144 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce58719-f435-42a5-8e4c-c724662d2791 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:05.467180 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc100a0b-2322-4445-a41a-96205145a03a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:05.501655 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb0cb2-95b0-416f-99cd-7f4352f45f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:05.502491 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb0cb2-95b0-416f-99cd-7f4352f45f13 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:05.502816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb0cb2-95b0-416f-99cd-7f4352f45f13 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:05.503040 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb0cb2-95b0-416f-99cd-7f4352f45f13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:05.513207 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb0cb2-95b0-416f-99cd-7f4352f45f13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:05.514663 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb0cb2-95b0-416f-99cd-7f4352f45f13 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:05.532221 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-ecfb0cb2-95b0-416f-99cd-7f4352f45f13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:05.534500 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 344/692] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:05.540545 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb0cb2-95b0-416f-99cd-7f4352f45f13 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:05.602754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce58719-f435-42a5-8e4c-c724662d2791 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:05.665886 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f7020-7f0b-4521-807b-2ea712099e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:05.666688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f7020-7f0b-4521-807b-2ea712099e4e None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:05.666965 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f7020-7f0b-4521-807b-2ea712099e4e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:05.667238 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f7020-7f0b-4521-807b-2ea712099e4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:05.671637 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb0cb2-95b0-416f-99cd-7f4352f45f13 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:05.684491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f7020-7f0b-4521-807b-2ea712099e4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:05.685946 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f7020-7f0b-4521-807b-2ea712099e4e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:05.708962 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-677f7020-7f0b-4521-807b-2ea712099e4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 11:42:05.711789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 349/693] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 11:42:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:05.717086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f7020-7f0b-4521-807b-2ea712099e4e None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:05.747092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a9d6f-7a9f-49ba-aa43-6e30c426b162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:05.747803 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a9d6f-7a9f-49ba-aa43-6e30c426b162 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:05.748089 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a9d6f-7a9f-49ba-aa43-6e30c426b162 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:05.748370 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a9d6f-7a9f-49ba-aa43-6e30c426b162 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:05.749104 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a9d6f-7a9f-49ba-aa43-6e30c426b162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:05.749414 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a9d6f-7a9f-49ba-aa43-6e30c426b162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:05.750786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a9d6f-7a9f-49ba-aa43-6e30c426b162 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:05.773213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 345/694] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:05.783688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a9d6f-7a9f-49ba-aa43-6e30c426b162 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:05.886645 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a9d6f-7a9f-49ba-aa43-6e30c426b162 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:05.903433 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f7020-7f0b-4521-807b-2ea712099e4e None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:05.924911 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f773c35-f5e5-4616-b747-f76ac4883121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:05.925708 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f773c35-f5e5-4616-b747-f76ac4883121 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:05.925983 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f773c35-f5e5-4616-b747-f76ac4883121 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:05.926252 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f773c35-f5e5-4616-b747-f76ac4883121 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:05.933765 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f773c35-f5e5-4616-b747-f76ac4883121 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:05.935220 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f773c35-f5e5-4616-b747-f76ac4883121 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:05.949127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-8f773c35-f5e5-4616-b747-f76ac4883121 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:05.955074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 346/695] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:05.956390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f773c35-f5e5-4616-b747-f76ac4883121 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:05.989146 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b9fce-e1cf-4453-8110-a9402e8b087c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:05.989840 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b9fce-e1cf-4453-8110-a9402e8b087c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:05.990126 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b9fce-e1cf-4453-8110-a9402e8b087c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:05.990397 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b9fce-e1cf-4453-8110-a9402e8b087c None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:05.991239 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b9fce-e1cf-4453-8110-a9402e8b087c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:05.991566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b9fce-e1cf-4453-8110-a9402e8b087c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:05.993013 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b9fce-e1cf-4453-8110-a9402e8b087c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:06.031212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 350/696] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 11:42:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:06.037360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b9fce-e1cf-4453-8110-a9402e8b087c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:06.063244 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f773c35-f5e5-4616-b747-f76ac4883121 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:06.108512 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce91e02-9255-4aa3-a9bc-af4e5f0c2038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:06.109642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce91e02-9255-4aa3-a9bc-af4e5f0c2038 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:06.110581 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce91e02-9255-4aa3-a9bc-af4e5f0c2038 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:06.110989 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce91e02-9255-4aa3-a9bc-af4e5f0c2038 None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:06.112849 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce91e02-9255-4aa3-a9bc-af4e5f0c2038 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:06.113174 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce91e02-9255-4aa3-a9bc-af4e5f0c2038 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:06.121828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce91e02-9255-4aa3-a9bc-af4e5f0c2038 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:06.153145 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 347/697] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:06.157319 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce91e02-9255-4aa3-a9bc-af4e5f0c2038 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:06.289670 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b9fce-e1cf-4453-8110-a9402e8b087c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:06.290966 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce91e02-9255-4aa3-a9bc-af4e5f0c2038 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:06.326905 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5effb2-e38f-4df6-be56-9d6e88dfaac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:06.327586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5effb2-e38f-4df6-be56-9d6e88dfaac9 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:06.327868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5effb2-e38f-4df6-be56-9d6e88dfaac9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:06.328142 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5effb2-e38f-4df6-be56-9d6e88dfaac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:06.329430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5effb2-e38f-4df6-be56-9d6e88dfaac9 None admin] RBAC: Adding query filter params (role.id=b34db25ec52b41a7bb7691d839e68c53, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=869feb4577be48a683997eab827b1062) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:06.329924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5effb2-e38f-4df6-be56-9d6e88dfaac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:06.331391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5effb2-e38f-4df6-be56-9d6e88dfaac9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:06.344055 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 348/698] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:06 2022] GET /identity/v3/role_assignments?user.id=869feb4577be48a683997eab827b1062&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=b34db25ec52b41a7bb7691d839e68c53 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:06.402665 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f8e1c-7db6-4dd5-88c5-0d81945bde62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:06.403408 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f8e1c-7db6-4dd5-88c5-0d81945bde62 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:06.403668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f8e1c-7db6-4dd5-88c5-0d81945bde62 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:06.403944 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f8e1c-7db6-4dd5-88c5-0d81945bde62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:06.513868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f8e1c-7db6-4dd5-88c5-0d81945bde62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:06.515366 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f8e1c-7db6-4dd5-88c5-0d81945bde62 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:06.617351 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d35803-81ce-46b8-8fac-7ce64dde5d47 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:06.617670 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d35803-81ce-46b8-8fac-7ce64dde5d47 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:06.617903 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d35803-81ce-46b8-8fac-7ce64dde5d47 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:06.620002 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 349/699] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:42:06.625023 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506510b5-88c8-4528-b520-4dcaffe4d935 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:06.625434 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506510b5-88c8-4528-b520-4dcaffe4d935 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:06.625858 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506510b5-88c8-4528-b520-4dcaffe4d935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:06.643405 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 351/700] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 11:42:06.648729 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f8e1c-7db6-4dd5-88c5-0d81945bde62 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:06.656483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-506510b5-88c8-4528-b520-4dcaffe4d935 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:06.658413 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-506510b5-88c8-4528-b520-4dcaffe4d935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:06.746548 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 350/701] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:42:06.761575 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f8e1c-7db6-4dd5-88c5-0d81945bde62 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:06.777629 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506510b5-88c8-4528-b520-4dcaffe4d935 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:06.801384 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e8b93-ab55-465d-a3bf-cf5ce0082609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:06.802628 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e8b93-ab55-465d-a3bf-cf5ce0082609 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:06.803094 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e8b93-ab55-465d-a3bf-cf5ce0082609 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:06.803616 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e8b93-ab55-465d-a3bf-cf5ce0082609 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:06.815564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e8b93-ab55-465d-a3bf-cf5ce0082609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:06.817314 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e8b93-ab55-465d-a3bf-cf5ce0082609 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:06.835049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-d35e8b93-ab55-465d-a3bf-cf5ce0082609 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:06.836875 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 352/702] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:06.842318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e8b93-ab55-465d-a3bf-cf5ce0082609 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:06.888588 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506510b5-88c8-4528-b520-4dcaffe4d935 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:06.927434 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff5544-4bec-4703-bb27-7f19864fd9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:06.928455 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff5544-4bec-4703-bb27-7f19864fd9a5 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:06.929056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff5544-4bec-4703-bb27-7f19864fd9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:06.929435 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff5544-4bec-4703-bb27-7f19864fd9a5 None admin] PATH_INFO: `/v3/services/network` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:06.930163 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff5544-4bec-4703-bb27-7f19864fd9a5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:06.931675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff5544-4bec-4703-bb27-7f19864fd9a5 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:06.947026 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-b5ff5544-4bec-4703-bb27-7f19864fd9a5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 08 11:42:06.948847 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 351/703] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:06 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:06.954703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff5544-4bec-4703-bb27-7f19864fd9a5 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:07.025310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e8b93-ab55-465d-a3bf-cf5ce0082609 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:07.066324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b42b7-9cf7-4570-b584-b64edad18413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:07.066997 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b42b7-9cf7-4570-b584-b64edad18413 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:07.067743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b42b7-9cf7-4570-b584-b64edad18413 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:07.068027 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b42b7-9cf7-4570-b584-b64edad18413 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:07.068754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b42b7-9cf7-4570-b584-b64edad18413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:07.069428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b42b7-9cf7-4570-b584-b64edad18413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:07.071277 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b42b7-9cf7-4570-b584-b64edad18413 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:07.086577 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 353/704] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:07.088447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b61e4-c5c9-4dcd-a973-9ede84d88531 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:07.088874 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b61e4-c5c9-4dcd-a973-9ede84d88531 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:07.089276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b61e4-c5c9-4dcd-a973-9ede84d88531 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:07.091773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 354/705] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:07.092488 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b61e4-c5c9-4dcd-a973-9ede84d88531 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:07.098700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff5544-4bec-4703-bb27-7f19864fd9a5 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:07.139278 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161a8e7-55a4-4331-a940-af8d057e1738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:07.140007 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161a8e7-55a4-4331-a940-af8d057e1738 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:07.140906 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161a8e7-55a4-4331-a940-af8d057e1738 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:07.141198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161a8e7-55a4-4331-a940-af8d057e1738 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:07.141930 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161a8e7-55a4-4331-a940-af8d057e1738 None admin] RBAC: Adding query filter params (name=network) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:07.142843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161a8e7-55a4-4331-a940-af8d057e1738 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:07.144864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161a8e7-55a4-4331-a940-af8d057e1738 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:07.154651 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 352/706] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 11:42:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:07.156626 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bf23b-2f6d-4aac-bd73-95fb1ef863b9 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:07.156913 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bf23b-2f6d-4aac-bd73-95fb1ef863b9 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:07.157185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bf23b-2f6d-4aac-bd73-95fb1ef863b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:07.180802 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-7d0bf23b-2f6d-4aac-bd73-95fb1ef863b9 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:07.181908 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-7d0bf23b-2f6d-4aac-bd73-95fb1ef863b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:07.215828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b61e4-c5c9-4dcd-a973-9ede84d88531 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:07.251500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cfd78-59f3-41a0-8c86-87219c49d737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:07.253019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cfd78-59f3-41a0-8c86-87219c49d737 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:07.253301 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cfd78-59f3-41a0-8c86-87219c49d737 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:07.253624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cfd78-59f3-41a0-8c86-87219c49d737 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:07.260873 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cfd78-59f3-41a0-8c86-87219c49d737 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:07.262503 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cfd78-59f3-41a0-8c86-87219c49d737 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:07.267626 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 353/707] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:42:07.269485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bf23b-2f6d-4aac-bd73-95fb1ef863b9 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:07.287794 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-568cfd78-59f3-41a0-8c86-87219c49d737 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:07.291690 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 355/708] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:07.303007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cfd78-59f3-41a0-8c86-87219c49d737 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:07.385919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bf23b-2f6d-4aac-bd73-95fb1ef863b9 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:07.406991 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cfd78-59f3-41a0-8c86-87219c49d737 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:07.420668 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adf14f-728d-4445-97ae-51e3ceb49790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:07.421348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adf14f-728d-4445-97ae-51e3ceb49790 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:07.421630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adf14f-728d-4445-97ae-51e3ceb49790 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:07.421903 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adf14f-728d-4445-97ae-51e3ceb49790 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:07.422613 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adf14f-728d-4445-97ae-51e3ceb49790 None admin] RBAC: Adding query filter params (type=network) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:07.422919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adf14f-728d-4445-97ae-51e3ceb49790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:07.424883 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adf14f-728d-4445-97ae-51e3ceb49790 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:07.430881 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 354/709] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 11:42:07 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:07.431648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adf14f-728d-4445-97ae-51e3ceb49790 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:07.443353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecd9a5-fcb9-4433-8a51-c5c1802a694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:07.444098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecd9a5-fcb9-4433-8a51-c5c1802a694f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:07.444381 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecd9a5-fcb9-4433-8a51-c5c1802a694f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:07.444651 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecd9a5-fcb9-4433-8a51-c5c1802a694f None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:07.445490 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecd9a5-fcb9-4433-8a51-c5c1802a694f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:07.445796 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecd9a5-fcb9-4433-8a51-c5c1802a694f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:07.447293 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecd9a5-fcb9-4433-8a51-c5c1802a694f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:07.466135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 356/710] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:07.467542 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecd9a5-fcb9-4433-8a51-c5c1802a694f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:07.538700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adf14f-728d-4445-97ae-51e3ceb49790 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:07.573380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecd9a5-fcb9-4433-8a51-c5c1802a694f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:07.574867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fda64c-13f8-493b-8f44-4c6626ff31b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:07.575720 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda64c-13f8-493b-8f44-4c6626ff31b5 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:07.576006 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda64c-13f8-493b-8f44-4c6626ff31b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:07.576282 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda64c-13f8-493b-8f44-4c6626ff31b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:07.587969 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fda64c-13f8-493b-8f44-4c6626ff31b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:07.589462 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fda64c-13f8-493b-8f44-4c6626ff31b5 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:07.606879 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-d4fda64c-13f8-493b-8f44-4c6626ff31b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:07.608446 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 355/711] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:07.613205 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c24d1b-12e8-44be-b9f3-a2df56bbc375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:07.613905 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c24d1b-12e8-44be-b9f3-a2df56bbc375 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:07.614183 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c24d1b-12e8-44be-b9f3-a2df56bbc375 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:07.614454 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c24d1b-12e8-44be-b9f3-a2df56bbc375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:07.615282 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c24d1b-12e8-44be-b9f3-a2df56bbc375 None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=534fd902f96043068e99ca0537cf57c5) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:07.615629 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c24d1b-12e8-44be-b9f3-a2df56bbc375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:07.616728 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fda64c-13f8-493b-8f44-4c6626ff31b5 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:07.617094 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c24d1b-12e8-44be-b9f3-a2df56bbc375 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:07.629226 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 357/712] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:07 2022] GET /identity/v3/role_assignments?user.id=534fd902f96043068e99ca0537cf57c5&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=c2642d38bc964424a5edc330e0d4471d => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:07.631885 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648db9cf-93ce-4523-9071-e38f68cf206c None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:07.632175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648db9cf-93ce-4523-9071-e38f68cf206c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:07.632455 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648db9cf-93ce-4523-9071-e38f68cf206c None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:07.636725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 358/713] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:07.643596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960d0c3-998b-4f05-a4db-adfbc1ab3a75 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:07.644079 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960d0c3-998b-4f05-a4db-adfbc1ab3a75 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:07.644618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960d0c3-998b-4f05-a4db-adfbc1ab3a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:07.665394 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-5960d0c3-998b-4f05-a4db-adfbc1ab3a75 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:07.666889 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5960d0c3-998b-4f05-a4db-adfbc1ab3a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:07.753396 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 359/714] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:42:07.792338 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960d0c3-998b-4f05-a4db-adfbc1ab3a75 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:07.822021 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fda64c-13f8-493b-8f44-4c6626ff31b5 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:07.858431 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202ca7e-0ec9-47a0-9a6c-99b5e3c1d743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:07.859268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202ca7e-0ec9-47a0-9a6c-99b5e3c1d743 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:07.859581 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202ca7e-0ec9-47a0-9a6c-99b5e3c1d743 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:07.859861 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202ca7e-0ec9-47a0-9a6c-99b5e3c1d743 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:07.860891 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202ca7e-0ec9-47a0-9a6c-99b5e3c1d743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:07.861729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202ca7e-0ec9-47a0-9a6c-99b5e3c1d743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:07.863771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202ca7e-0ec9-47a0-9a6c-99b5e3c1d743 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:07.884573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 356/715] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:07.900772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202ca7e-0ec9-47a0-9a6c-99b5e3c1d743 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:07.928807 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960d0c3-998b-4f05-a4db-adfbc1ab3a75 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:07.967670 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bc078-9f34-483a-95cc-56c8307e1c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:07.968893 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bc078-9f34-483a-95cc-56c8307e1c20 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:07.969399 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bc078-9f34-483a-95cc-56c8307e1c20 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:07.969888 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bc078-9f34-483a-95cc-56c8307e1c20 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:07.971371 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bc078-9f34-483a-95cc-56c8307e1c20 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:07.973310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bc078-9f34-483a-95cc-56c8307e1c20 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:07.987686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-9d1bc078-9f34-483a-95cc-56c8307e1c20 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 08 11:42:07.990457 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 360/716] 10.222.0.52 () {56 vars in 1129 bytes} [Tue Mar 8 11:42:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:07.999157 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bc078-9f34-483a-95cc-56c8307e1c20 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:08.116489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202ca7e-0ec9-47a0-9a6c-99b5e3c1d743 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:08.159996 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bc078-9f34-483a-95cc-56c8307e1c20 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:08.183161 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e85dc-85fa-4b24-8eeb-a1fd4ea66a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:08.184100 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e85dc-85fa-4b24-8eeb-a1fd4ea66a79 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:08.184554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e85dc-85fa-4b24-8eeb-a1fd4ea66a79 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:08.185028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e85dc-85fa-4b24-8eeb-a1fd4ea66a79 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:08.185906 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e85dc-85fa-4b24-8eeb-a1fd4ea66a79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:08.187700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e85dc-85fa-4b24-8eeb-a1fd4ea66a79 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:08.219659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21aefb-66bb-4fe5-a31b-9cf716236fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:08.220612 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21aefb-66bb-4fe5-a31b-9cf716236fbb None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:08.223078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21aefb-66bb-4fe5-a31b-9cf716236fbb None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:08.223078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21aefb-66bb-4fe5-a31b-9cf716236fbb None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:08.223078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21aefb-66bb-4fe5-a31b-9cf716236fbb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:08.223078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21aefb-66bb-4fe5-a31b-9cf716236fbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:08.224269 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21aefb-66bb-4fe5-a31b-9cf716236fbb None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:08.229327 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 361/717] 10.222.0.52 () {56 vars in 1124 bytes} [Tue Mar 8 11:42:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:08.236891 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21aefb-66bb-4fe5-a31b-9cf716236fbb None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:08.286071 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 357/718] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:42:07 2022] POST /identity/v3/users => generated 254 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:42:08.357830 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21aefb-66bb-4fe5-a31b-9cf716236fbb None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:08.397931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fb01d-1bcc-491c-8918-8b068d2fb9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:08.398894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fb01d-1bcc-491c-8918-8b068d2fb9b4 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:08.399346 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fb01d-1bcc-491c-8918-8b068d2fb9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:08.400045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fb01d-1bcc-491c-8918-8b068d2fb9b4 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:08.400916 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fb01d-1bcc-491c-8918-8b068d2fb9b4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:08.401446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fb01d-1bcc-491c-8918-8b068d2fb9b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:08.403094 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fb01d-1bcc-491c-8918-8b068d2fb9b4 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:08.413336 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 362/719] 10.222.0.52 () {56 vars in 1124 bytes} [Tue Mar 8 11:42:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:09.276951 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d88e20-0ade-47c9-8f12-0d67478be6f8 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:09.277463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d88e20-0ade-47c9-8f12-0d67478be6f8 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:09.277536 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d88e20-0ade-47c9-8f12-0d67478be6f8 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:09.279549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 358/720] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:09.300511 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289fb57-4f65-4054-8612-81ec09dddc4c None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:09.301102 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289fb57-4f65-4054-8612-81ec09dddc4c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:09.301582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289fb57-4f65-4054-8612-81ec09dddc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:09.324765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-c289fb57-4f65-4054-8612-81ec09dddc4c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:09.325971 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c289fb57-4f65-4054-8612-81ec09dddc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:09.410434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 363/721] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 11:42:09.458479 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d88e20-0ade-47c9-8f12-0d67478be6f8 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:09.608320 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d88e20-0ade-47c9-8f12-0d67478be6f8 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:09.651173 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54015b4-eb9e-4345-b696-fc108354e48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:09.652400 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54015b4-eb9e-4345-b696-fc108354e48a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:09.652891 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54015b4-eb9e-4345-b696-fc108354e48a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:09.653367 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54015b4-eb9e-4345-b696-fc108354e48a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:09.672600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54015b4-eb9e-4345-b696-fc108354e48a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:09.680796 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-c54015b4-eb9e-4345-b696-fc108354e48a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:42:09.682427 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 359/722] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:42:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:09.688461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289fb57-4f65-4054-8612-81ec09dddc4c None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:09.871191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289fb57-4f65-4054-8612-81ec09dddc4c None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:09.915611 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd4ee7-5f56-48c9-a69d-ce6bd408be46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:09.916684 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd4ee7-5f56-48c9-a69d-ce6bd408be46 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:09.917182 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd4ee7-5f56-48c9-a69d-ce6bd408be46 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:09.917654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd4ee7-5f56-48c9-a69d-ce6bd408be46 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:09.918601 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd4ee7-5f56-48c9-a69d-ce6bd408be46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:09.919116 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd4ee7-5f56-48c9-a69d-ce6bd408be46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:09.920722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd4ee7-5f56-48c9-a69d-ce6bd408be46 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:09.930635 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 364/723] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:09.936573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54015b4-eb9e-4345-b696-fc108354e48a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:10.063128 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54015b4-eb9e-4345-b696-fc108354e48a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:10.102999 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2808d-d3ee-4000-ae73-6870ac695877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:10.103826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2808d-d3ee-4000-ae73-6870ac695877 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:10.104107 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2808d-d3ee-4000-ae73-6870ac695877 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:10.104379 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2808d-d3ee-4000-ae73-6870ac695877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:10.114818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2808d-d3ee-4000-ae73-6870ac695877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:10.116315 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2808d-d3ee-4000-ae73-6870ac695877 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:10.144893 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-bea2808d-d3ee-4000-ae73-6870ac695877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:10.146370 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 360/724] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:10.152029 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd4ee7-5f56-48c9-a69d-ce6bd408be46 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:10.214412 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c63229-88a1-4c27-b915-d7d88f8abaa5 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:10.214710 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c63229-88a1-4c27-b915-d7d88f8abaa5 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:10.214971 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c63229-88a1-4c27-b915-d7d88f8abaa5 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:10.217053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 361/725] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:10.225243 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49312b-0108-478c-a457-01195c44d2e5 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:10.225536 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49312b-0108-478c-a457-01195c44d2e5 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:10.225804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49312b-0108-478c-a457-01195c44d2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:10.256620 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-cf49312b-0108-478c-a457-01195c44d2e5 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:10.257850 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-cf49312b-0108-478c-a457-01195c44d2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:10.290189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd4ee7-5f56-48c9-a69d-ce6bd408be46 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:10.325102 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad2ab1-c410-4e56-ae1d-ef782170cc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:10.326026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad2ab1-c410-4e56-ae1d-ef782170cc4d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:10.326488 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad2ab1-c410-4e56-ae1d-ef782170cc4d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:10.326906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad2ab1-c410-4e56-ae1d-ef782170cc4d None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:10.327804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad2ab1-c410-4e56-ae1d-ef782170cc4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:10.328253 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad2ab1-c410-4e56-ae1d-ef782170cc4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:10.329842 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad2ab1-c410-4e56-ae1d-ef782170cc4d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:10.342425 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 365/726] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:10.348359 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad2ab1-c410-4e56-ae1d-ef782170cc4d None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:10.373764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 362/727] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:42:10.444408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49312b-0108-478c-a457-01195c44d2e5 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:10.472292 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad2ab1-c410-4e56-ae1d-ef782170cc4d None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:10.508319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297310e-7e73-4cc5-879d-d075171213da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:10.513067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297310e-7e73-4cc5-879d-d075171213da None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:10.513507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297310e-7e73-4cc5-879d-d075171213da None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:10.513928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297310e-7e73-4cc5-879d-d075171213da None admin] PATH_INFO: `/v3/users/swift` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:10.525857 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297310e-7e73-4cc5-879d-d075171213da None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:10.527720 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297310e-7e73-4cc5-879d-d075171213da None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:10.546162 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-9297310e-7e73-4cc5-879d-d075171213da None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 11:42:10.547894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 366/728] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:42:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:10.553513 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729f3ca-7964-473b-81cc-47fb3ae92296 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:10.554057 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729f3ca-7964-473b-81cc-47fb3ae92296 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:10.554489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729f3ca-7964-473b-81cc-47fb3ae92296 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:10.556688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 367/729] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:10.557540 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729f3ca-7964-473b-81cc-47fb3ae92296 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:10.591148 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49312b-0108-478c-a457-01195c44d2e5 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:10.624600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee3820-24a0-43dd-a8f1-d48e0382cfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:10.625385 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3820-24a0-43dd-a8f1-d48e0382cfc2 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:10.625664 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3820-24a0-43dd-a8f1-d48e0382cfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:10.625932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3820-24a0-43dd-a8f1-d48e0382cfc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:10.636852 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee3820-24a0-43dd-a8f1-d48e0382cfc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:10.644448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-9dee3820-24a0-43dd-a8f1-d48e0382cfc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:42:10.646156 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 363/730] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:42:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:10.647587 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe3da2-07db-4b81-8a55-d473ecee1e36 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:10.648192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe3da2-07db-4b81-8a55-d473ecee1e36 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:10.648606 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe3da2-07db-4b81-8a55-d473ecee1e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:10.661722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729f3ca-7964-473b-81cc-47fb3ae92296 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:10.666348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-09fe3da2-07db-4b81-8a55-d473ecee1e36 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:10.667753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-09fe3da2-07db-4b81-8a55-d473ecee1e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:10.697678 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a49462-1752-45fa-8b40-598b5ebaa9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:10.698273 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a49462-1752-45fa-8b40-598b5ebaa9ec None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:10.698720 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a49462-1752-45fa-8b40-598b5ebaa9ec None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:10.699197 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a49462-1752-45fa-8b40-598b5ebaa9ec None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:10.700234 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a49462-1752-45fa-8b40-598b5ebaa9ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:10.700687 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a49462-1752-45fa-8b40-598b5ebaa9ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:10.702293 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a49462-1752-45fa-8b40-598b5ebaa9ec None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:10.726034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 368/731] 10.222.0.52 () {56 vars in 1135 bytes} [Tue Mar 8 11:42:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:10.727137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a49462-1752-45fa-8b40-598b5ebaa9ec None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:10.743871 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 364/732] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:42:10.744969 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe3da2-07db-4b81-8a55-d473ecee1e36 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:10.832309 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a49462-1752-45fa-8b40-598b5ebaa9ec None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:10.862133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe3da2-07db-4b81-8a55-d473ecee1e36 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:10.867061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3878a91-b0bf-44d6-aa6a-67cca2e5c7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:10.867764 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3878a91-b0bf-44d6-aa6a-67cca2e5c7e5 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:10.868049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3878a91-b0bf-44d6-aa6a-67cca2e5c7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:10.868322 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3878a91-b0bf-44d6-aa6a-67cca2e5c7e5 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:10.869062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3878a91-b0bf-44d6-aa6a-67cca2e5c7e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:10.869368 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3878a91-b0bf-44d6-aa6a-67cca2e5c7e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:10.871186 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3878a91-b0bf-44d6-aa6a-67cca2e5c7e5 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:10.882742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 369/733] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:42:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:10.883684 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3878a91-b0bf-44d6-aa6a-67cca2e5c7e5 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:10.904502 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384019d-3288-4d80-90f0-44d3bacf815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:10.905168 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384019d-3288-4d80-90f0-44d3bacf815e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:10.905500 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384019d-3288-4d80-90f0-44d3bacf815e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:10.905785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384019d-3288-4d80-90f0-44d3bacf815e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:10.990656 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384019d-3288-4d80-90f0-44d3bacf815e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:10.992484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384019d-3288-4d80-90f0-44d3bacf815e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:10.994360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3878a91-b0bf-44d6-aa6a-67cca2e5c7e5 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:11.040475 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ce115-8ca6-4a75-bb04-9fe39b50e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:11.041155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ce115-8ca6-4a75-bb04-9fe39b50e102 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:11.041440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ce115-8ca6-4a75-bb04-9fe39b50e102 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:11.042087 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ce115-8ca6-4a75-bb04-9fe39b50e102 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:11.046104 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ce115-8ca6-4a75-bb04-9fe39b50e102 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:11.046104 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ce115-8ca6-4a75-bb04-9fe39b50e102 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:11.097476 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 365/734] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 11:42:11.098783 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384019d-3288-4d80-90f0-44d3bacf815e None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:11.119724 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 370/735] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 11:42:10 2022] POST /identity/v3/services => generated 240 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:42:11.121117 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ce115-8ca6-4a75-bb04-9fe39b50e102 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:11.247217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384019d-3288-4d80-90f0-44d3bacf815e None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:11.266009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ce115-8ca6-4a75-bb04-9fe39b50e102 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:11.291386 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a086ce7-7090-4b97-8a22-2ceb7a1835f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:11.292616 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a086ce7-7090-4b97-8a22-2ceb7a1835f7 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:11.292899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a086ce7-7090-4b97-8a22-2ceb7a1835f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:11.293178 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a086ce7-7090-4b97-8a22-2ceb7a1835f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:11.304498 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d635b-a73d-4d43-b506-76a9e3e586b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:11.305767 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d635b-a73d-4d43-b506-76a9e3e586b7 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:11.306261 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d635b-a73d-4d43-b506-76a9e3e586b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:11.306742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d635b-a73d-4d43-b506-76a9e3e586b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:11.307620 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a086ce7-7090-4b97-8a22-2ceb7a1835f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:11.309236 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a086ce7-7090-4b97-8a22-2ceb7a1835f7 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:11.318981 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d635b-a73d-4d43-b506-76a9e3e586b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:11.320944 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d635b-a73d-4d43-b506-76a9e3e586b7 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:11.330901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-1a086ce7-7090-4b97-8a22-2ceb7a1835f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:11.339556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 366/736] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:11.339556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9ee6e-0cbd-4888-afba-e9a217fb787b None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:11.339556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9ee6e-0cbd-4888-afba-e9a217fb787b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:11.339556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9ee6e-0cbd-4888-afba-e9a217fb787b None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:11.339556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 367/737] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:11.340424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9ee6e-0cbd-4888-afba-e9a217fb787b None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:11.340722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-209d635b-a73d-4d43-b506-76a9e3e586b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:11.342402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 371/738] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:11.344761 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b47ee-4528-4d8a-9c60-f64d736f297f None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:11.345548 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b47ee-4528-4d8a-9c60-f64d736f297f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:11.345847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b47ee-4528-4d8a-9c60-f64d736f297f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:11.365079 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-0a8b47ee-4528-4d8a-9c60-f64d736f297f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:11.366265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0a8b47ee-4528-4d8a-9c60-f64d736f297f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:11.446391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 372/739] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:11 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 11:42:11.447645 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b47ee-4528-4d8a-9c60-f64d736f297f None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:11.459086 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9ee6e-0cbd-4888-afba-e9a217fb787b None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:11.500735 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cafca-2e85-4605-9ffe-601a6dd4d579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:11.501872 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cafca-2e85-4605-9ffe-601a6dd4d579 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:11.502369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cafca-2e85-4605-9ffe-601a6dd4d579 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:11.502854 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cafca-2e85-4605-9ffe-601a6dd4d579 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:11.503797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cafca-2e85-4605-9ffe-601a6dd4d579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:11.504288 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cafca-2e85-4605-9ffe-601a6dd4d579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:11.505865 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cafca-2e85-4605-9ffe-601a6dd4d579 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:11.518939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 368/740] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:11.520085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cafca-2e85-4605-9ffe-601a6dd4d579 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:11.555613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b47ee-4528-4d8a-9c60-f64d736f297f None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:11.592650 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd371b31-b9f5-4862-8a95-7aa24122b733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:11.593329 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd371b31-b9f5-4862-8a95-7aa24122b733 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:11.593615 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd371b31-b9f5-4862-8a95-7aa24122b733 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:11.593893 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd371b31-b9f5-4862-8a95-7aa24122b733 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:11.594619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd371b31-b9f5-4862-8a95-7aa24122b733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:11.594928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd371b31-b9f5-4862-8a95-7aa24122b733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:11.597321 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd371b31-b9f5-4862-8a95-7aa24122b733 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:11.608485 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 373/741] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:11.609315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd371b31-b9f5-4862-8a95-7aa24122b733 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:11.625341 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cafca-2e85-4605-9ffe-601a6dd4d579 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:11.659976 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7b017-5060-4c83-a779-95100c27d64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:11.660642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7b017-5060-4c83-a779-95100c27d64d None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:11.660931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7b017-5060-4c83-a779-95100c27d64d None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:11.661206 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7b017-5060-4c83-a779-95100c27d64d None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:11.661931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7b017-5060-4c83-a779-95100c27d64d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:11.663312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7b017-5060-4c83-a779-95100c27d64d None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:11.707354 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd371b31-b9f5-4862-8a95-7aa24122b733 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:11.739694 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f29bf5-7fd2-416d-b861-5eb533d18460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:11.740447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f29bf5-7fd2-416d-b861-5eb533d18460 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:11.740726 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f29bf5-7fd2-416d-b861-5eb533d18460 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:11.741006 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f29bf5-7fd2-416d-b861-5eb533d18460 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:11.744821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 369/742] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 11:42:11 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:42:11.746609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466349e-5d36-46ec-a200-69d0c9a8018b None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:11.746609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466349e-5d36-46ec-a200-69d0c9a8018b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:11.746609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466349e-5d36-46ec-a200-69d0c9a8018b None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:11.748238 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 370/743] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:11.749475 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f29bf5-7fd2-416d-b861-5eb533d18460 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:11.751170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f29bf5-7fd2-416d-b861-5eb533d18460 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:11.753512 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466349e-5d36-46ec-a200-69d0c9a8018b None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:11.769616 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-82f29bf5-7fd2-416d-b861-5eb533d18460 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 11:42:11.771077 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 374/744] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 11:42:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:11.772195 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c921fd-1b4e-4a32-87ed-4fdc4adc2dfd None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:11.772479 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c921fd-1b4e-4a32-87ed-4fdc4adc2dfd None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:11.772750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c921fd-1b4e-4a32-87ed-4fdc4adc2dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:11.792046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-e6c921fd-1b4e-4a32-87ed-4fdc4adc2dfd None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:11.792947 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e6c921fd-1b4e-4a32-87ed-4fdc4adc2dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:11.881604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466349e-5d36-46ec-a200-69d0c9a8018b None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:11.884132 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 375/745] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:11.885824 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c921fd-1b4e-4a32-87ed-4fdc4adc2dfd None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:11.922174 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17821a-5e2f-43fc-a30e-a6b5d2c7b835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:11.923421 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17821a-5e2f-43fc-a30e-a6b5d2c7b835 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:11.924122 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17821a-5e2f-43fc-a30e-a6b5d2c7b835 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:11.924659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17821a-5e2f-43fc-a30e-a6b5d2c7b835 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:11.932730 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17821a-5e2f-43fc-a30e-a6b5d2c7b835 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:11.934632 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17821a-5e2f-43fc-a30e-a6b5d2c7b835 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:11.949746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-0b17821a-5e2f-43fc-a30e-a6b5d2c7b835 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:11.956940 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 371/746] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:11.958265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17821a-5e2f-43fc-a30e-a6b5d2c7b835 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:12.018914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c921fd-1b4e-4a32-87ed-4fdc4adc2dfd None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:12.065699 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0faba0a-bc6b-4f94-8936-91cd5b22cf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:12.066371 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faba0a-bc6b-4f94-8936-91cd5b22cf22 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:12.066647 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faba0a-bc6b-4f94-8936-91cd5b22cf22 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:12.066916 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faba0a-bc6b-4f94-8936-91cd5b22cf22 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:12.067787 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0faba0a-bc6b-4f94-8936-91cd5b22cf22 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:12.068095 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0faba0a-bc6b-4f94-8936-91cd5b22cf22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:12.069549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0faba0a-bc6b-4f94-8936-91cd5b22cf22 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:12.087013 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17821a-5e2f-43fc-a30e-a6b5d2c7b835 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:12.088515 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 376/747] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 11:42:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:12.093544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0faba0a-bc6b-4f94-8936-91cd5b22cf22 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:12.133475 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41885e-c43a-42c8-b110-954d062ac3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:12.135577 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41885e-c43a-42c8-b110-954d062ac3c4 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:12.136067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41885e-c43a-42c8-b110-954d062ac3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:12.136537 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41885e-c43a-42c8-b110-954d062ac3c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:12.150715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41885e-c43a-42c8-b110-954d062ac3c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:12.160208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-0e41885e-c43a-42c8-b110-954d062ac3c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:42:12.162539 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 372/748] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:42:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:12.163548 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41885e-c43a-42c8-b110-954d062ac3c4 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:12.215085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0faba0a-bc6b-4f94-8936-91cd5b22cf22 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:12.257387 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dd255-5049-496e-84c7-3e6582646bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:12.258503 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dd255-5049-496e-84c7-3e6582646bc0 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:12.258855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dd255-5049-496e-84c7-3e6582646bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:12.259189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dd255-5049-496e-84c7-3e6582646bc0 None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:12.260041 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dd255-5049-496e-84c7-3e6582646bc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:12.260358 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dd255-5049-496e-84c7-3e6582646bc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:12.261820 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dd255-5049-496e-84c7-3e6582646bc0 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:12.276132 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 377/749] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:12.276953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dd255-5049-496e-84c7-3e6582646bc0 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:12.300433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41885e-c43a-42c8-b110-954d062ac3c4 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:12.334704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcbc48-b854-4f2f-8541-2a7370b886f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:12.335492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcbc48-b854-4f2f-8541-2a7370b886f0 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:12.335797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcbc48-b854-4f2f-8541-2a7370b886f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:12.336073 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcbc48-b854-4f2f-8541-2a7370b886f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:12.346830 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcbc48-b854-4f2f-8541-2a7370b886f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:12.348379 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcbc48-b854-4f2f-8541-2a7370b886f0 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:12.365318 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-5dfcbc48-b854-4f2f-8541-2a7370b886f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:12.366817 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 373/750] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:12.367638 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcbc48-b854-4f2f-8541-2a7370b886f0 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:12.393866 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dd255-5049-496e-84c7-3e6582646bc0 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:12.428111 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa7d17-6cc3-4bcc-a4b9-47d8c4e75e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:12.428789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa7d17-6cc3-4bcc-a4b9-47d8c4e75e32 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:12.429074 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa7d17-6cc3-4bcc-a4b9-47d8c4e75e32 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:12.429350 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa7d17-6cc3-4bcc-a4b9-47d8c4e75e32 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:12.430098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa7d17-6cc3-4bcc-a4b9-47d8c4e75e32 None admin] RBAC: Adding query filter params (name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:12.430407 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa7d17-6cc3-4bcc-a4b9-47d8c4e75e32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:12.431816 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa7d17-6cc3-4bcc-a4b9-47d8c4e75e32 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:12.441345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 378/751] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:42:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:12.442239 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa7d17-6cc3-4bcc-a4b9-47d8c4e75e32 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:12.477343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcbc48-b854-4f2f-8541-2a7370b886f0 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:12.511609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b5f2d-4570-47f6-986c-63d03cf3a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:12.512268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b5f2d-4570-47f6-986c-63d03cf3a629 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:12.512547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b5f2d-4570-47f6-986c-63d03cf3a629 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:12.512823 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b5f2d-4570-47f6-986c-63d03cf3a629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:12.513647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b5f2d-4570-47f6-986c-63d03cf3a629 None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=869feb4577be48a683997eab827b1062) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:12.513959 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b5f2d-4570-47f6-986c-63d03cf3a629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:12.515537 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b5f2d-4570-47f6-986c-63d03cf3a629 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:12.521669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 374/752] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:12 2022] GET /identity/v3/role_assignments?user.id=869feb4577be48a683997eab827b1062&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=c2642d38bc964424a5edc330e0d4471d => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:12.522546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b5f2d-4570-47f6-986c-63d03cf3a629 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:12.552270 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa7d17-6cc3-4bcc-a4b9-47d8c4e75e32 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:12.589553 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd1d33-32c4-4619-beb4-a084e2c7a07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:12.590333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd1d33-32c4-4619-beb4-a084e2c7a07d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:12.590508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd1d33-32c4-4619-beb4-a084e2c7a07d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:12.590769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd1d33-32c4-4619-beb4-a084e2c7a07d None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:12.591497 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd1d33-32c4-4619-beb4-a084e2c7a07d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:12.591828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd1d33-32c4-4619-beb4-a084e2c7a07d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:12.593207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd1d33-32c4-4619-beb4-a084e2c7a07d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:12.606009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 379/753] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:12.612095 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd1d33-32c4-4619-beb4-a084e2c7a07d None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:12.627688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b5f2d-4570-47f6-986c-63d03cf3a629 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:12.663776 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd2bd1-6ce7-403f-bdb2-457aba60b7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:12.664582 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd2bd1-6ce7-403f-bdb2-457aba60b7bd None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:12.664861 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd2bd1-6ce7-403f-bdb2-457aba60b7bd None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:12.665134 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd2bd1-6ce7-403f-bdb2-457aba60b7bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:12.677474 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd2bd1-6ce7-403f-bdb2-457aba60b7bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:12.678948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd2bd1-6ce7-403f-bdb2-457aba60b7bd None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:12.696303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-7ddd2bd1-6ce7-403f-bdb2-457aba60b7bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:12.697922 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 375/754] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:12.703205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd2bd1-6ce7-403f-bdb2-457aba60b7bd None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:12.765728 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd1d33-32c4-4619-beb4-a084e2c7a07d None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:12.822264 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd2bd1-6ce7-403f-bdb2-457aba60b7bd None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:12.857613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb722a6-a120-4a37-ae95-8c5d5078e320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:12.858558 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb722a6-a120-4a37-ae95-8c5d5078e320 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:12.858846 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb722a6-a120-4a37-ae95-8c5d5078e320 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:12.859127 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb722a6-a120-4a37-ae95-8c5d5078e320 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:12.860333 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1315ae0-f1a8-4a0b-9bfb-6f60184b6d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:12.861847 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1315ae0-f1a8-4a0b-9bfb-6f60184b6d86 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:12.862389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1315ae0-f1a8-4a0b-9bfb-6f60184b6d86 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:12.862869 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1315ae0-f1a8-4a0b-9bfb-6f60184b6d86 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:12.863933 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1315ae0-f1a8-4a0b-9bfb-6f60184b6d86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:12.864433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1315ae0-f1a8-4a0b-9bfb-6f60184b6d86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:12.866216 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1315ae0-f1a8-4a0b-9bfb-6f60184b6d86 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:12.877348 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb722a6-a120-4a37-ae95-8c5d5078e320 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:12.878849 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb722a6-a120-4a37-ae95-8c5d5078e320 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:12.883892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 376/755] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:12.885458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1315ae0-f1a8-4a0b-9bfb-6f60184b6d86 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:12.903495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-acb722a6-a120-4a37-ae95-8c5d5078e320 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:12.913247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 380/756] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:12.918581 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb722a6-a120-4a37-ae95-8c5d5078e320 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:12.994022 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1315ae0-f1a8-4a0b-9bfb-6f60184b6d86 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:13.031898 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d0b3b-56d4-46f8-b7c5-fb0b68adacf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:13.034202 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d0b3b-56d4-46f8-b7c5-fb0b68adacf8 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:13.034834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d0b3b-56d4-46f8-b7c5-fb0b68adacf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:13.035319 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d0b3b-56d4-46f8-b7c5-fb0b68adacf8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:13.043187 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d0b3b-56d4-46f8-b7c5-fb0b68adacf8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:13.045241 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d0b3b-56d4-46f8-b7c5-fb0b68adacf8 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:13.061652 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-499d0b3b-56d4-46f8-b7c5-fb0b68adacf8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 11:42:13.063477 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 377/757] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 11:42:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:13.069635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d0b3b-56d4-46f8-b7c5-fb0b68adacf8 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:13.178146 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d0b3b-56d4-46f8-b7c5-fb0b68adacf8 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:13.188005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb722a6-a120-4a37-ae95-8c5d5078e320 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:13.246050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16de0dd-e125-49e8-993a-0df1eb9e6940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:13.246731 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16de0dd-e125-49e8-993a-0df1eb9e6940 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:13.247017 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16de0dd-e125-49e8-993a-0df1eb9e6940 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:13.247296 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16de0dd-e125-49e8-993a-0df1eb9e6940 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:13.248169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16de0dd-e125-49e8-993a-0df1eb9e6940 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:13.248482 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16de0dd-e125-49e8-993a-0df1eb9e6940 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:13.249916 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16de0dd-e125-49e8-993a-0df1eb9e6940 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:13.257620 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e8dd2-b6d1-4f57-9fa6-827401ec6226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:13.258558 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e8dd2-b6d1-4f57-9fa6-827401ec6226 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:13.259035 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e8dd2-b6d1-4f57-9fa6-827401ec6226 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:13.259539 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e8dd2-b6d1-4f57-9fa6-827401ec6226 None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:13.260528 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e8dd2-b6d1-4f57-9fa6-827401ec6226 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:13.261054 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e8dd2-b6d1-4f57-9fa6-827401ec6226 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:13.262674 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e8dd2-b6d1-4f57-9fa6-827401ec6226 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:13.282127 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 381/758] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:13.284394 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 378/759] 10.222.0.52 () {56 vars in 1149 bytes} [Tue Mar 8 11:42:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:13.286698 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e8dd2-b6d1-4f57-9fa6-827401ec6226 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:13.290433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16de0dd-e125-49e8-993a-0df1eb9e6940 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:13.456608 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e8dd2-b6d1-4f57-9fa6-827401ec6226 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:13.461178 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16de0dd-e125-49e8-993a-0df1eb9e6940 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:13.520677 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c928a80-4a8d-4184-bfb8-2387335d969b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:13.521591 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c928a80-4a8d-4184-bfb8-2387335d969b None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:13.521873 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c928a80-4a8d-4184-bfb8-2387335d969b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:13.522157 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c928a80-4a8d-4184-bfb8-2387335d969b None admin] PATH_INFO: `/v3/projects/7c390663688b466f98ff480c31ba21bc/users/534fd902f96043068e99ca0537cf57c5/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:13.523686 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b8ec4-28d3-40c4-82f4-a57e19718c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:13.524583 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b8ec4-28d3-40c4-82f4-a57e19718c33 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:13.524861 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b8ec4-28d3-40c4-82f4-a57e19718c33 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:13.525131 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b8ec4-28d3-40c4-82f4-a57e19718c33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:13.527146 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c928a80-4a8d-4184-bfb8-2387335d969b None admin] RBAC: Authorizing `identity:create_grant(project_id=7c390663688b466f98ff480c31ba21bc, user_id=534fd902f96043068e99ca0537cf57c5, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:13.528606 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c928a80-4a8d-4184-bfb8-2387335d969b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:13.615921 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 382/760] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:42:13 2022] PUT /identity/v3/projects/7c390663688b466f98ff480c31ba21bc/users/534fd902f96043068e99ca0537cf57c5/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:42:13.618435 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b8ec4-28d3-40c4-82f4-a57e19718c33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:13.620347 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b8ec4-28d3-40c4-82f4-a57e19718c33 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:13.729092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 379/761] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:42:13.734979 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c928a80-4a8d-4184-bfb8-2387335d969b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:13.852871 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c928a80-4a8d-4184-bfb8-2387335d969b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:13.853087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f81dc-e5e0-4d55-81a0-6be2bebf86bb None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:13.853343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f81dc-e5e0-4d55-81a0-6be2bebf86bb None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:13.853624 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f81dc-e5e0-4d55-81a0-6be2bebf86bb None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:13.856792 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 380/762] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:13.861284 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56d567-af0d-4391-a55c-daa409fd6ccc None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:13.861570 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56d567-af0d-4391-a55c-daa409fd6ccc None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:13.861846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56d567-af0d-4391-a55c-daa409fd6ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:13.888846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-eb56d567-af0d-4391-a55c-daa409fd6ccc None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:13.891329 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-eb56d567-af0d-4391-a55c-daa409fd6ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:13.936109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9654c-369c-40b9-b599-60d0b68ad7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:13.937311 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9654c-369c-40b9-b599-60d0b68ad7c3 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:13.937765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9654c-369c-40b9-b599-60d0b68ad7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:13.939026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9654c-369c-40b9-b599-60d0b68ad7c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:13.964058 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9654c-369c-40b9-b599-60d0b68ad7c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:13.966317 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9654c-369c-40b9-b599-60d0b68ad7c3 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:13.996200 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-08e9654c-369c-40b9-b599-60d0b68ad7c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:13.998721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 383/763] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:14.004469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9654c-369c-40b9-b599-60d0b68ad7c3 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:14.012036 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 381/764] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:14.037020 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56d567-af0d-4391-a55c-daa409fd6ccc None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:14.160375 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9654c-369c-40b9-b599-60d0b68ad7c3 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:14.197053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56d567-af0d-4391-a55c-daa409fd6ccc None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:14.205721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dcda8-7429-4711-ad6f-e0571c16cb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:14.206662 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dcda8-7429-4711-ad6f-e0571c16cb91 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:14.206788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dcda8-7429-4711-ad6f-e0571c16cb91 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:14.207223 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dcda8-7429-4711-ad6f-e0571c16cb91 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:14.207759 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dcda8-7429-4711-ad6f-e0571c16cb91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:14.208064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dcda8-7429-4711-ad6f-e0571c16cb91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:14.209446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dcda8-7429-4711-ad6f-e0571c16cb91 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:14.231056 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 384/765] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:14.236284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dcda8-7429-4711-ad6f-e0571c16cb91 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:14.246901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedd879-147c-4c35-b764-0538442ec732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:14.247664 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedd879-147c-4c35-b764-0538442ec732 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:14.247941 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedd879-147c-4c35-b764-0538442ec732 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:14.248207 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedd879-147c-4c35-b764-0538442ec732 None admin] PATH_INFO: `/v3/services/network` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:14.248859 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedd879-147c-4c35-b764-0538442ec732 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:14.250258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedd879-147c-4c35-b764-0538442ec732 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:14.265098 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-bfedd879-147c-4c35-b764-0538442ec732 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 08 11:42:14.266470 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 382/766] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:14 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:14.276748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedd879-147c-4c35-b764-0538442ec732 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:14.365228 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dcda8-7429-4711-ad6f-e0571c16cb91 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:14.407832 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c612d-3936-4116-abef-af830bc8fef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:14.408659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c612d-3936-4116-abef-af830bc8fef7 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:14.408939 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c612d-3936-4116-abef-af830bc8fef7 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:14.409208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c612d-3936-4116-abef-af830bc8fef7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:14.426079 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c612d-3936-4116-abef-af830bc8fef7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:14.428176 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c612d-3936-4116-abef-af830bc8fef7 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:14.451105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-117c612d-3936-4116-abef-af830bc8fef7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:14.467729 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 385/767] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:14.469731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c612d-3936-4116-abef-af830bc8fef7 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:14.489466 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedd879-147c-4c35-b764-0538442ec732 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:14.524496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea3e81-37a9-44e0-bdcb-d5e8d0edcffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:14.525198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea3e81-37a9-44e0-bdcb-d5e8d0edcffc None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:14.525349 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea3e81-37a9-44e0-bdcb-d5e8d0edcffc None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:14.525666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea3e81-37a9-44e0-bdcb-d5e8d0edcffc None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:14.526472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea3e81-37a9-44e0-bdcb-d5e8d0edcffc None admin] RBAC: Adding query filter params (name=network) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:14.526829 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea3e81-37a9-44e0-bdcb-d5e8d0edcffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:14.528377 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea3e81-37a9-44e0-bdcb-d5e8d0edcffc None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:14.533812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 383/768] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 11:42:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:14.535121 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39079640-5e31-4842-aa69-852100ce07c1 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:14.535409 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39079640-5e31-4842-aa69-852100ce07c1 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:14.535727 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39079640-5e31-4842-aa69-852100ce07c1 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:14.541390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 384/769] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:14.541390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39079640-5e31-4842-aa69-852100ce07c1 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:14.605977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c612d-3936-4116-abef-af830bc8fef7 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:14.640984 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39079640-5e31-4842-aa69-852100ce07c1 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:14.648338 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c67b37-6601-4016-9e2b-27d8e74a0952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:14.649674 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c67b37-6601-4016-9e2b-27d8e74a0952 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:14.649958 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c67b37-6601-4016-9e2b-27d8e74a0952 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:14.650233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c67b37-6601-4016-9e2b-27d8e74a0952 None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:14.651396 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c67b37-6601-4016-9e2b-27d8e74a0952 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:14.651739 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c67b37-6601-4016-9e2b-27d8e74a0952 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:14.653834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c67b37-6601-4016-9e2b-27d8e74a0952 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:14.670199 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 386/770] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:14.672321 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e391b1-d44f-421f-98af-2751ac733072 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:14.672621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e391b1-d44f-421f-98af-2751ac733072 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:14.673008 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e391b1-d44f-421f-98af-2751ac733072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:14.676767 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096759b-174a-4370-8ab2-b3e1285056d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:14.677487 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096759b-174a-4370-8ab2-b3e1285056d1 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:14.677912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096759b-174a-4370-8ab2-b3e1285056d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:14.678281 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096759b-174a-4370-8ab2-b3e1285056d1 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:14.679132 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096759b-174a-4370-8ab2-b3e1285056d1 None admin] RBAC: Adding query filter params (type=network) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:14.679548 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096759b-174a-4370-8ab2-b3e1285056d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:14.681248 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096759b-174a-4370-8ab2-b3e1285056d1 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:14.686694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 385/771] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 11:42:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:14.687647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096759b-174a-4370-8ab2-b3e1285056d1 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:14.692555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-e1e391b1-d44f-421f-98af-2751ac733072 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:14.693732 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e1e391b1-d44f-421f-98af-2751ac733072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:14.759215 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 387/772] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:14.760101 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e391b1-d44f-421f-98af-2751ac733072 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:14.816061 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096759b-174a-4370-8ab2-b3e1285056d1 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:14.857885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe9564-58c1-48a1-8ec4-6c696fbbc70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:14.858544 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe9564-58c1-48a1-8ec4-6c696fbbc70a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:14.858826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe9564-58c1-48a1-8ec4-6c696fbbc70a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:14.859101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe9564-58c1-48a1-8ec4-6c696fbbc70a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:14.859952 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe9564-58c1-48a1-8ec4-6c696fbbc70a None admin] RBAC: Adding query filter params (role.id=b34db25ec52b41a7bb7691d839e68c53, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=34d5824ea4a54b65a3eaa6deeb9dc416) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:14.860264 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe9564-58c1-48a1-8ec4-6c696fbbc70a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:14.862474 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe9564-58c1-48a1-8ec4-6c696fbbc70a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:14.868472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 386/773] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:14 2022] GET /identity/v3/role_assignments?user.id=34d5824ea4a54b65a3eaa6deeb9dc416&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=b34db25ec52b41a7bb7691d839e68c53 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:14.869446 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe9564-58c1-48a1-8ec4-6c696fbbc70a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:14.893746 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e391b1-d44f-421f-98af-2751ac733072 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:14.945915 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477835b-2c87-4d63-a191-36a1c732a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:14.947038 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477835b-2c87-4d63-a191-36a1c732a329 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:14.947616 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477835b-2c87-4d63-a191-36a1c732a329 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:14.947905 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477835b-2c87-4d63-a191-36a1c732a329 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:14.948867 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477835b-2c87-4d63-a191-36a1c732a329 None admin] RBAC: Adding query filter params (interface=public, service_id=8794d7b19fbc4c6fac41066da8313512, region_id=RegionOne) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:14.949124 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477835b-2c87-4d63-a191-36a1c732a329 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:14.951259 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477835b-2c87-4d63-a191-36a1c732a329 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:14.963649 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 388/774] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 11:42:14 2022] GET /identity/v3/endpoints?service_id=8794d7b19fbc4c6fac41066da8313512&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:14.965287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477835b-2c87-4d63-a191-36a1c732a329 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:14.989331 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe9564-58c1-48a1-8ec4-6c696fbbc70a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:15.025175 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b33df-430d-4f8c-be39-1e5c73c3244f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:15.026331 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b33df-430d-4f8c-be39-1e5c73c3244f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:15.026833 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b33df-430d-4f8c-be39-1e5c73c3244f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:15.027303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b33df-430d-4f8c-be39-1e5c73c3244f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:15.028178 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b33df-430d-4f8c-be39-1e5c73c3244f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:15.029768 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b33df-430d-4f8c-be39-1e5c73c3244f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:15.042662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-486b33df-430d-4f8c-be39-1e5c73c3244f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 08 11:42:15.044724 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 387/775] 10.222.0.52 () {56 vars in 1129 bytes} [Tue Mar 8 11:42:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:15.051369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b33df-430d-4f8c-be39-1e5c73c3244f None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:15.077182 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477835b-2c87-4d63-a191-36a1c732a329 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:15.199559 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b33df-430d-4f8c-be39-1e5c73c3244f None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:15.208277 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7b997-438d-4d35-93f9-873f3894ac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:15.208963 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7b997-438d-4d35-93f9-873f3894ac6f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:15.209240 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7b997-438d-4d35-93f9-873f3894ac6f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:15.209510 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7b997-438d-4d35-93f9-873f3894ac6f None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:15.211561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7b997-438d-4d35-93f9-873f3894ac6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:15.215574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7b997-438d-4d35-93f9-873f3894ac6f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:15.230134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 389/776] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 11:42:14 2022] GET /identity/v3/services => generated 772 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:15.231718 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b528f52-9df9-4d6f-99a3-a013b1ba8b34 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:15.232256 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b528f52-9df9-4d6f-99a3-a013b1ba8b34 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:15.232765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b528f52-9df9-4d6f-99a3-a013b1ba8b34 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:15.236643 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc66979-433a-4a27-ad26-40f962d3b09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:15.237568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc66979-433a-4a27-ad26-40f962d3b09b None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:15.237855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc66979-433a-4a27-ad26-40f962d3b09b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:15.238136 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc66979-433a-4a27-ad26-40f962d3b09b None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:15.238869 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc66979-433a-4a27-ad26-40f962d3b09b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:15.239175 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc66979-433a-4a27-ad26-40f962d3b09b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:15.240850 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 390/777] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:15.240978 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc66979-433a-4a27-ad26-40f962d3b09b None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:15.242763 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed620a5-44d2-44a4-98c7-fc8548641724 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:15.243046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed620a5-44d2-44a4-98c7-fc8548641724 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:15.243423 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed620a5-44d2-44a4-98c7-fc8548641724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:15.246616 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 388/778] 10.222.0.52 () {56 vars in 1124 bytes} [Tue Mar 8 11:42:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:15.252623 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc66979-433a-4a27-ad26-40f962d3b09b None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:15.265363 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-bed620a5-44d2-44a4-98c7-fc8548641724 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:15.266646 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-bed620a5-44d2-44a4-98c7-fc8548641724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:15.393817 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 391/779] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:15.420266 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed620a5-44d2-44a4-98c7-fc8548641724 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:15.433791 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc66979-433a-4a27-ad26-40f962d3b09b None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:15.486923 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f84cc-7aa1-4b8f-91cf-b3cf3ba066d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:15.487990 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f84cc-7aa1-4b8f-91cf-b3cf3ba066d9 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:15.488467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f84cc-7aa1-4b8f-91cf-b3cf3ba066d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:15.488974 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f84cc-7aa1-4b8f-91cf-b3cf3ba066d9 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:15.489868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f84cc-7aa1-4b8f-91cf-b3cf3ba066d9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:15.490365 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f84cc-7aa1-4b8f-91cf-b3cf3ba066d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:15.491979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f84cc-7aa1-4b8f-91cf-b3cf3ba066d9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:15.497509 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 389/780] 10.222.0.52 () {56 vars in 1124 bytes} [Tue Mar 8 11:42:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:15.504593 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f84cc-7aa1-4b8f-91cf-b3cf3ba066d9 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:15.536581 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed620a5-44d2-44a4-98c7-fc8548641724 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:15.582779 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e91fa1-d7c8-41ff-a594-dc985921a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:15.583672 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e91fa1-d7c8-41ff-a594-dc985921a0cb None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:15.584005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e91fa1-d7c8-41ff-a594-dc985921a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:15.584335 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e91fa1-d7c8-41ff-a594-dc985921a0cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:15.597012 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e91fa1-d7c8-41ff-a594-dc985921a0cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:15.606518 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-75e91fa1-d7c8-41ff-a594-dc985921a0cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:42:15.608404 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 392/781] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:42:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:15.616339 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e91fa1-d7c8-41ff-a594-dc985921a0cb None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:15.627887 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f84cc-7aa1-4b8f-91cf-b3cf3ba066d9 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:15.705280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fabc26-11a7-41ec-80cd-49650c7eafc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:15.705970 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fabc26-11a7-41ec-80cd-49650c7eafc5 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:15.706257 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fabc26-11a7-41ec-80cd-49650c7eafc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:15.706540 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fabc26-11a7-41ec-80cd-49650c7eafc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:15.707341 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fabc26-11a7-41ec-80cd-49650c7eafc5 None admin] RBAC: Adding query filter params (interface=public, service_id=fe7d594749b64e9d83b13561b9c5df39, region_id=RegionOne) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:15.707750 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fabc26-11a7-41ec-80cd-49650c7eafc5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:15.710972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fabc26-11a7-41ec-80cd-49650c7eafc5 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:15.726673 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e91fa1-d7c8-41ff-a594-dc985921a0cb None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:15.730842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 390/782] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 11:42:15 2022] GET /identity/v3/endpoints?service_id=fe7d594749b64e9d83b13561b9c5df39&interface=public®ion_id=RegionOne => generated 194 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:15.736408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fabc26-11a7-41ec-80cd-49650c7eafc5 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:15.792269 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcac8eb-f3dc-4971-ba62-34e273e60a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:15.792965 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcac8eb-f3dc-4971-ba62-34e273e60a3b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:15.793247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcac8eb-f3dc-4971-ba62-34e273e60a3b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:15.793523 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcac8eb-f3dc-4971-ba62-34e273e60a3b None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:15.794281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcac8eb-f3dc-4971-ba62-34e273e60a3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:15.794588 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcac8eb-f3dc-4971-ba62-34e273e60a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:15.796017 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcac8eb-f3dc-4971-ba62-34e273e60a3b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:15.805624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 393/783] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:42:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:15.812485 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcac8eb-f3dc-4971-ba62-34e273e60a3b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:15.858998 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fabc26-11a7-41ec-80cd-49650c7eafc5 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:15.924726 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d358065-9b67-4ca2-a5de-78c0593df3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:15.925702 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d358065-9b67-4ca2-a5de-78c0593df3cd None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:15.926163 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d358065-9b67-4ca2-a5de-78c0593df3cd None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:15.926643 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d358065-9b67-4ca2-a5de-78c0593df3cd None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:15.927500 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d358065-9b67-4ca2-a5de-78c0593df3cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:15.929092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d358065-9b67-4ca2-a5de-78c0593df3cd None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:15.939315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcac8eb-f3dc-4971-ba62-34e273e60a3b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:15.939612 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 391/784] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 11:42:15 2022] GET /identity/v3/services => generated 772 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:16.010609 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d1ffc-8d15-4d1f-9ee4-6a9b76880a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:16.011360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d1ffc-8d15-4d1f-9ee4-6a9b76880a50 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:16.011670 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d1ffc-8d15-4d1f-9ee4-6a9b76880a50 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:16.011944 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d1ffc-8d15-4d1f-9ee4-6a9b76880a50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:16.031780 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d1ffc-8d15-4d1f-9ee4-6a9b76880a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:16.033905 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d1ffc-8d15-4d1f-9ee4-6a9b76880a50 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:16.058378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-3c2d1ffc-8d15-4d1f-9ee4-6a9b76880a50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:16.060033 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 394/785] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:16.065445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d358065-9b67-4ca2-a5de-78c0593df3cd None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:16.191338 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d358065-9b67-4ca2-a5de-78c0593df3cd None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:16.226785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba4a8b-3945-48c3-95af-ffc7f37b967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:16.227457 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba4a8b-3945-48c3-95af-ffc7f37b967c None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:16.227770 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba4a8b-3945-48c3-95af-ffc7f37b967c None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:16.228047 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba4a8b-3945-48c3-95af-ffc7f37b967c None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:16.228768 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba4a8b-3945-48c3-95af-ffc7f37b967c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:16.229075 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba4a8b-3945-48c3-95af-ffc7f37b967c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:16.230466 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba4a8b-3945-48c3-95af-ffc7f37b967c None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:16.243197 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 392/786] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:16.248682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d1ffc-8d15-4d1f-9ee4-6a9b76880a50 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:16.432632 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d1ffc-8d15-4d1f-9ee4-6a9b76880a50 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:16.478573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dba58-bb8e-450f-b860-39bf91dc8c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:16.479435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dba58-bb8e-450f-b860-39bf91dc8c39 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:16.479741 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dba58-bb8e-450f-b860-39bf91dc8c39 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:16.480018 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dba58-bb8e-450f-b860-39bf91dc8c39 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:16.493772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dba58-bb8e-450f-b860-39bf91dc8c39 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:16.495220 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dba58-bb8e-450f-b860-39bf91dc8c39 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:16.512974 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-e44dba58-bb8e-450f-b860-39bf91dc8c39 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 11:42:16.514469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 395/787] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:42:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:16.520215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba4a8b-3945-48c3-95af-ffc7f37b967c None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:16.627635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba4a8b-3945-48c3-95af-ffc7f37b967c None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:16.662955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ba4b5-119f-4e69-9880-711b9181ccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:16.664439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ba4b5-119f-4e69-9880-711b9181ccc0 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:16.664925 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ba4b5-119f-4e69-9880-711b9181ccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:16.665399 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ba4b5-119f-4e69-9880-711b9181ccc0 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:16.666445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ba4b5-119f-4e69-9880-711b9181ccc0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:16.666967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ba4b5-119f-4e69-9880-711b9181ccc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:16.668641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ba4b5-119f-4e69-9880-711b9181ccc0 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:16.678568 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fec81-ba6c-4e5e-b564-bdb27dfb090b None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:16.678568 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fec81-ba6c-4e5e-b564-bdb27dfb090b None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:16.678825 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fec81-ba6c-4e5e-b564-bdb27dfb090b None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:16.680622 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 396/788] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:16.685788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e1243-df84-4b27-a722-931439f56ed2 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:16.686013 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e1243-df84-4b27-a722-931439f56ed2 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:16.686288 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e1243-df84-4b27-a722-931439f56ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:16.689194 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 393/789] 10.222.0.52 () {56 vars in 1135 bytes} [Tue Mar 8 11:42:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:16.694087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ba4b5-119f-4e69-9880-711b9181ccc0 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:16.721121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-f40e1243-df84-4b27-a722-931439f56ed2 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:16.722299 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f40e1243-df84-4b27-a722-931439f56ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:16.844000 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 397/790] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:16.849275 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ba4b5-119f-4e69-9880-711b9181ccc0 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:16.900774 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876f0de-8a07-4820-b4cc-26d3c8fd1c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:16.901926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876f0de-8a07-4820-b4cc-26d3c8fd1c1b None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:16.902465 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876f0de-8a07-4820-b4cc-26d3c8fd1c1b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:16.902940 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876f0de-8a07-4820-b4cc-26d3c8fd1c1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:16.905717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e1243-df84-4b27-a722-931439f56ed2 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:16.916566 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876f0de-8a07-4820-b4cc-26d3c8fd1c1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:16.918309 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876f0de-8a07-4820-b4cc-26d3c8fd1c1b None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:16.944729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-5876f0de-8a07-4820-b4cc-26d3c8fd1c1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:16.946119 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 394/791] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:16.951234 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876f0de-8a07-4820-b4cc-26d3c8fd1c1b None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:17.069416 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e1243-df84-4b27-a722-931439f56ed2 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:17.108465 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde7b10-a5ad-4863-89b5-f4017a08c3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:17.109266 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde7b10-a5ad-4863-89b5-f4017a08c3fd None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:17.109561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde7b10-a5ad-4863-89b5-f4017a08c3fd None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:17.109816 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde7b10-a5ad-4863-89b5-f4017a08c3fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:17.121218 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde7b10-a5ad-4863-89b5-f4017a08c3fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:17.129786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-bfde7b10-a5ad-4863-89b5-f4017a08c3fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:42:17.131660 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 398/792] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:17.134529 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876f0de-8a07-4820-b4cc-26d3c8fd1c1b None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:17.144506 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde7b10-a5ad-4863-89b5-f4017a08c3fd None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:17.186374 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656864b-703d-4234-b97e-0d08cd484035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:17.188228 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656864b-703d-4234-b97e-0d08cd484035 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:17.189003 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656864b-703d-4234-b97e-0d08cd484035 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:17.190169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656864b-703d-4234-b97e-0d08cd484035 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:17.191645 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656864b-703d-4234-b97e-0d08cd484035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:17.192334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656864b-703d-4234-b97e-0d08cd484035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:17.195944 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656864b-703d-4234-b97e-0d08cd484035 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:17.219435 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 395/793] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:17.226649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656864b-703d-4234-b97e-0d08cd484035 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:17.323630 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde7b10-a5ad-4863-89b5-f4017a08c3fd None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:17.348163 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656864b-703d-4234-b97e-0d08cd484035 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:17.380695 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb210a-96f0-4b76-8374-decdfc30ca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:17.381401 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb210a-96f0-4b76-8374-decdfc30ca73 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:17.381682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb210a-96f0-4b76-8374-decdfc30ca73 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:17.381953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb210a-96f0-4b76-8374-decdfc30ca73 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:17.382707 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb210a-96f0-4b76-8374-decdfc30ca73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:17.383013 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb210a-96f0-4b76-8374-decdfc30ca73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:17.384491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb210a-96f0-4b76-8374-decdfc30ca73 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:17.385144 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92962c11-e497-4dcb-a676-c1e2d6ec788b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:17.385955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92962c11-e497-4dcb-a676-c1e2d6ec788b None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:17.386276 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92962c11-e497-4dcb-a676-c1e2d6ec788b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:17.386551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92962c11-e497-4dcb-a676-c1e2d6ec788b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:17.394433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92962c11-e497-4dcb-a676-c1e2d6ec788b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:17.396019 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92962c11-e497-4dcb-a676-c1e2d6ec788b None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:17.397912 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 399/794] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:42:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:17.403613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb210a-96f0-4b76-8374-decdfc30ca73 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:17.411061 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-92962c11-e497-4dcb-a676-c1e2d6ec788b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:17.412669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 396/795] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:17.424688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92962c11-e497-4dcb-a676-c1e2d6ec788b None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:17.508823 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb210a-96f0-4b76-8374-decdfc30ca73 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:17.551296 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92962c11-e497-4dcb-a676-c1e2d6ec788b None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:17.561287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607f7fa-f6bc-4ba5-bfc2-517e033158ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:17.562115 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607f7fa-f6bc-4ba5-bfc2-517e033158ab None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:17.562393 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607f7fa-f6bc-4ba5-bfc2-517e033158ab None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:17.562667 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607f7fa-f6bc-4ba5-bfc2-517e033158ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:17.586890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607f7fa-f6bc-4ba5-bfc2-517e033158ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:17.588400 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607f7fa-f6bc-4ba5-bfc2-517e033158ab None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:17.592294 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be4c04-fa59-4a79-a5e7-cf35d8f90627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:17.593012 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be4c04-fa59-4a79-a5e7-cf35d8f90627 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:17.593297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be4c04-fa59-4a79-a5e7-cf35d8f90627 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:17.593568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be4c04-fa59-4a79-a5e7-cf35d8f90627 None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:17.594343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be4c04-fa59-4a79-a5e7-cf35d8f90627 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:17.595270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be4c04-fa59-4a79-a5e7-cf35d8f90627 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:17.596927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be4c04-fa59-4a79-a5e7-cf35d8f90627 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:17.609066 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 397/796] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:17.614802 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be4c04-fa59-4a79-a5e7-cf35d8f90627 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:17.627462 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-8607f7fa-f6bc-4ba5-bfc2-517e033158ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:17.630934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 400/797] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:17.636332 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607f7fa-f6bc-4ba5-bfc2-517e033158ab None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:17.746501 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be4c04-fa59-4a79-a5e7-cf35d8f90627 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:17.790955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b904890-c997-41cf-a1b6-59c64ec00516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:17.791808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b904890-c997-41cf-a1b6-59c64ec00516 None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:17.792087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b904890-c997-41cf-a1b6-59c64ec00516 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:17.792364 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b904890-c997-41cf-a1b6-59c64ec00516 None admin] PATH_INFO: `/v3/projects/7c390663688b466f98ff480c31ba21bc/users/869feb4577be48a683997eab827b1062/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:17.797456 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b904890-c997-41cf-a1b6-59c64ec00516 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c390663688b466f98ff480c31ba21bc, user_id=869feb4577be48a683997eab827b1062, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:17.799790 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b904890-c997-41cf-a1b6-59c64ec00516 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:17.841269 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607f7fa-f6bc-4ba5-bfc2-517e033158ab None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:17.876769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2bc52-6763-436a-9e5d-0dae6960644f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:17.877645 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2bc52-6763-436a-9e5d-0dae6960644f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:17.877724 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2bc52-6763-436a-9e5d-0dae6960644f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:17.877985 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2bc52-6763-436a-9e5d-0dae6960644f None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:17.878708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2bc52-6763-436a-9e5d-0dae6960644f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:17.879104 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2bc52-6763-436a-9e5d-0dae6960644f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:17.881166 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2bc52-6763-436a-9e5d-0dae6960644f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:17.895734 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 398/798] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:42:17 2022] PUT /identity/v3/projects/7c390663688b466f98ff480c31ba21bc/users/869feb4577be48a683997eab827b1062/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:42:17.897574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e5eae-91fd-4898-b401-5d00eaaf083c None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:17.897574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e5eae-91fd-4898-b401-5d00eaaf083c None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:17.897822 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e5eae-91fd-4898-b401-5d00eaaf083c None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:17.903066 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 399/799] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:17.911168 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 401/800] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:17.913231 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4d566-2b53-4a57-888d-4fb4f67d1c66 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:17.913690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4d566-2b53-4a57-888d-4fb4f67d1c66 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:17.914113 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4d566-2b53-4a57-888d-4fb4f67d1c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:17.916584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2bc52-6763-436a-9e5d-0dae6960644f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:17.946787 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-7be4d566-2b53-4a57-888d-4fb4f67d1c66 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:17.948992 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-7be4d566-2b53-4a57-888d-4fb4f67d1c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:18.106140 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 400/801] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:18.120781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d82d0-688f-4345-93f7-f05a7a9c3556 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:18.121289 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d82d0-688f-4345-93f7-f05a7a9c3556 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:18.121874 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d82d0-688f-4345-93f7-f05a7a9c3556 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:18.124755 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 401/802] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:42:18.127683 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2bc52-6763-436a-9e5d-0dae6960644f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:18.130259 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06cade-d791-41c0-b631-59ce620fc7c4 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:18.130872 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06cade-d791-41c0-b631-59ce620fc7c4 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:18.132233 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06cade-d791-41c0-b631-59ce620fc7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:18.154976 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-bf06cade-d791-41c0-b631-59ce620fc7c4 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:18.156187 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-bf06cade-d791-41c0-b631-59ce620fc7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:18.175863 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc06c9-c982-4a75-a4aa-7c90e8063b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:18.177000 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc06c9-c982-4a75-a4aa-7c90e8063b99 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:18.178679 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc06c9-c982-4a75-a4aa-7c90e8063b99 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:18.179142 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc06c9-c982-4a75-a4aa-7c90e8063b99 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:18.197913 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc06c9-c982-4a75-a4aa-7c90e8063b99 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:18.199708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc06c9-c982-4a75-a4aa-7c90e8063b99 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:18.221624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-1afc06c9-c982-4a75-a4aa-7c90e8063b99 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 11:42:18.223496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 402/803] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 11:42:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:18.224637 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc06c9-c982-4a75-a4aa-7c90e8063b99 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:18.247554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 402/804] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:18.247554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06cade-d791-41c0-b631-59ce620fc7c4 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:18.350788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc06c9-c982-4a75-a4aa-7c90e8063b99 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:18.361538 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06cade-d791-41c0-b631-59ce620fc7c4 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:18.385139 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3909493-0cf3-40c7-a9e7-c42234d9fd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:18.385768 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3909493-0cf3-40c7-a9e7-c42234d9fd3a None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:18.386047 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3909493-0cf3-40c7-a9e7-c42234d9fd3a None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:18.386321 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3909493-0cf3-40c7-a9e7-c42234d9fd3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:18.397029 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba0a1b-7832-442a-b4ad-fb44a7e7ae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:18.397306 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3909493-0cf3-40c7-a9e7-c42234d9fd3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:18.398187 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba0a1b-7832-442a-b4ad-fb44a7e7ae95 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:18.398955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba0a1b-7832-442a-b4ad-fb44a7e7ae95 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:18.399465 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba0a1b-7832-442a-b4ad-fb44a7e7ae95 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:18.400574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba0a1b-7832-442a-b4ad-fb44a7e7ae95 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:18.401085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba0a1b-7832-442a-b4ad-fb44a7e7ae95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:18.402723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba0a1b-7832-442a-b4ad-fb44a7e7ae95 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:18.404701 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-a3909493-0cf3-40c7-a9e7-c42234d9fd3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:42:18.411541 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 403/805] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:42:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:18.412494 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3909493-0cf3-40c7-a9e7-c42234d9fd3a None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:18.428096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 403/806] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 11:42:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:18.429526 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba0a1b-7832-442a-b4ad-fb44a7e7ae95 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:18.520760 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3909493-0cf3-40c7-a9e7-c42234d9fd3a None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:18.533584 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba0a1b-7832-442a-b4ad-fb44a7e7ae95 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:18.554749 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347831-4c30-419a-989e-97eb4f7155b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:18.555432 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347831-4c30-419a-989e-97eb4f7155b9 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:18.555742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347831-4c30-419a-989e-97eb4f7155b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:18.556018 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347831-4c30-419a-989e-97eb4f7155b9 None admin] PATH_INFO: `/v3/services/network` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:18.556786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b347831-4c30-419a-989e-97eb4f7155b9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:18.558079 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b347831-4c30-419a-989e-97eb4f7155b9 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:18.569479 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-9b347831-4c30-419a-989e-97eb4f7155b9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 08 11:42:18.571564 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b6399-6edf-4dbf-aa1c-cfc5eeefdc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:18.571735 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 404/807] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:18 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:18.571735 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347831-4c30-419a-989e-97eb4f7155b9 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:18.576396 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b6399-6edf-4dbf-aa1c-cfc5eeefdc75 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:18.576780 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b6399-6edf-4dbf-aa1c-cfc5eeefdc75 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:18.577161 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b6399-6edf-4dbf-aa1c-cfc5eeefdc75 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:18.578016 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b6399-6edf-4dbf-aa1c-cfc5eeefdc75 None admin] RBAC: Adding query filter params (name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:18.578431 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b6399-6edf-4dbf-aa1c-cfc5eeefdc75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:18.580072 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b6399-6edf-4dbf-aa1c-cfc5eeefdc75 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:18.588955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 404/808] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:42:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:18.589868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b6399-6edf-4dbf-aa1c-cfc5eeefdc75 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:18.676057 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347831-4c30-419a-989e-97eb4f7155b9 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:18.691558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b6399-6edf-4dbf-aa1c-cfc5eeefdc75 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:18.709985 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5be78-d3c7-4707-9c03-e17bd9627a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:18.710636 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5be78-d3c7-4707-9c03-e17bd9627a79 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:18.710916 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5be78-d3c7-4707-9c03-e17bd9627a79 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:18.711190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5be78-d3c7-4707-9c03-e17bd9627a79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:18.725737 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4545b2-b30d-40ef-85f0-09f7ac9fccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:18.726408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4545b2-b30d-40ef-85f0-09f7ac9fccbc None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:18.726689 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4545b2-b30d-40ef-85f0-09f7ac9fccbc None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:18.726967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4545b2-b30d-40ef-85f0-09f7ac9fccbc None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:18.727704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4545b2-b30d-40ef-85f0-09f7ac9fccbc None admin] RBAC: Adding query filter params (name=network) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:18.728016 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4545b2-b30d-40ef-85f0-09f7ac9fccbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:18.729522 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4545b2-b30d-40ef-85f0-09f7ac9fccbc None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:18.739460 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 405/809] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 11:42:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:18.740388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4545b2-b30d-40ef-85f0-09f7ac9fccbc None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:18.781917 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5be78-d3c7-4707-9c03-e17bd9627a79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:18.783698 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5be78-d3c7-4707-9c03-e17bd9627a79 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:18.841333 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4545b2-b30d-40ef-85f0-09f7ac9fccbc None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:18.873961 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdaf70-e542-411e-816a-2ddf70bc43f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:18.874754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdaf70-e542-411e-816a-2ddf70bc43f6 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:18.875035 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdaf70-e542-411e-816a-2ddf70bc43f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:18.875308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdaf70-e542-411e-816a-2ddf70bc43f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:18.885992 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdaf70-e542-411e-816a-2ddf70bc43f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:18.887560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdaf70-e542-411e-816a-2ddf70bc43f6 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:18.887897 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 405/810] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:42:18.889409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5be78-d3c7-4707-9c03-e17bd9627a79 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:18.908051 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-efbdaf70-e542-411e-816a-2ddf70bc43f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:18.909462 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 406/811] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:18.910815 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f66d4-3696-4866-bf25-4d0aaddba6a2 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:18.911230 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f66d4-3696-4866-bf25-4d0aaddba6a2 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:18.911681 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f66d4-3696-4866-bf25-4d0aaddba6a2 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:18.913575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 407/812] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:18.914401 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f66d4-3696-4866-bf25-4d0aaddba6a2 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:18.989932 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5be78-d3c7-4707-9c03-e17bd9627a79 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:19.020002 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f66d4-3696-4866-bf25-4d0aaddba6a2 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:19.023185 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5772ddf-0f65-4453-92c6-2620df88aaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:19.024149 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5772ddf-0f65-4453-92c6-2620df88aaad None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:19.024432 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5772ddf-0f65-4453-92c6-2620df88aaad None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:19.024718 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5772ddf-0f65-4453-92c6-2620df88aaad None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:19.025426 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5772ddf-0f65-4453-92c6-2620df88aaad None admin] RBAC: Adding query filter params (type=network) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:19.025730 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5772ddf-0f65-4453-92c6-2620df88aaad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:19.027111 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5772ddf-0f65-4453-92c6-2620df88aaad None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:19.032002 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 406/813] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 11:42:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:19.032960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5772ddf-0f65-4453-92c6-2620df88aaad None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:19.057827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e15d80-d2fe-49ed-8b86-f2036d285c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:19.058614 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e15d80-d2fe-49ed-8b86-f2036d285c3f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:19.058907 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e15d80-d2fe-49ed-8b86-f2036d285c3f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:19.059166 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e15d80-d2fe-49ed-8b86-f2036d285c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:19.069721 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e15d80-d2fe-49ed-8b86-f2036d285c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:19.071171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e15d80-d2fe-49ed-8b86-f2036d285c3f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:19.087960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-e2e15d80-d2fe-49ed-8b86-f2036d285c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:19.093424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 408/814] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:19.093424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8d50f-a404-4366-bbdf-0aaf277e1e06 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:19.093424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8d50f-a404-4366-bbdf-0aaf277e1e06 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:19.093424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8d50f-a404-4366-bbdf-0aaf277e1e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:19.108495 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-e9c8d50f-a404-4366-bbdf-0aaf277e1e06 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:19.109684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-e9c8d50f-a404-4366-bbdf-0aaf277e1e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:19.140883 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5772ddf-0f65-4453-92c6-2620df88aaad None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:19.178301 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07544ae0-5128-48b0-a8f0-61f8fa12e69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:19.178959 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07544ae0-5128-48b0-a8f0-61f8fa12e69c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:19.179239 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07544ae0-5128-48b0-a8f0-61f8fa12e69c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:19.179513 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07544ae0-5128-48b0-a8f0-61f8fa12e69c None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:19.180265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07544ae0-5128-48b0-a8f0-61f8fa12e69c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:19.180566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07544ae0-5128-48b0-a8f0-61f8fa12e69c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:19.181925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07544ae0-5128-48b0-a8f0-61f8fa12e69c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:19.182540 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 409/815] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:19.183541 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8d50f-a404-4366-bbdf-0aaf277e1e06 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:19.210657 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 407/816] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:19.211804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07544ae0-5128-48b0-a8f0-61f8fa12e69c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:19.290217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8d50f-a404-4366-bbdf-0aaf277e1e06 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:19.315016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07544ae0-5128-48b0-a8f0-61f8fa12e69c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:19.323300 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a37928-f685-4a45-b3d3-f8d712364a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:19.324000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a37928-f685-4a45-b3d3-f8d712364a6b None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:19.324288 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a37928-f685-4a45-b3d3-f8d712364a6b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:19.324567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a37928-f685-4a45-b3d3-f8d712364a6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:19.325306 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a37928-f685-4a45-b3d3-f8d712364a6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:19.326694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a37928-f685-4a45-b3d3-f8d712364a6b None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:19.349386 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f894b-038e-4e0d-930d-f1dbc13b8478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:19.350048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f894b-038e-4e0d-930d-f1dbc13b8478 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:19.350331 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f894b-038e-4e0d-930d-f1dbc13b8478 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:19.350604 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f894b-038e-4e0d-930d-f1dbc13b8478 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:19.351316 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f894b-038e-4e0d-930d-f1dbc13b8478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:19.351686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f894b-038e-4e0d-930d-f1dbc13b8478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:19.353075 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f894b-038e-4e0d-930d-f1dbc13b8478 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:19.364454 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 408/817] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:19.365236 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f894b-038e-4e0d-930d-f1dbc13b8478 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:19.421555 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 410/818] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 11:42:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:42:19.422638 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a37928-f685-4a45-b3d3-f8d712364a6b None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:19.467571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f894b-038e-4e0d-930d-f1dbc13b8478 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:19.512046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef3f03-d1c4-4e6c-af9d-6b2aef7486d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:19.512883 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef3f03-d1c4-4e6c-af9d-6b2aef7486d6 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:19.513165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef3f03-d1c4-4e6c-af9d-6b2aef7486d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:19.513437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef3f03-d1c4-4e6c-af9d-6b2aef7486d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:19.514108 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef3f03-d1c4-4e6c-af9d-6b2aef7486d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:19.515601 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef3f03-d1c4-4e6c-af9d-6b2aef7486d6 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:19.528318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-09ef3f03-d1c4-4e6c-af9d-6b2aef7486d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 08 11:42:19.535713 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 409/819] 10.222.0.52 () {56 vars in 1129 bytes} [Tue Mar 8 11:42:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:19.536690 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef3f03-d1c4-4e6c-af9d-6b2aef7486d6 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:19.566130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a37928-f685-4a45-b3d3-f8d712364a6b None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:19.603819 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d9958-1936-4667-a1c9-5971c1736fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:19.605062 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d9958-1936-4667-a1c9-5971c1736fda None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:19.605563 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d9958-1936-4667-a1c9-5971c1736fda None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:19.606037 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d9958-1936-4667-a1c9-5971c1736fda None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:19.615043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d9958-1936-4667-a1c9-5971c1736fda None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:19.616922 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d9958-1936-4667-a1c9-5971c1736fda None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:19.632419 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-8a6d9958-1936-4667-a1c9-5971c1736fda None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 11:42:19.634787 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 411/820] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 11:42:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:19.635879 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d9958-1936-4667-a1c9-5971c1736fda None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:19.644514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef3f03-d1c4-4e6c-af9d-6b2aef7486d6 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:19.684871 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ae76a-34c7-497a-9353-79436d744063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:19.686077 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ae76a-34c7-497a-9353-79436d744063 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:19.686424 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ae76a-34c7-497a-9353-79436d744063 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:19.686779 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ae76a-34c7-497a-9353-79436d744063 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:19.694901 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ae76a-34c7-497a-9353-79436d744063 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:19.696508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ae76a-34c7-497a-9353-79436d744063 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:19.710944 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-542ae76a-34c7-497a-9353-79436d744063 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:19.716774 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 410/821] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:19.717653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ae76a-34c7-497a-9353-79436d744063 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:19.750056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d9958-1936-4667-a1c9-5971c1736fda None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:19.788129 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffb0cf-ba6b-4a09-a401-9e3187477553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:19.788804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffb0cf-ba6b-4a09-a401-9e3187477553 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:19.789089 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffb0cf-ba6b-4a09-a401-9e3187477553 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:19.789369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffb0cf-ba6b-4a09-a401-9e3187477553 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:19.790077 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffb0cf-ba6b-4a09-a401-9e3187477553 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:19.790388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffb0cf-ba6b-4a09-a401-9e3187477553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:19.791803 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffb0cf-ba6b-4a09-a401-9e3187477553 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:19.796260 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 412/822] 10.222.0.52 () {56 vars in 1124 bytes} [Tue Mar 8 11:42:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:19.797053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffb0cf-ba6b-4a09-a401-9e3187477553 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:19.828251 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ae76a-34c7-497a-9353-79436d744063 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:19.866453 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685cbc1-48d9-41ee-99cd-00b71b34c21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:19.867728 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685cbc1-48d9-41ee-99cd-00b71b34c21c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:19.868361 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685cbc1-48d9-41ee-99cd-00b71b34c21c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:19.868827 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685cbc1-48d9-41ee-99cd-00b71b34c21c None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:19.870558 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685cbc1-48d9-41ee-99cd-00b71b34c21c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:19.871077 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685cbc1-48d9-41ee-99cd-00b71b34c21c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:19.872709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685cbc1-48d9-41ee-99cd-00b71b34c21c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:19.893359 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 411/823] 10.222.0.52 () {56 vars in 1149 bytes} [Tue Mar 8 11:42:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:19.894926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685cbc1-48d9-41ee-99cd-00b71b34c21c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:19.900605 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffb0cf-ba6b-4a09-a401-9e3187477553 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:19.937807 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968c9f6-0b13-47f7-933e-485ea3039cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:19.939220 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968c9f6-0b13-47f7-933e-485ea3039cf1 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:19.939765 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968c9f6-0b13-47f7-933e-485ea3039cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:19.940420 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968c9f6-0b13-47f7-933e-485ea3039cf1 None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:19.941905 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968c9f6-0b13-47f7-933e-485ea3039cf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:19.942746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968c9f6-0b13-47f7-933e-485ea3039cf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:19.945045 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968c9f6-0b13-47f7-933e-485ea3039cf1 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:19.963357 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 413/824] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:19.964816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968c9f6-0b13-47f7-933e-485ea3039cf1 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:19.995919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685cbc1-48d9-41ee-99cd-00b71b34c21c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:20.029965 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e56f1f-124f-46d2-a897-698f784a77fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:20.030720 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e56f1f-124f-46d2-a897-698f784a77fc None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:20.030982 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e56f1f-124f-46d2-a897-698f784a77fc None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:20.031260 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e56f1f-124f-46d2-a897-698f784a77fc None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:20.032592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e56f1f-124f-46d2-a897-698f784a77fc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:20.043423 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e56f1f-124f-46d2-a897-698f784a77fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:20.043423 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e56f1f-124f-46d2-a897-698f784a77fc None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:20.043423 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 412/825] 10.222.0.52 () {56 vars in 1124 bytes} [Tue Mar 8 11:42:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:20.043423 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e56f1f-124f-46d2-a897-698f784a77fc None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:20.078440 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968c9f6-0b13-47f7-933e-485ea3039cf1 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:20.112837 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fa696-cf75-4811-913c-261b6cbdc293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:20.113655 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fa696-cf75-4811-913c-261b6cbdc293 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:20.113915 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fa696-cf75-4811-913c-261b6cbdc293 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:20.114192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fa696-cf75-4811-913c-261b6cbdc293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:20.124174 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fa696-cf75-4811-913c-261b6cbdc293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:20.126163 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fa696-cf75-4811-913c-261b6cbdc293 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:20.138890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e56f1f-124f-46d2-a897-698f784a77fc None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:20.144187 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-211fa696-cf75-4811-913c-261b6cbdc293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:20.150339 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 414/826] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:20.150339 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fa696-cf75-4811-913c-261b6cbdc293 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:20.181048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd38cc-c77e-46a8-ae2f-07d97ce18c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:20.181710 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd38cc-c77e-46a8-ae2f-07d97ce18c2d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:20.182004 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd38cc-c77e-46a8-ae2f-07d97ce18c2d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:20.182256 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd38cc-c77e-46a8-ae2f-07d97ce18c2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:20.183370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd38cc-c77e-46a8-ae2f-07d97ce18c2d None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=534fd902f96043068e99ca0537cf57c5) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:20.183370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd38cc-c77e-46a8-ae2f-07d97ce18c2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:20.184832 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd38cc-c77e-46a8-ae2f-07d97ce18c2d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:20.193445 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 413/827] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:20 2022] GET /identity/v3/role_assignments?user.id=534fd902f96043068e99ca0537cf57c5&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=c2642d38bc964424a5edc330e0d4471d => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:20.194322 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd38cc-c77e-46a8-ae2f-07d97ce18c2d None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:20.279325 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fa696-cf75-4811-913c-261b6cbdc293 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:20.307398 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd38cc-c77e-46a8-ae2f-07d97ce18c2d None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:20.324395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7f5c6-3e3f-4980-8970-73e687fc7f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:20.325247 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f5c6-3e3f-4980-8970-73e687fc7f41 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:20.325845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f5c6-3e3f-4980-8970-73e687fc7f41 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:20.326126 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f5c6-3e3f-4980-8970-73e687fc7f41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:20.326880 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7f5c6-3e3f-4980-8970-73e687fc7f41 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:20.328931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7f5c6-3e3f-4980-8970-73e687fc7f41 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:20.343035 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29ab88-a183-40e9-b342-c756bfe2e7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:20.343744 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29ab88-a183-40e9-b342-c756bfe2e7fb None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:20.344027 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29ab88-a183-40e9-b342-c756bfe2e7fb None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:20.344320 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29ab88-a183-40e9-b342-c756bfe2e7fb None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:20.345539 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29ab88-a183-40e9-b342-c756bfe2e7fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:20.345936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29ab88-a183-40e9-b342-c756bfe2e7fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:20.347359 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29ab88-a183-40e9-b342-c756bfe2e7fb None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:20.359468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 414/828] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:20.361709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108faa0-2592-4aa2-b481-0239ef67f1f1 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:20.361997 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108faa0-2592-4aa2-b481-0239ef67f1f1 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:20.362340 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108faa0-2592-4aa2-b481-0239ef67f1f1 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:20.364270 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 415/829] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:20.365758 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108faa0-2592-4aa2-b481-0239ef67f1f1 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:20.421822 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 415/830] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 11:42:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:42:20.423789 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78667770-5408-4586-b4ea-9c84d0d87b0b None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:20.424076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78667770-5408-4586-b4ea-9c84d0d87b0b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:20.424354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78667770-5408-4586-b4ea-9c84d0d87b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:20.442581 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-78667770-5408-4586-b4ea-9c84d0d87b0b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:20.443981 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-78667770-5408-4586-b4ea-9c84d0d87b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:20.489798 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108faa0-2592-4aa2-b481-0239ef67f1f1 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:20.531560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 416/831] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:20.531757 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc95a2-37a7-4eb4-96a8-d023bbf04d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:20.532668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc95a2-37a7-4eb4-96a8-d023bbf04d2f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:20.532935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc95a2-37a7-4eb4-96a8-d023bbf04d2f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:20.533310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc95a2-37a7-4eb4-96a8-d023bbf04d2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:20.541453 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc95a2-37a7-4eb4-96a8-d023bbf04d2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:20.543016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc95a2-37a7-4eb4-96a8-d023bbf04d2f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:20.549371 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78667770-5408-4586-b4ea-9c84d0d87b0b None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:20.568722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-3ecc95a2-37a7-4eb4-96a8-d023bbf04d2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:20.571265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 416/832] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:20.576255 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc95a2-37a7-4eb4-96a8-d023bbf04d2f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:20.664641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78667770-5408-4586-b4ea-9c84d0d87b0b None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:20.683151 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc95a2-37a7-4eb4-96a8-d023bbf04d2f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:20.704671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfe684-aaa0-4feb-8fcf-9125ea8f0f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:20.705828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfe684-aaa0-4feb-8fcf-9125ea8f0f05 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:20.706343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfe684-aaa0-4feb-8fcf-9125ea8f0f05 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:20.706814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfe684-aaa0-4feb-8fcf-9125ea8f0f05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:20.717492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfe684-aaa0-4feb-8fcf-9125ea8f0f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:20.718177 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deecce9-d025-4531-8d2e-90cf2367a172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:20.718841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deecce9-d025-4531-8d2e-90cf2367a172 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:20.719124 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deecce9-d025-4531-8d2e-90cf2367a172 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:20.719558 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deecce9-d025-4531-8d2e-90cf2367a172 None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:20.720369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deecce9-d025-4531-8d2e-90cf2367a172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:20.720674 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deecce9-d025-4531-8d2e-90cf2367a172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:20.722184 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deecce9-d025-4531-8d2e-90cf2367a172 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:20.727691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-addfe684-aaa0-4feb-8fcf-9125ea8f0f05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:42:20.729520 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 417/833] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:20.738465 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 417/834] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:20.738635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfe684-aaa0-4feb-8fcf-9125ea8f0f05 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:20.743547 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deecce9-d025-4531-8d2e-90cf2367a172 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:20.840625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfe684-aaa0-4feb-8fcf-9125ea8f0f05 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:20.845691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deecce9-d025-4531-8d2e-90cf2367a172 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:20.874787 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f9bde-eab1-49f6-9c7a-bb0551305739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:20.875459 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f9bde-eab1-49f6-9c7a-bb0551305739 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:20.876372 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f9bde-eab1-49f6-9c7a-bb0551305739 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:20.876652 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f9bde-eab1-49f6-9c7a-bb0551305739 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:20.877449 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f9bde-eab1-49f6-9c7a-bb0551305739 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:20.877765 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f9bde-eab1-49f6-9c7a-bb0551305739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:20.879161 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f9bde-eab1-49f6-9c7a-bb0551305739 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:20.880212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872328a3-f180-4abc-9b7b-5f1fd5999b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:20.881173 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872328a3-f180-4abc-9b7b-5f1fd5999b19 None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:20.881518 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872328a3-f180-4abc-9b7b-5f1fd5999b19 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:20.881858 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872328a3-f180-4abc-9b7b-5f1fd5999b19 None admin] PATH_INFO: `/v3/projects/7c390663688b466f98ff480c31ba21bc/users/34d5824ea4a54b65a3eaa6deeb9dc416/roles/b34db25ec52b41a7bb7691d839e68c53` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:20.887893 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 418/835] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:42:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:20.895492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f9bde-eab1-49f6-9c7a-bb0551305739 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:20.900965 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872328a3-f180-4abc-9b7b-5f1fd5999b19 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c390663688b466f98ff480c31ba21bc, user_id=34d5824ea4a54b65a3eaa6deeb9dc416, role_id=b34db25ec52b41a7bb7691d839e68c53)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:20.902411 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872328a3-f180-4abc-9b7b-5f1fd5999b19 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:20.993523 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 418/836] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:42:20 2022] PUT /identity/v3/projects/7c390663688b466f98ff480c31ba21bc/users/34d5824ea4a54b65a3eaa6deeb9dc416/roles/b34db25ec52b41a7bb7691d839e68c53 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 11:42:21.004430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f9bde-eab1-49f6-9c7a-bb0551305739 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:21.043312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b3b37-e063-42be-ab58-ff9530e659e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:21.044154 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b3b37-e063-42be-ab58-ff9530e659e7 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:21.044527 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b3b37-e063-42be-ab58-ff9530e659e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:21.044822 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b3b37-e063-42be-ab58-ff9530e659e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:21.057921 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b3b37-e063-42be-ab58-ff9530e659e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:21.059473 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b3b37-e063-42be-ab58-ff9530e659e7 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:21.078587 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-5b6b3b37-e063-42be-ab58-ff9530e659e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:21.081095 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 419/837] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:21.091996 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872328a3-f180-4abc-9b7b-5f1fd5999b19 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:21.203385 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872328a3-f180-4abc-9b7b-5f1fd5999b19 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:21.240471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c26502-9f88-445c-b52a-970bb5ac672f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:21.241140 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c26502-9f88-445c-b52a-970bb5ac672f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:21.241475 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c26502-9f88-445c-b52a-970bb5ac672f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:21.241848 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c26502-9f88-445c-b52a-970bb5ac672f None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:21.242574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c26502-9f88-445c-b52a-970bb5ac672f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:21.242919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c26502-9f88-445c-b52a-970bb5ac672f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:21.244437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c26502-9f88-445c-b52a-970bb5ac672f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:21.256154 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 419/838] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:21.261388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b3b37-e063-42be-ab58-ff9530e659e7 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:21.363549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b3b37-e063-42be-ab58-ff9530e659e7 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:21.401161 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ec246-70ac-4beb-a18b-6c2685fac02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:21.402013 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ec246-70ac-4beb-a18b-6c2685fac02e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:21.402342 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ec246-70ac-4beb-a18b-6c2685fac02e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:21.402619 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ec246-70ac-4beb-a18b-6c2685fac02e None admin] PATH_INFO: `/v3/users/swift` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:21.410915 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ec246-70ac-4beb-a18b-6c2685fac02e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:21.412398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ec246-70ac-4beb-a18b-6c2685fac02e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:21.425801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-506ec246-70ac-4beb-a18b-6c2685fac02e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 11:42:21.427303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 420/839] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:42:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:21.432634 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c26502-9f88-445c-b52a-970bb5ac672f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:21.536844 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c26502-9f88-445c-b52a-970bb5ac672f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:21.572536 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8eec4c-a3e8-4e88-baa9-fdf0fe0f1c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:21.573491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8eec4c-a3e8-4e88-baa9-fdf0fe0f1c44 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:21.573921 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8eec4c-a3e8-4e88-baa9-fdf0fe0f1c44 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:21.574341 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8eec4c-a3e8-4e88-baa9-fdf0fe0f1c44 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:21.575942 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8eec4c-a3e8-4e88-baa9-fdf0fe0f1c44 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:21.576726 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8eec4c-a3e8-4e88-baa9-fdf0fe0f1c44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:21.579102 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8eec4c-a3e8-4e88-baa9-fdf0fe0f1c44 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:21.598799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 420/840] 10.222.0.52 () {56 vars in 1135 bytes} [Tue Mar 8 11:42:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:21.603979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ec246-70ac-4beb-a18b-6c2685fac02e None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:21.705479 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ec246-70ac-4beb-a18b-6c2685fac02e None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:21.739116 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720a090-666e-4735-ab2d-c203e0b6be4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:21.739793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720a090-666e-4735-ab2d-c203e0b6be4f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:21.740070 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720a090-666e-4735-ab2d-c203e0b6be4f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:21.740342 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720a090-666e-4735-ab2d-c203e0b6be4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:21.808934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720a090-666e-4735-ab2d-c203e0b6be4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:21.810375 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720a090-666e-4735-ab2d-c203e0b6be4f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:21.913225 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 421/841] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:21 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:42:21.918722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8eec4c-a3e8-4e88-baa9-fdf0fe0f1c44 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:22.020592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8eec4c-a3e8-4e88-baa9-fdf0fe0f1c44 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:22.055455 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c13bab-13d7-4920-90ed-ae5ec756787e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:22.056650 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13bab-13d7-4920-90ed-ae5ec756787e None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:22.057135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13bab-13d7-4920-90ed-ae5ec756787e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:22.057586 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13bab-13d7-4920-90ed-ae5ec756787e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:22.068688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c13bab-13d7-4920-90ed-ae5ec756787e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:22.070373 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c13bab-13d7-4920-90ed-ae5ec756787e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:22.088762 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-47c13bab-13d7-4920-90ed-ae5ec756787e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:22.090578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 421/842] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:22.098603 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720a090-666e-4735-ab2d-c203e0b6be4f None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:22.198384 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720a090-666e-4735-ab2d-c203e0b6be4f None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:22.234326 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab96b-2e25-4f4d-9759-81ff9be3a1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:22.235793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab96b-2e25-4f4d-9759-81ff9be3a1e7 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:22.236168 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab96b-2e25-4f4d-9759-81ff9be3a1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:22.236445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab96b-2e25-4f4d-9759-81ff9be3a1e7 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:22.237171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ab96b-2e25-4f4d-9759-81ff9be3a1e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:22.237477 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ab96b-2e25-4f4d-9759-81ff9be3a1e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:22.238882 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ab96b-2e25-4f4d-9759-81ff9be3a1e7 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:22.255008 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 422/843] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:22.257404 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c13bab-13d7-4920-90ed-ae5ec756787e None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:22.364422 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c13bab-13d7-4920-90ed-ae5ec756787e None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:22.398256 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8f45a-f20b-438e-a393-6ef50507350c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:22.399318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8f45a-f20b-438e-a393-6ef50507350c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:22.399620 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8f45a-f20b-438e-a393-6ef50507350c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:22.399897 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8f45a-f20b-438e-a393-6ef50507350c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:22.407479 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8f45a-f20b-438e-a393-6ef50507350c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:22.409157 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8f45a-f20b-438e-a393-6ef50507350c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:22.423259 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-baa8f45a-f20b-438e-a393-6ef50507350c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:22.424760 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 422/844] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:22.430415 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab96b-2e25-4f4d-9759-81ff9be3a1e7 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:22.534429 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab96b-2e25-4f4d-9759-81ff9be3a1e7 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:22.568571 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c833035-f6b7-4431-9290-07c70c8c0dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:22.569236 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c833035-f6b7-4431-9290-07c70c8c0dcd None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:22.569563 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c833035-f6b7-4431-9290-07c70c8c0dcd None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:22.569844 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c833035-f6b7-4431-9290-07c70c8c0dcd None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:22.570617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c833035-f6b7-4431-9290-07c70c8c0dcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:22.570924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c833035-f6b7-4431-9290-07c70c8c0dcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:22.572399 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c833035-f6b7-4431-9290-07c70c8c0dcd None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:22.584844 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 423/845] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:22.590763 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8f45a-f20b-438e-a393-6ef50507350c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:22.659383 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d94b4a-e7fa-4d11-b9fd-9be60c234a17 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:22.659691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d94b4a-e7fa-4d11-b9fd-9be60c234a17 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:22.659902 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d94b4a-e7fa-4d11-b9fd-9be60c234a17 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:22.661948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 424/846] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:42:22.667140 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b71c85-360c-4cc6-aec0-17b733cf1b96 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:22.667438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b71c85-360c-4cc6-aec0-17b733cf1b96 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:22.667742 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b71c85-360c-4cc6-aec0-17b733cf1b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:22.685989 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-29b71c85-360c-4cc6-aec0-17b733cf1b96 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:22.687185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-29b71c85-360c-4cc6-aec0-17b733cf1b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:22.695163 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8f45a-f20b-438e-a393-6ef50507350c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:22.739326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0a071-4a26-4f50-8028-0e6a17cad7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:22.740062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0a071-4a26-4f50-8028-0e6a17cad7e0 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:22.740343 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0a071-4a26-4f50-8028-0e6a17cad7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:22.740618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0a071-4a26-4f50-8028-0e6a17cad7e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:22.741437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0a071-4a26-4f50-8028-0e6a17cad7e0 None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=869feb4577be48a683997eab827b1062) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:22.741745 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0a071-4a26-4f50-8028-0e6a17cad7e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:22.743175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0a071-4a26-4f50-8028-0e6a17cad7e0 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:22.749385 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 423/847] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:22 2022] GET /identity/v3/role_assignments?user.id=869feb4577be48a683997eab827b1062&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=c2642d38bc964424a5edc330e0d4471d => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:22.754090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 425/848] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:22.777925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0a071-4a26-4f50-8028-0e6a17cad7e0 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:22.865396 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f1efa-c60c-422c-aaaa-a1623d351126 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:22.865775 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f1efa-c60c-422c-aaaa-a1623d351126 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:22.865943 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f1efa-c60c-422c-aaaa-a1623d351126 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:22.868049 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 426/849] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:42:22.873608 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cb76f-e325-42a5-8701-766c8eadbcdd None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:22.873923 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cb76f-e325-42a5-8701-766c8eadbcdd None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:22.874154 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cb76f-e325-42a5-8701-766c8eadbcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:22.887827 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0a071-4a26-4f50-8028-0e6a17cad7e0 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:22.892368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-ae1cb76f-e325-42a5-8701-766c8eadbcdd None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:22.893587 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-ae1cb76f-e325-42a5-8701-766c8eadbcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:22.930190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cd85d-c73a-4d16-80df-ad70036b214c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:22.931125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cd85d-c73a-4d16-80df-ad70036b214c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:22.931409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cd85d-c73a-4d16-80df-ad70036b214c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:22.931711 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cd85d-c73a-4d16-80df-ad70036b214c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:22.932380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cd85d-c73a-4d16-80df-ad70036b214c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:22.933828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cd85d-c73a-4d16-80df-ad70036b214c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:22.946191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-926cd85d-c73a-4d16-80df-ad70036b214c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 08 11:42:22.947831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 424/850] 10.222.0.52 () {56 vars in 1132 bytes} [Tue Mar 8 11:42:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:22.953385 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cd85d-c73a-4d16-80df-ad70036b214c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:22.975865 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 427/851] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:22.997610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cb76f-e325-42a5-8701-766c8eadbcdd None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:23.084468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cd85d-c73a-4d16-80df-ad70036b214c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:23.123041 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cb76f-e325-42a5-8701-766c8eadbcdd None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:23.126766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccf8cb-ae89-496e-a93c-44fcf03d91f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:23.127483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccf8cb-ae89-496e-a93c-44fcf03d91f6 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:23.127791 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccf8cb-ae89-496e-a93c-44fcf03d91f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:23.128078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccf8cb-ae89-496e-a93c-44fcf03d91f6 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:23.128796 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccf8cb-ae89-496e-a93c-44fcf03d91f6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:23.129105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccf8cb-ae89-496e-a93c-44fcf03d91f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:23.130495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccf8cb-ae89-496e-a93c-44fcf03d91f6 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:23.136861 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 425/852] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 11:42:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:23.142391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccf8cb-ae89-496e-a93c-44fcf03d91f6 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:23.166696 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34361f0a-0f6d-43dc-8265-9a3e32b3434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:23.167604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34361f0a-0f6d-43dc-8265-9a3e32b3434e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:23.167893 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34361f0a-0f6d-43dc-8265-9a3e32b3434e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:23.168599 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34361f0a-0f6d-43dc-8265-9a3e32b3434e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:23.169268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34361f0a-0f6d-43dc-8265-9a3e32b3434e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:23.171088 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34361f0a-0f6d-43dc-8265-9a3e32b3434e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:23.186470 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-34361f0a-0f6d-43dc-8265-9a3e32b3434e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 08 11:42:23.188350 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 428/853] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:42:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:23.193512 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34361f0a-0f6d-43dc-8265-9a3e32b3434e None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:23.254131 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccf8cb-ae89-496e-a93c-44fcf03d91f6 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:23.287984 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1187a11-b1ae-4a6c-a050-bc48bb98afb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:23.288963 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1187a11-b1ae-4a6c-a050-bc48bb98afb5 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:23.289421 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1187a11-b1ae-4a6c-a050-bc48bb98afb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:23.289867 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1187a11-b1ae-4a6c-a050-bc48bb98afb5 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:23.290738 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1187a11-b1ae-4a6c-a050-bc48bb98afb5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:23.291248 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1187a11-b1ae-4a6c-a050-bc48bb98afb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:23.292821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1187a11-b1ae-4a6c-a050-bc48bb98afb5 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:23.298297 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 426/854] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 11:42:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:23.320944 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34361f0a-0f6d-43dc-8265-9a3e32b3434e None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:23.357279 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16b680-9b3c-4c04-85bf-f937eed3a97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:23.358220 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16b680-9b3c-4c04-85bf-f937eed3a97e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:23.358656 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16b680-9b3c-4c04-85bf-f937eed3a97e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:23.359074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16b680-9b3c-4c04-85bf-f937eed3a97e None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:23.360012 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16b680-9b3c-4c04-85bf-f937eed3a97e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:23.360497 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16b680-9b3c-4c04-85bf-f937eed3a97e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:23.362042 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16b680-9b3c-4c04-85bf-f937eed3a97e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:23.367600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 429/855] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:42:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:23.377651 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1187a11-b1ae-4a6c-a050-bc48bb98afb5 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:23.477938 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd866da-715d-48f2-9f05-dff6e61667be None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:23.478245 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd866da-715d-48f2-9f05-dff6e61667be None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:23.478426 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd866da-715d-48f2-9f05-dff6e61667be None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:23.483724 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 430/856] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:23.487226 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986adfbc-d564-4b39-b756-eb0c40d3725b None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:23.487511 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986adfbc-d564-4b39-b756-eb0c40d3725b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:23.487627 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1187a11-b1ae-4a6c-a050-bc48bb98afb5 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:23.487809 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986adfbc-d564-4b39-b756-eb0c40d3725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:23.506147 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-986adfbc-d564-4b39-b756-eb0c40d3725b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:23.507347 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-986adfbc-d564-4b39-b756-eb0c40d3725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:23.534194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe446c8-a48d-4e5b-995e-aa63bb7252e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:23.534881 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe446c8-a48d-4e5b-995e-aa63bb7252e4 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:23.535162 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe446c8-a48d-4e5b-995e-aa63bb7252e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:23.535434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe446c8-a48d-4e5b-995e-aa63bb7252e4 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:23.537084 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe446c8-a48d-4e5b-995e-aa63bb7252e4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:23.537084 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe446c8-a48d-4e5b-995e-aa63bb7252e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:23.537858 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe446c8-a48d-4e5b-995e-aa63bb7252e4 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:23.542708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 427/857] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:42:23 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:23.602150 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 431/858] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:23.628224 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe446c8-a48d-4e5b-995e-aa63bb7252e4 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:23.739031 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe446c8-a48d-4e5b-995e-aa63bb7252e4 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:23.775794 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4e6fe-8d21-4652-bccb-715d9682b924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:23.776881 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4e6fe-8d21-4652-bccb-715d9682b924 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:23.777312 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4e6fe-8d21-4652-bccb-715d9682b924 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:23.777744 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4e6fe-8d21-4652-bccb-715d9682b924 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:23.788565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4e6fe-8d21-4652-bccb-715d9682b924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:23.795782 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-a4d4e6fe-8d21-4652-bccb-715d9682b924 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:42:23.797720 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 428/859] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:42:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:23.806030 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986adfbc-d564-4b39-b756-eb0c40d3725b None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:23.907854 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986adfbc-d564-4b39-b756-eb0c40d3725b None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:23.942976 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0def6e0-a1e5-4e09-a37c-621f68be8efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:23.943932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0def6e0-a1e5-4e09-a37c-621f68be8efe None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:23.944406 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0def6e0-a1e5-4e09-a37c-621f68be8efe None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:23.944832 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0def6e0-a1e5-4e09-a37c-621f68be8efe None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:23.945717 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0def6e0-a1e5-4e09-a37c-621f68be8efe None admin] RBAC: Adding query filter params (name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:23.946174 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0def6e0-a1e5-4e09-a37c-621f68be8efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:23.947780 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0def6e0-a1e5-4e09-a37c-621f68be8efe None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:23.960782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 432/860] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:42:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:23.962297 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4e6fe-8d21-4652-bccb-715d9682b924 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:24.068474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4e6fe-8d21-4652-bccb-715d9682b924 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:24.103324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f3f86-7516-47a3-8595-77fa36b996f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:24.104148 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3f86-7516-47a3-8595-77fa36b996f8 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:24.104426 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3f86-7516-47a3-8595-77fa36b996f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:24.104760 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3f86-7516-47a3-8595-77fa36b996f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:24.116199 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f3f86-7516-47a3-8595-77fa36b996f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:24.117659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f3f86-7516-47a3-8595-77fa36b996f8 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:24.136014 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-d96f3f86-7516-47a3-8595-77fa36b996f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:24.137539 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 429/861] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:24.143093 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0def6e0-a1e5-4e09-a37c-621f68be8efe None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:24.244849 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0def6e0-a1e5-4e09-a37c-621f68be8efe None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:24.278671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427cb31-4504-4645-8934-9e610955d97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:24.279337 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427cb31-4504-4645-8934-9e610955d97d None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:24.279647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427cb31-4504-4645-8934-9e610955d97d None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:24.279928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427cb31-4504-4645-8934-9e610955d97d None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:24.280649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427cb31-4504-4645-8934-9e610955d97d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:24.280956 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427cb31-4504-4645-8934-9e610955d97d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:24.283054 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427cb31-4504-4645-8934-9e610955d97d None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:24.299599 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 433/862] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:24.301386 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f3f86-7516-47a3-8595-77fa36b996f8 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:24.403548 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f3f86-7516-47a3-8595-77fa36b996f8 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:24.442943 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fbdd2-fda9-404a-b6a8-97c969e29708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:24.443791 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fbdd2-fda9-404a-b6a8-97c969e29708 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:24.444094 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fbdd2-fda9-404a-b6a8-97c969e29708 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:24.444388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fbdd2-fda9-404a-b6a8-97c969e29708 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:24.453058 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fbdd2-fda9-404a-b6a8-97c969e29708 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:24.455398 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fbdd2-fda9-404a-b6a8-97c969e29708 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:24.470489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-455fbdd2-fda9-404a-b6a8-97c969e29708 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 11:42:24.472170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 430/863] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 11:42:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:24.477828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427cb31-4504-4645-8934-9e610955d97d None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:24.583883 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427cb31-4504-4645-8934-9e610955d97d None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:24.618885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3e016-b680-4b60-a2a7-8019f2360962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:24.619588 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3e016-b680-4b60-a2a7-8019f2360962 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:24.619876 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3e016-b680-4b60-a2a7-8019f2360962 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:24.620154 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3e016-b680-4b60-a2a7-8019f2360962 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:24.621043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3e016-b680-4b60-a2a7-8019f2360962 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:24.621359 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3e016-b680-4b60-a2a7-8019f2360962 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:24.622788 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3e016-b680-4b60-a2a7-8019f2360962 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:24.645705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 434/864] 10.222.0.52 () {56 vars in 1149 bytes} [Tue Mar 8 11:42:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:24.647044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fbdd2-fda9-404a-b6a8-97c969e29708 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:24.748696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fbdd2-fda9-404a-b6a8-97c969e29708 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:24.785379 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb69ac-c894-495b-86a7-b0eb1e0b8d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:24.786045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb69ac-c894-495b-86a7-b0eb1e0b8d30 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:24.786330 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb69ac-c894-495b-86a7-b0eb1e0b8d30 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:24.786606 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb69ac-c894-495b-86a7-b0eb1e0b8d30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:24.854773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb69ac-c894-495b-86a7-b0eb1e0b8d30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:24.856309 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb69ac-c894-495b-86a7-b0eb1e0b8d30 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:24.960951 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 431/865] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:42:24.966449 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3e016-b680-4b60-a2a7-8019f2360962 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:25.066747 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3e016-b680-4b60-a2a7-8019f2360962 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:25.100593 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ebd2e-11e0-470a-b4bb-68b825c2fe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:25.101391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ebd2e-11e0-470a-b4bb-68b825c2fe1a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:25.101675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ebd2e-11e0-470a-b4bb-68b825c2fe1a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:25.101951 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ebd2e-11e0-470a-b4bb-68b825c2fe1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:25.112802 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ebd2e-11e0-470a-b4bb-68b825c2fe1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:25.114267 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ebd2e-11e0-470a-b4bb-68b825c2fe1a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:25.131705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-c86ebd2e-11e0-470a-b4bb-68b825c2fe1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:25.137476 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 435/866] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:25.140605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb69ac-c894-495b-86a7-b0eb1e0b8d30 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:25.230937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf8c3d-7f1e-4292-838a-c04e565da2e5 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:25.231468 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf8c3d-7f1e-4292-838a-c04e565da2e5 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:25.231468 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf8c3d-7f1e-4292-838a-c04e565da2e5 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:25.233587 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 436/867] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:42:25.239479 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75dea0-9211-41c1-80b6-9810422d6129 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:25.240073 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75dea0-9211-41c1-80b6-9810422d6129 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:25.240558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75dea0-9211-41c1-80b6-9810422d6129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:25.256441 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb69ac-c894-495b-86a7-b0eb1e0b8d30 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:25.257937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-6f75dea0-9211-41c1-80b6-9810422d6129 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:25.259334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-6f75dea0-9211-41c1-80b6-9810422d6129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:25.299793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464bcd5-e53f-4d2f-bbaf-eb12c68989f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:25.300469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464bcd5-e53f-4d2f-bbaf-eb12c68989f0 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:25.300752 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464bcd5-e53f-4d2f-bbaf-eb12c68989f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:25.301029 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464bcd5-e53f-4d2f-bbaf-eb12c68989f0 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:25.301754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464bcd5-e53f-4d2f-bbaf-eb12c68989f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:25.302064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464bcd5-e53f-4d2f-bbaf-eb12c68989f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:25.303953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464bcd5-e53f-4d2f-bbaf-eb12c68989f0 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:25.323666 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 432/868] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:25.325564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464bcd5-e53f-4d2f-bbaf-eb12c68989f0 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:25.343663 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 437/869] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:25.361813 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75dea0-9211-41c1-80b6-9810422d6129 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:25.447755 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464bcd5-e53f-4d2f-bbaf-eb12c68989f0 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:25.473821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75dea0-9211-41c1-80b6-9810422d6129 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:25.488935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fa945-2f23-405a-a57a-d653894f89e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:25.490545 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fa945-2f23-405a-a57a-d653894f89e9 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:25.490977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fa945-2f23-405a-a57a-d653894f89e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:25.491407 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fa945-2f23-405a-a57a-d653894f89e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:25.500205 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fa945-2f23-405a-a57a-d653894f89e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:25.502122 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fa945-2f23-405a-a57a-d653894f89e9 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:25.514077 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b9388-7d21-4cbd-887b-f86e17c7fbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:25.515018 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b9388-7d21-4cbd-887b-f86e17c7fbc3 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:25.515395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b9388-7d21-4cbd-887b-f86e17c7fbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:25.515844 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b9388-7d21-4cbd-887b-f86e17c7fbc3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:25.516618 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b9388-7d21-4cbd-887b-f86e17c7fbc3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:25.518173 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b9388-7d21-4cbd-887b-f86e17c7fbc3 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:25.519737 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-dd0fa945-2f23-405a-a57a-d653894f89e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:25.526637 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 433/870] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:25.528211 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fa945-2f23-405a-a57a-d653894f89e9 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:25.536695 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-f25b9388-7d21-4cbd-887b-f86e17c7fbc3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 11:42:25.543540 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 438/871] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 11:42:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:25.544574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b9388-7d21-4cbd-887b-f86e17c7fbc3 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:25.650223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b9388-7d21-4cbd-887b-f86e17c7fbc3 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:25.653174 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fa945-2f23-405a-a57a-d653894f89e9 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:25.687856 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c923b-bc77-4aaa-85ce-295031b45e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:25.688697 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c923b-bc77-4aaa-85ce-295031b45e04 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:25.689208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c923b-bc77-4aaa-85ce-295031b45e04 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:25.689689 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c923b-bc77-4aaa-85ce-295031b45e04 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:25.689906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152b420-e69f-40b7-8557-15b39c546aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:25.690714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c923b-bc77-4aaa-85ce-295031b45e04 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:25.690885 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152b420-e69f-40b7-8557-15b39c546aa2 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:25.691205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c923b-bc77-4aaa-85ce-295031b45e04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:25.691484 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152b420-e69f-40b7-8557-15b39c546aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:25.691947 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152b420-e69f-40b7-8557-15b39c546aa2 None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:25.692887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152b420-e69f-40b7-8557-15b39c546aa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:25.693008 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c923b-bc77-4aaa-85ce-295031b45e04 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:25.693439 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152b420-e69f-40b7-8557-15b39c546aa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:25.695025 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152b420-e69f-40b7-8557-15b39c546aa2 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:25.703763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 439/872] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 11:42:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:25.705908 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c923b-bc77-4aaa-85ce-295031b45e04 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:25.710359 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 434/873] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:25.711608 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b48a34-4e9f-4afa-9056-feb971b6c857 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:25.713688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b48a34-4e9f-4afa-9056-feb971b6c857 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:25.713688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b48a34-4e9f-4afa-9056-feb971b6c857 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:25.717616 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 435/874] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:25.718373 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b48a34-4e9f-4afa-9056-feb971b6c857 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:25.805627 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c923b-bc77-4aaa-85ce-295031b45e04 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:25.821776 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b48a34-4e9f-4afa-9056-feb971b6c857 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:25.843350 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70660369-e891-41d9-8c73-762a8ae583cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:25.844592 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70660369-e891-41d9-8c73-762a8ae583cb None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:25.844871 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70660369-e891-41d9-8c73-762a8ae583cb None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:25.845325 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70660369-e891-41d9-8c73-762a8ae583cb None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:25.846037 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70660369-e891-41d9-8c73-762a8ae583cb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:25.846348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70660369-e891-41d9-8c73-762a8ae583cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:25.847762 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70660369-e891-41d9-8c73-762a8ae583cb None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:25.859782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 440/875] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 11:42:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:25.859782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882b470-78ef-40f0-a4cc-cbc7a0e42396 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:25.859782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882b470-78ef-40f0-a4cc-cbc7a0e42396 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:25.859782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882b470-78ef-40f0-a4cc-cbc7a0e42396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:25.868862 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc962785-097a-451f-808d-8e3596742635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:25.869542 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc962785-097a-451f-808d-8e3596742635 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:25.869821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc962785-097a-451f-808d-8e3596742635 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:25.870093 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc962785-097a-451f-808d-8e3596742635 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:25.871044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc962785-097a-451f-808d-8e3596742635 None admin] RBAC: Adding query filter params (role.id=b34db25ec52b41a7bb7691d839e68c53, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=34d5824ea4a54b65a3eaa6deeb9dc416) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:25.871356 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc962785-097a-451f-808d-8e3596742635 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:25.871753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-f882b470-78ef-40f0-a4cc-cbc7a0e42396 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:25.872991 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc962785-097a-451f-808d-8e3596742635 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:25.873106 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f882b470-78ef-40f0-a4cc-cbc7a0e42396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:25.881600 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 436/876] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:25 2022] GET /identity/v3/role_assignments?user.id=34d5824ea4a54b65a3eaa6deeb9dc416&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=b34db25ec52b41a7bb7691d839e68c53 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:25.955054 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 441/877] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:25.978541 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc962785-097a-451f-808d-8e3596742635 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:25.995430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036600e0-6bef-416e-a1eb-014ce3d4edde None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:25.995811 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036600e0-6bef-416e-a1eb-014ce3d4edde None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:25.996012 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036600e0-6bef-416e-a1eb-014ce3d4edde None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:25.998043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 442/878] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:42:26.004323 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932e72-a55b-4724-9b94-58f199b35e03 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:26.004667 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932e72-a55b-4724-9b94-58f199b35e03 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:26.004877 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932e72-a55b-4724-9b94-58f199b35e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:26.025577 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-18932e72-a55b-4724-9b94-58f199b35e03 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:26.027125 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-18932e72-a55b-4724-9b94-58f199b35e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:26.115314 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc962785-097a-451f-808d-8e3596742635 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:26.116109 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 443/879] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:26.138764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18932e72-a55b-4724-9b94-58f199b35e03 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:26.150602 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487942d-f888-494c-be4a-0fa07654e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:26.151264 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487942d-f888-494c-be4a-0fa07654e052 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:26.151563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487942d-f888-494c-be4a-0fa07654e052 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:26.151840 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487942d-f888-494c-be4a-0fa07654e052 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:26.152574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487942d-f888-494c-be4a-0fa07654e052 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:26.153931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487942d-f888-494c-be4a-0fa07654e052 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:26.243065 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 437/880] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 11:42:25 2022] POST /identity/v3/services => generated 269 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:42:26.261056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18932e72-a55b-4724-9b94-58f199b35e03 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:26.308554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af8cac-2500-453b-b7f7-69764c6cd454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:26.309233 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8cac-2500-453b-b7f7-69764c6cd454 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:26.309511 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8cac-2500-453b-b7f7-69764c6cd454 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:26.309836 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af8cac-2500-453b-b7f7-69764c6cd454 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:26.310567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af8cac-2500-453b-b7f7-69764c6cd454 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:26.312015 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af8cac-2500-453b-b7f7-69764c6cd454 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:26.395304 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 444/881] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 11:42:26 2022] POST /identity/v3/services => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 11:42:28.252963 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ab294-600a-4bd0-a133-d01b6e04c419 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:28.253467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ab294-600a-4bd0-a133-d01b6e04c419 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:28.253568 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ab294-600a-4bd0-a133-d01b6e04c419 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:28.255575 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 438/882] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:28.261257 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00446623-aa44-44a7-b1d9-604099c7784c None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:28.261679 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00446623-aa44-44a7-b1d9-604099c7784c None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:28.261850 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00446623-aa44-44a7-b1d9-604099c7784c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:28.279581 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-00446623-aa44-44a7-b1d9-604099c7784c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:28.282007 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-00446623-aa44-44a7-b1d9-604099c7784c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:28.357961 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 445/883] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:28.386580 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ab294-600a-4bd0-a133-d01b6e04c419 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:28.395365 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667a508-7941-493c-8fad-a2bccca0fb5a None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:28.395717 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667a508-7941-493c-8fad-a2bccca0fb5a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:28.395973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667a508-7941-493c-8fad-a2bccca0fb5a None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:28.397898 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 446/884] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:42:28.403800 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4e32e-a3f5-4d94-9e12-2f492761309e None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:28.404093 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4e32e-a3f5-4d94-9e12-2f492761309e None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:28.404535 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4e32e-a3f5-4d94-9e12-2f492761309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:28.423727 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-26d4e32e-a3f5-4d94-9e12-2f492761309e None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:28.425303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-26d4e32e-a3f5-4d94-9e12-2f492761309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:28.492073 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 447/885] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:28.505239 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ab294-600a-4bd0-a133-d01b6e04c419 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:28.515031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4e32e-a3f5-4d94-9e12-2f492761309e None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:28.545837 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3e935-f734-4730-b779-aa04f7bbd6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:28.546761 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3e935-f734-4730-b779-aa04f7bbd6a7 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:28.547063 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3e935-f734-4730-b779-aa04f7bbd6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:28.547333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3e935-f734-4730-b779-aa04f7bbd6a7 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:28.548237 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3e935-f734-4730-b779-aa04f7bbd6a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:28.550730 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3e935-f734-4730-b779-aa04f7bbd6a7 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:28.614125 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4e32e-a3f5-4d94-9e12-2f492761309e None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:28.623569 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 439/886] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 11:42:28 2022] POST /identity/v3/services => generated 241 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:42:28.670091 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792092f8-b863-404b-823f-85c6276775d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:28.671216 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792092f8-b863-404b-823f-85c6276775d8 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:28.671771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792092f8-b863-404b-823f-85c6276775d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:28.672404 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792092f8-b863-404b-823f-85c6276775d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:28.676311 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ff8fd-45df-445d-adc0-7ce56a24a8f3 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:28.676720 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ff8fd-45df-445d-adc0-7ce56a24a8f3 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:28.677112 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ff8fd-45df-445d-adc0-7ce56a24a8f3 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:28.679325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 440/887] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:42:28.685069 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d79c1a-2d1e-481c-8be9-2245b9d0186d None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:28.685375 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d79c1a-2d1e-481c-8be9-2245b9d0186d None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:28.685622 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d79c1a-2d1e-481c-8be9-2245b9d0186d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:28.693650 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792092f8-b863-404b-823f-85c6276775d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:28.701891 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-792092f8-b863-404b-823f-85c6276775d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 11:42:28.704732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 448/888] 10.222.0.52 () {56 vars in 1120 bytes} [Tue Mar 8 11:42:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:28.708319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-42d79c1a-2d1e-481c-8be9-2245b9d0186d None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:28.709960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-42d79c1a-2d1e-481c-8be9-2245b9d0186d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:28.711106 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792092f8-b863-404b-823f-85c6276775d8 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:28.791996 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 441/889] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:28.794456 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e8b39-2fd6-4ae0-a8c6-9dace9d9136e None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:28.794907 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e8b39-2fd6-4ae0-a8c6-9dace9d9136e None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:28.795687 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e8b39-2fd6-4ae0-a8c6-9dace9d9136e None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:28.798801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 442/890] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:28.804051 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c541d1e-c81c-4da8-a89f-0f15a2663c84 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:28.804339 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c541d1e-c81c-4da8-a89f-0f15a2663c84 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:28.804620 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c541d1e-c81c-4da8-a89f-0f15a2663c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:28.822431 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-0c541d1e-c81c-4da8-a89f-0f15a2663c84 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:28.823550 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0c541d1e-c81c-4da8-a89f-0f15a2663c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:28.841502 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792092f8-b863-404b-823f-85c6276775d8 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:28.874656 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d3df8-962d-45a9-9a5d-829df6dae009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:28.876204 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d3df8-962d-45a9-9a5d-829df6dae009 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:28.876694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d3df8-962d-45a9-9a5d-829df6dae009 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:28.877148 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d3df8-962d-45a9-9a5d-829df6dae009 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:28.878090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d3df8-962d-45a9-9a5d-829df6dae009 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:28.878588 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d3df8-962d-45a9-9a5d-829df6dae009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:28.880178 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d3df8-962d-45a9-9a5d-829df6dae009 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:28.888653 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 449/891] 10.222.0.52 () {56 vars in 1115 bytes} [Tue Mar 8 11:42:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:28.889676 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d3df8-962d-45a9-9a5d-829df6dae009 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:28.895567 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 443/892] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:28.896627 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c541d1e-c81c-4da8-a89f-0f15a2663c84 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:28.986634 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d3df8-962d-45a9-9a5d-829df6dae009 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:28.998430 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c541d1e-c81c-4da8-a89f-0f15a2663c84 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:29.019976 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86979a74-08be-48c8-bb76-c6fc57adfced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:29.021042 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86979a74-08be-48c8-bb76-c6fc57adfced None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:29.021328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86979a74-08be-48c8-bb76-c6fc57adfced None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:29.021598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86979a74-08be-48c8-bb76-c6fc57adfced None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:29.022252 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86979a74-08be-48c8-bb76-c6fc57adfced None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:29.023907 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86979a74-08be-48c8-bb76-c6fc57adfced None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:29.032611 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a88720-9886-4a04-8428-1925b72040b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:29.033410 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a88720-9886-4a04-8428-1925b72040b4 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:29.033696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a88720-9886-4a04-8428-1925b72040b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:29.033971 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a88720-9886-4a04-8428-1925b72040b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:29.035839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-86979a74-08be-48c8-bb76-c6fc57adfced None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 08 11:42:29.037193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 450/893] 10.222.0.52 () {56 vars in 1132 bytes} [Tue Mar 8 11:42:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:29.040813 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86979a74-08be-48c8-bb76-c6fc57adfced None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:29.045019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a88720-9886-4a04-8428-1925b72040b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:29.045652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a88720-9886-4a04-8428-1925b72040b4 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:29.064215 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-a8a88720-9886-4a04-8428-1925b72040b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:29.070172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 444/894] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:29.070172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a88720-9886-4a04-8428-1925b72040b4 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:29.148800 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86979a74-08be-48c8-bb76-c6fc57adfced None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:29.168765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a88720-9886-4a04-8428-1925b72040b4 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:29.193496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060139d0-48e5-4961-8915-8d7e57af8df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:29.194398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060139d0-48e5-4961-8915-8d7e57af8df4 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:29.194788 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060139d0-48e5-4961-8915-8d7e57af8df4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:29.195203 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060139d0-48e5-4961-8915-8d7e57af8df4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:29.196018 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060139d0-48e5-4961-8915-8d7e57af8df4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:29.197514 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060139d0-48e5-4961-8915-8d7e57af8df4 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:29.213648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-060139d0-48e5-4961-8915-8d7e57af8df4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 08 11:42:29.214937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 451/895] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:42:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:29.215758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060139d0-48e5-4961-8915-8d7e57af8df4 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:29.224707 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f455f3-5b86-48d9-838d-15ef25a6b1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:29.225386 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f455f3-5b86-48d9-838d-15ef25a6b1e4 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:29.225672 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f455f3-5b86-48d9-838d-15ef25a6b1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:29.225951 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f455f3-5b86-48d9-838d-15ef25a6b1e4 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:29.226659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f455f3-5b86-48d9-838d-15ef25a6b1e4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:29.226965 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f455f3-5b86-48d9-838d-15ef25a6b1e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:29.228386 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f455f3-5b86-48d9-838d-15ef25a6b1e4 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:29.238165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 445/896] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 11:42:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:29.238165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f455f3-5b86-48d9-838d-15ef25a6b1e4 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:29.322096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060139d0-48e5-4961-8915-8d7e57af8df4 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:29.341911 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f455f3-5b86-48d9-838d-15ef25a6b1e4 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:29.357984 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18162f94-ccd4-4480-ad9d-ced3739efd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:29.358666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18162f94-ccd4-4480-ad9d-ced3739efd15 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:29.358949 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18162f94-ccd4-4480-ad9d-ced3739efd15 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:29.359896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18162f94-ccd4-4480-ad9d-ced3739efd15 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:29.360973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18162f94-ccd4-4480-ad9d-ced3739efd15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:29.361290 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18162f94-ccd4-4480-ad9d-ced3739efd15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:29.362700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18162f94-ccd4-4480-ad9d-ced3739efd15 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:29.382222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 452/897] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:29.382222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18162f94-ccd4-4480-ad9d-ced3739efd15 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:29.382543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb20025-28e6-4ade-993c-54054d5031a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:29.382863 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb20025-28e6-4ade-993c-54054d5031a8 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:29.383313 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb20025-28e6-4ade-993c-54054d5031a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:29.383624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb20025-28e6-4ade-993c-54054d5031a8 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:29.384353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb20025-28e6-4ade-993c-54054d5031a8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:29.384662 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb20025-28e6-4ade-993c-54054d5031a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:29.386041 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb20025-28e6-4ade-993c-54054d5031a8 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:29.391128 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 446/898] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:42:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:29.396073 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb20025-28e6-4ade-993c-54054d5031a8 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:29.500853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18162f94-ccd4-4480-ad9d-ced3739efd15 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:29.517421 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb20025-28e6-4ade-993c-54054d5031a8 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:29.543073 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb91f8-d3e0-4b62-96aa-8181e11de607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:29.543809 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb91f8-d3e0-4b62-96aa-8181e11de607 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:29.544093 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb91f8-d3e0-4b62-96aa-8181e11de607 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:29.544376 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb91f8-d3e0-4b62-96aa-8181e11de607 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:29.545085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb91f8-d3e0-4b62-96aa-8181e11de607 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:29.545394 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb91f8-d3e0-4b62-96aa-8181e11de607 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:29.547045 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb91f8-d3e0-4b62-96aa-8181e11de607 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:29.558448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 453/899] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 11:42:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:29.558448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb91f8-d3e0-4b62-96aa-8181e11de607 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:29.559749 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb5d96-897e-452c-aa22-5e112d79a8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:29.560584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb5d96-897e-452c-aa22-5e112d79a8d4 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:29.560888 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb5d96-897e-452c-aa22-5e112d79a8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:29.561159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb5d96-897e-452c-aa22-5e112d79a8d4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:29.569555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb5d96-897e-452c-aa22-5e112d79a8d4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:29.571019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb5d96-897e-452c-aa22-5e112d79a8d4 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:29.588222 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-19fb5d96-897e-452c-aa22-5e112d79a8d4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 11:42:29.594767 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 447/900] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 11:42:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:29.594767 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb5d96-897e-452c-aa22-5e112d79a8d4 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:29.680185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb91f8-d3e0-4b62-96aa-8181e11de607 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:29.702485 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb5d96-897e-452c-aa22-5e112d79a8d4 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:29.718295 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0620-1a3a-463b-bbad-c5382681bcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:29.720036 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0620-1a3a-463b-bbad-c5382681bcf1 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:29.720488 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0620-1a3a-463b-bbad-c5382681bcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:29.721197 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0620-1a3a-463b-bbad-c5382681bcf1 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:29.722179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0620-1a3a-463b-bbad-c5382681bcf1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:29.722939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0620-1a3a-463b-bbad-c5382681bcf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:29.724695 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0620-1a3a-463b-bbad-c5382681bcf1 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:29.729852 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 454/901] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:42:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:29.730684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0620-1a3a-463b-bbad-c5382681bcf1 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:29.740671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310e499-6636-47fc-9b99-f2600af929f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:29.741539 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310e499-6636-47fc-9b99-f2600af929f8 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:29.741832 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310e499-6636-47fc-9b99-f2600af929f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:29.742107 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310e499-6636-47fc-9b99-f2600af929f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:29.743428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310e499-6636-47fc-9b99-f2600af929f8 None admin] RBAC: Adding query filter params (interface=public, service_id=43ec89e51efa4558aa06726de883bd15, region_id=RegionOne) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:29.743428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310e499-6636-47fc-9b99-f2600af929f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:29.744650 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310e499-6636-47fc-9b99-f2600af929f8 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:29.751417 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 448/902] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 11:42:29 2022] GET /identity/v3/endpoints?service_id=43ec89e51efa4558aa06726de883bd15&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:29.751417 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310e499-6636-47fc-9b99-f2600af929f8 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:29.866628 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0620-1a3a-463b-bbad-c5382681bcf1 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:29.870986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310e499-6636-47fc-9b99-f2600af929f8 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:29.905812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5991e-0bd6-4df0-aa2a-c571a4fd40bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:29.907257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d5ded-11ea-4eb4-8c78-7decd6057e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:29.907556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5991e-0bd6-4df0-aa2a-c571a4fd40bc None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:29.907849 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5991e-0bd6-4df0-aa2a-c571a4fd40bc None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:29.908127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5991e-0bd6-4df0-aa2a-c571a4fd40bc None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:29.908805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d5ded-11ea-4eb4-8c78-7decd6057e50 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:29.908976 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5991e-0bd6-4df0-aa2a-c571a4fd40bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:29.909274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5991e-0bd6-4df0-aa2a-c571a4fd40bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:29.909632 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d5ded-11ea-4eb4-8c78-7decd6057e50 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:29.910093 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d5ded-11ea-4eb4-8c78-7decd6057e50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:29.910938 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5991e-0bd6-4df0-aa2a-c571a4fd40bc None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:29.911889 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d5ded-11ea-4eb4-8c78-7decd6057e50 None admin] RBAC: Adding query filter params (interface=public, service_id=264b571a7df74cd18f371a9f773c8a87, region_id=RegionOne) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:29.912416 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d5ded-11ea-4eb4-8c78-7decd6057e50 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:29.914017 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d5ded-11ea-4eb4-8c78-7decd6057e50 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:29.920085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 449/903] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 11:42:29 2022] GET /identity/v3/endpoints?service_id=264b571a7df74cd18f371a9f773c8a87&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:29.921023 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d5ded-11ea-4eb4-8c78-7decd6057e50 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:29.935463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 455/904] 10.222.0.52 () {56 vars in 1149 bytes} [Tue Mar 8 11:42:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:29.936608 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5991e-0bd6-4df0-aa2a-c571a4fd40bc None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:30.050881 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5991e-0bd6-4df0-aa2a-c571a4fd40bc None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:30.056166 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d5ded-11ea-4eb4-8c78-7decd6057e50 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:30.089578 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb76191-511f-4a6e-8064-c741cc33faa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:30.090350 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb76191-511f-4a6e-8064-c741cc33faa6 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:30.090648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb76191-511f-4a6e-8064-c741cc33faa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:30.090923 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb76191-511f-4a6e-8064-c741cc33faa6 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:30.091641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb76191-511f-4a6e-8064-c741cc33faa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:30.093051 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb76191-511f-4a6e-8064-c741cc33faa6 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:30.097620 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cc1a8-21c5-47d0-b37e-bfbc7075f31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:30.098289 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cc1a8-21c5-47d0-b37e-bfbc7075f31a None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:30.098573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cc1a8-21c5-47d0-b37e-bfbc7075f31a None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:30.098977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cc1a8-21c5-47d0-b37e-bfbc7075f31a None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:30.099684 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cc1a8-21c5-47d0-b37e-bfbc7075f31a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:30.107692 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 456/905] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 11:42:29 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 11:42:30.107692 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb76191-511f-4a6e-8064-c741cc33faa6 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:30.107973 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cc1a8-21c5-47d0-b37e-bfbc7075f31a None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:30.117278 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 450/906] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 11:42:29 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 11:42:30.252772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb76191-511f-4a6e-8064-c741cc33faa6 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:30.296549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be94d8c-1a33-45eb-ad76-81d8e8c57ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:30.297936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be94d8c-1a33-45eb-ad76-81d8e8c57ab5 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:30.298296 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be94d8c-1a33-45eb-ad76-81d8e8c57ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:30.298467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be94d8c-1a33-45eb-ad76-81d8e8c57ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:30.376636 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be94d8c-1a33-45eb-ad76-81d8e8c57ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:30.378156 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be94d8c-1a33-45eb-ad76-81d8e8c57ab5 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:30.480812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 457/907] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:30 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:42:30.487219 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cc1a8-21c5-47d0-b37e-bfbc7075f31a None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:30.588701 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cc1a8-21c5-47d0-b37e-bfbc7075f31a None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:30.622202 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ec5d7-3527-43e0-953f-ba7261a0b072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:30.623500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ec5d7-3527-43e0-953f-ba7261a0b072 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:30.624047 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ec5d7-3527-43e0-953f-ba7261a0b072 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:30.624556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ec5d7-3527-43e0-953f-ba7261a0b072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:30.638998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ec5d7-3527-43e0-953f-ba7261a0b072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:30.640444 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ec5d7-3527-43e0-953f-ba7261a0b072 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:30.657988 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-ac3ec5d7-3527-43e0-953f-ba7261a0b072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:30.659491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 451/908] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:30.664995 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be94d8c-1a33-45eb-ad76-81d8e8c57ab5 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:30.774635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be94d8c-1a33-45eb-ad76-81d8e8c57ab5 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:30.808354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252267fb-b624-45c8-917f-a71ff920e648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:30.809009 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252267fb-b624-45c8-917f-a71ff920e648 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:30.809287 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252267fb-b624-45c8-917f-a71ff920e648 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:30.809558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252267fb-b624-45c8-917f-a71ff920e648 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:30.810265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252267fb-b624-45c8-917f-a71ff920e648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:30.810567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252267fb-b624-45c8-917f-a71ff920e648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:30.811963 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252267fb-b624-45c8-917f-a71ff920e648 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:30.823307 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 458/909] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:30.828593 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ec5d7-3527-43e0-953f-ba7261a0b072 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:30.928685 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ec5d7-3527-43e0-953f-ba7261a0b072 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:30.963554 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e64b61-74e6-4db4-b5a7-80ec471a43c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:30.964727 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e64b61-74e6-4db4-b5a7-80ec471a43c9 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:30.965207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e64b61-74e6-4db4-b5a7-80ec471a43c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:30.965702 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e64b61-74e6-4db4-b5a7-80ec471a43c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:30.973448 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e64b61-74e6-4db4-b5a7-80ec471a43c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:30.975166 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e64b61-74e6-4db4-b5a7-80ec471a43c9 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:30.989021 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-50e64b61-74e6-4db4-b5a7-80ec471a43c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:30.990538 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 452/910] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:30.996551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252267fb-b624-45c8-917f-a71ff920e648 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:31.079467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c408bf0-a5de-4e03-ac92-2a4aca75f974 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:31.079835 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c408bf0-a5de-4e03-ac92-2a4aca75f974 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:31.080058 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c408bf0-a5de-4e03-ac92-2a4aca75f974 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:31.082568 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 453/911] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:42:31.088763 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3019fcf-df21-4d6a-9b8f-133368445535 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:31.089043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3019fcf-df21-4d6a-9b8f-133368445535 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:31.089321 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3019fcf-df21-4d6a-9b8f-133368445535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:31.108153 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-e3019fcf-df21-4d6a-9b8f-133368445535 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:31.110275 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e3019fcf-df21-4d6a-9b8f-133368445535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:31.122212 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252267fb-b624-45c8-917f-a71ff920e648 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:31.167043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a454b-2580-429f-bb65-8864baa47155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:31.168676 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a454b-2580-429f-bb65-8864baa47155 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:31.169170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a454b-2580-429f-bb65-8864baa47155 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:31.169814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a454b-2580-429f-bb65-8864baa47155 None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:31.171386 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a454b-2580-429f-bb65-8864baa47155 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:31.172690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a454b-2580-429f-bb65-8864baa47155 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:31.174927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a454b-2580-429f-bb65-8864baa47155 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:31.183702 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 454/912] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:31.189078 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 459/913] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:31.194610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3019fcf-df21-4d6a-9b8f-133368445535 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:31.205064 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a454b-2580-429f-bb65-8864baa47155 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:31.298062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3019fcf-df21-4d6a-9b8f-133368445535 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:31.325544 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a454b-2580-429f-bb65-8864baa47155 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:31.332556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2eafb-1424-4b59-8bc7-d273aad233e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:31.333229 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2eafb-1424-4b59-8bc7-d273aad233e5 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:31.333508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2eafb-1424-4b59-8bc7-d273aad233e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:31.333779 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2eafb-1424-4b59-8bc7-d273aad233e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:31.334606 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2eafb-1424-4b59-8bc7-d273aad233e5 None admin] RBAC: Adding query filter params (role.id=5b24bb8e8b36434f986d06603c8ac351, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=34d5824ea4a54b65a3eaa6deeb9dc416) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:31.334915 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2eafb-1424-4b59-8bc7-d273aad233e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:31.336388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2eafb-1424-4b59-8bc7-d273aad233e5 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:31.342728 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 455/914] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:31 2022] GET /identity/v3/role_assignments?user.id=34d5824ea4a54b65a3eaa6deeb9dc416&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=5b24bb8e8b36434f986d06603c8ac351 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:31.370539 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91714e-df77-472d-ac15-ade4b7f73229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:31.371712 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91714e-df77-472d-ac15-ade4b7f73229 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:31.372175 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91714e-df77-472d-ac15-ade4b7f73229 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:31.372602 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91714e-df77-472d-ac15-ade4b7f73229 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:31.373441 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91714e-df77-472d-ac15-ade4b7f73229 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:31.375822 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91714e-df77-472d-ac15-ade4b7f73229 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:31.388502 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-ee91714e-df77-472d-ac15-ade4b7f73229 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 11:42:31.391968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 460/915] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 11:42:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:31.398866 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2eafb-1424-4b59-8bc7-d273aad233e5 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:31.513643 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2eafb-1424-4b59-8bc7-d273aad233e5 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:31.551166 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d35ab-c33a-4d2b-9531-e7a35372a71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:31.551861 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d35ab-c33a-4d2b-9531-e7a35372a71e None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:31.552143 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d35ab-c33a-4d2b-9531-e7a35372a71e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:31.552414 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d35ab-c33a-4d2b-9531-e7a35372a71e None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:31.553112 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d35ab-c33a-4d2b-9531-e7a35372a71e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:31.553414 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d35ab-c33a-4d2b-9531-e7a35372a71e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:31.554784 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d35ab-c33a-4d2b-9531-e7a35372a71e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:31.563631 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 456/916] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 11:42:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:31.566068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91714e-df77-472d-ac15-ade4b7f73229 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:31.671179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91714e-df77-472d-ac15-ade4b7f73229 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:31.706674 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a1dd7-e4eb-47e1-9d3a-b8808dc1ad72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:31.707350 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a1dd7-e4eb-47e1-9d3a-b8808dc1ad72 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:31.707659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a1dd7-e4eb-47e1-9d3a-b8808dc1ad72 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:31.707937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a1dd7-e4eb-47e1-9d3a-b8808dc1ad72 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:31.708645 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a1dd7-e4eb-47e1-9d3a-b8808dc1ad72 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:31.708955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a1dd7-e4eb-47e1-9d3a-b8808dc1ad72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:31.710341 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a1dd7-e4eb-47e1-9d3a-b8808dc1ad72 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:31.715773 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 461/917] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 11:42:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:31.721829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d35ab-c33a-4d2b-9531-e7a35372a71e None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:31.818117 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d35ab-c33a-4d2b-9531-e7a35372a71e None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:31.861096 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542106ed-2779-47fe-b922-6eec39d17427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:31.862136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542106ed-2779-47fe-b922-6eec39d17427 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:31.862642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542106ed-2779-47fe-b922-6eec39d17427 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:31.863129 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542106ed-2779-47fe-b922-6eec39d17427 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:31.864159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542106ed-2779-47fe-b922-6eec39d17427 None admin] RBAC: Adding query filter params (interface=public, service_id=cbd75833219144369a01d1f47c9c4071, region_id=RegionOne) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:31.864680 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542106ed-2779-47fe-b922-6eec39d17427 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:31.866248 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542106ed-2779-47fe-b922-6eec39d17427 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:31.872259 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 457/918] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 11:42:31 2022] GET /identity/v3/endpoints?service_id=cbd75833219144369a01d1f47c9c4071&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:31.880558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a1dd7-e4eb-47e1-9d3a-b8808dc1ad72 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:31.978355 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a1dd7-e4eb-47e1-9d3a-b8808dc1ad72 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:32.011677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd33151-f7de-4238-b2e1-ec4b7f3d1c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:32.012401 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd33151-f7de-4238-b2e1-ec4b7f3d1c1f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:32.012683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd33151-f7de-4238-b2e1-ec4b7f3d1c1f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:32.013014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd33151-f7de-4238-b2e1-ec4b7f3d1c1f None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:32.013699 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd33151-f7de-4238-b2e1-ec4b7f3d1c1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:32.015133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd33151-f7de-4238-b2e1-ec4b7f3d1c1f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:32.022256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 462/919] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 11:42:31 2022] GET /identity/v3/services => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 11:42:32.625255 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212f203-d110-4ead-abf6-7d31ee0acced None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:32.625845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212f203-d110-4ead-abf6-7d31ee0acced None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:32.625845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212f203-d110-4ead-abf6-7d31ee0acced None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:32.626729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2176286-daa9-494a-a512-1750b2d500a7 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:32.627580 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2176286-daa9-494a-a512-1750b2d500a7 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:32.627809 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 458/920] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:32.628282 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2176286-daa9-494a-a512-1750b2d500a7 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:32.630678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 463/921] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:32.632634 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00dd05-8a44-4787-883c-77a798e515b8 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:32.633169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00dd05-8a44-4787-883c-77a798e515b8 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:32.633670 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00dd05-8a44-4787-883c-77a798e515b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:32.635355 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921ea8e-4c08-4847-b1e6-b709fac34b7b None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:32.635827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921ea8e-4c08-4847-b1e6-b709fac34b7b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:32.636256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921ea8e-4c08-4847-b1e6-b709fac34b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:32.653427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-3e00dd05-8a44-4787-883c-77a798e515b8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:32.653979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-4921ea8e-4c08-4847-b1e6-b709fac34b7b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:32.654853 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-3e00dd05-8a44-4787-883c-77a798e515b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:32.655468 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-4921ea8e-4c08-4847-b1e6-b709fac34b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:32.739602 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 459/922] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:32.744398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 464/923] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:32.757267 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00dd05-8a44-4787-883c-77a798e515b8 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:32.770874 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921ea8e-4c08-4847-b1e6-b709fac34b7b None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:32.869149 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921ea8e-4c08-4847-b1e6-b709fac34b7b None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:32.878124 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00dd05-8a44-4787-883c-77a798e515b8 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:32.907171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200d8f0-de39-4554-9507-1eeaa26f57cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:32.908472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200d8f0-de39-4554-9507-1eeaa26f57cc None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:32.909202 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200d8f0-de39-4554-9507-1eeaa26f57cc None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:32.909896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200d8f0-de39-4554-9507-1eeaa26f57cc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:32.910701 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200d8f0-de39-4554-9507-1eeaa26f57cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:32.912959 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200d8f0-de39-4554-9507-1eeaa26f57cc None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:32.919355 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fff8e-b836-4640-a4aa-7811c535211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:32.920245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fff8e-b836-4640-a4aa-7811c535211e None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:32.920674 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fff8e-b836-4640-a4aa-7811c535211e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:32.921010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fff8e-b836-4640-a4aa-7811c535211e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:32.922135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fff8e-b836-4640-a4aa-7811c535211e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:32.923427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fff8e-b836-4640-a4aa-7811c535211e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:32.927846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-b200d8f0-de39-4554-9507-1eeaa26f57cc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 08 11:42:32.929508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 465/924] 10.222.0.52 () {56 vars in 1132 bytes} [Tue Mar 8 11:42:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:32.941968 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-200fff8e-b836-4640-a4aa-7811c535211e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 08 11:42:32.942152 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200d8f0-de39-4554-9507-1eeaa26f57cc None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:32.942250 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 460/925] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:42:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:32.943126 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fff8e-b836-4640-a4aa-7811c535211e None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:33.050145 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200d8f0-de39-4554-9507-1eeaa26f57cc None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:33.076219 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fff8e-b836-4640-a4aa-7811c535211e None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:33.086704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1cefb-0b54-414f-b353-a32b3e251ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:33.087379 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1cefb-0b54-414f-b353-a32b3e251ae3 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:33.087693 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1cefb-0b54-414f-b353-a32b3e251ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:33.087979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1cefb-0b54-414f-b353-a32b3e251ae3 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:33.088689 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1cefb-0b54-414f-b353-a32b3e251ae3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:33.088999 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1cefb-0b54-414f-b353-a32b3e251ae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:33.090381 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1cefb-0b54-414f-b353-a32b3e251ae3 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:33.099975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 466/926] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 11:42:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:33.101678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1cefb-0b54-414f-b353-a32b3e251ae3 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:33.115565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105c2e3-b2ff-4d27-a8e4-d57eaeffae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:33.116241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105c2e3-b2ff-4d27-a8e4-d57eaeffae3f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:33.116521 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105c2e3-b2ff-4d27-a8e4-d57eaeffae3f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:33.116794 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105c2e3-b2ff-4d27-a8e4-d57eaeffae3f None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:33.117502 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105c2e3-b2ff-4d27-a8e4-d57eaeffae3f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:33.117807 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105c2e3-b2ff-4d27-a8e4-d57eaeffae3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:33.119169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105c2e3-b2ff-4d27-a8e4-d57eaeffae3f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:33.124357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 461/927] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:42:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:33.132860 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105c2e3-b2ff-4d27-a8e4-d57eaeffae3f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:33.225508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1cefb-0b54-414f-b353-a32b3e251ae3 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:33.264844 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892338f4-1abd-415e-8d0b-16524fe5092a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:33.265594 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105c2e3-b2ff-4d27-a8e4-d57eaeffae3f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:33.266636 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892338f4-1abd-415e-8d0b-16524fe5092a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:33.267075 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892338f4-1abd-415e-8d0b-16524fe5092a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:33.267499 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892338f4-1abd-415e-8d0b-16524fe5092a None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:33.268391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892338f4-1abd-415e-8d0b-16524fe5092a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:33.268866 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892338f4-1abd-415e-8d0b-16524fe5092a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:33.270488 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892338f4-1abd-415e-8d0b-16524fe5092a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:33.279873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 467/928] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 11:42:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:33.283784 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892338f4-1abd-415e-8d0b-16524fe5092a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:33.308672 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940c4a5-2ef5-4aa0-9f55-696245dd9725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:33.309355 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c4a5-2ef5-4aa0-9f55-696245dd9725 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:33.309641 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c4a5-2ef5-4aa0-9f55-696245dd9725 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:33.309920 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c4a5-2ef5-4aa0-9f55-696245dd9725 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:33.310801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940c4a5-2ef5-4aa0-9f55-696245dd9725 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:33.311116 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940c4a5-2ef5-4aa0-9f55-696245dd9725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:33.313697 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940c4a5-2ef5-4aa0-9f55-696245dd9725 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:33.325803 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 462/929] 10.222.0.52 () {56 vars in 1114 bytes} [Tue Mar 8 11:42:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:33.326882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940c4a5-2ef5-4aa0-9f55-696245dd9725 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:33.402204 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892338f4-1abd-415e-8d0b-16524fe5092a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:33.442413 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7178491-8dc0-4014-b775-84aea3b412f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:33.443410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7178491-8dc0-4014-b775-84aea3b412f9 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:33.444054 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7178491-8dc0-4014-b775-84aea3b412f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:33.444338 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7178491-8dc0-4014-b775-84aea3b412f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:33.445144 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7178491-8dc0-4014-b775-84aea3b412f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:33.447054 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7178491-8dc0-4014-b775-84aea3b412f9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:33.449481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940c4a5-2ef5-4aa0-9f55-696245dd9725 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:33.485760 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a87a6a-2448-4fa4-965b-4ec2d5359e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:33.486600 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a87a6a-2448-4fa4-965b-4ec2d5359e48 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:33.486890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a87a6a-2448-4fa4-965b-4ec2d5359e48 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:33.487169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a87a6a-2448-4fa4-965b-4ec2d5359e48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:33.487943 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a87a6a-2448-4fa4-965b-4ec2d5359e48 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:33.489336 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a87a6a-2448-4fa4-965b-4ec2d5359e48 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:33.528431 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 468/930] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 11:42:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 11:42:33.639377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 463/931] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 11:42:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:42:33.803958 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a142f29-32de-4835-8f9d-442aeba09b7b None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:33.804510 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a142f29-32de-4835-8f9d-442aeba09b7b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:33.804510 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a142f29-32de-4835-8f9d-442aeba09b7b None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:33.806569 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 469/932] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:33.813275 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebd3b6-9c47-4954-a83e-893a060e9a7d None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:33.813720 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebd3b6-9c47-4954-a83e-893a060e9a7d None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:33.814096 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebd3b6-9c47-4954-a83e-893a060e9a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:33.833020 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-c3ebd3b6-9c47-4954-a83e-893a060e9a7d None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:33.834396 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c3ebd3b6-9c47-4954-a83e-893a060e9a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:33.916959 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 464/933] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:33.939278 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a142f29-32de-4835-8f9d-442aeba09b7b None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:34.044720 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a142f29-32de-4835-8f9d-442aeba09b7b None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:34.088000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e5df7-3107-49f5-b401-6740111af8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:34.089514 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e5df7-3107-49f5-b401-6740111af8da None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:34.089987 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e5df7-3107-49f5-b401-6740111af8da None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:34.090481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e5df7-3107-49f5-b401-6740111af8da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:34.106555 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e5df7-3107-49f5-b401-6740111af8da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:34.115166 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-d95e5df7-3107-49f5-b401-6740111af8da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 11:42:34.117203 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 470/934] 10.222.0.52 () {56 vars in 1120 bytes} [Tue Mar 8 11:42:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:34.124730 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebd3b6-9c47-4954-a83e-893a060e9a7d None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:34.257585 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebd3b6-9c47-4954-a83e-893a060e9a7d None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:34.304252 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafd67f-b0dd-4c33-a571-b3518c25bee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:34.304935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafd67f-b0dd-4c33-a571-b3518c25bee0 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:34.305213 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafd67f-b0dd-4c33-a571-b3518c25bee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:34.305488 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafd67f-b0dd-4c33-a571-b3518c25bee0 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:34.306250 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafd67f-b0dd-4c33-a571-b3518c25bee0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:34.306548 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafd67f-b0dd-4c33-a571-b3518c25bee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:34.307953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafd67f-b0dd-4c33-a571-b3518c25bee0 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:34.320821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 465/935] 10.222.0.52 () {56 vars in 1115 bytes} [Tue Mar 8 11:42:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:34.326452 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e5df7-3107-49f5-b401-6740111af8da None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:34.447495 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e5df7-3107-49f5-b401-6740111af8da None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:34.483662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a749ca-7a93-43b6-9975-ebb1808845a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:34.485154 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a749ca-7a93-43b6-9975-ebb1808845a4 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:34.485442 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a749ca-7a93-43b6-9975-ebb1808845a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:34.485719 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a749ca-7a93-43b6-9975-ebb1808845a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:34.496679 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a749ca-7a93-43b6-9975-ebb1808845a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:34.498154 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a749ca-7a93-43b6-9975-ebb1808845a4 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:34.515270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-20a749ca-7a93-43b6-9975-ebb1808845a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:34.516991 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 471/936] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:34.522233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafd67f-b0dd-4c33-a571-b3518c25bee0 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:34.544126 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a659c9-5f02-4a6f-9820-eeef149a7b21 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:34.544421 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a659c9-5f02-4a6f-9820-eeef149a7b21 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:34.544691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a659c9-5f02-4a6f-9820-eeef149a7b21 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:34.547509 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 472/937] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:42:34.552807 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009869e-5231-4894-816c-d7bc4d409754 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:34.553100 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009869e-5231-4894-816c-d7bc4d409754 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:34.553379 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009869e-5231-4894-816c-d7bc4d409754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:34.571023 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-1009869e-5231-4894-816c-d7bc4d409754 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:34.572303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-1009869e-5231-4894-816c-d7bc4d409754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:34.623020 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafd67f-b0dd-4c33-a571-b3518c25bee0 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:34.647829 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 473/938] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:34.662008 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ba308-6ed4-40e8-a252-a72c63f08396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:34.667543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba308-6ed4-40e8-a252-a72c63f08396 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:34.667543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba308-6ed4-40e8-a252-a72c63f08396 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:34.667543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba308-6ed4-40e8-a252-a72c63f08396 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:34.667543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ba308-6ed4-40e8-a252-a72c63f08396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:34.667543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ba308-6ed4-40e8-a252-a72c63f08396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:34.667911 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009869e-5231-4894-816c-d7bc4d409754 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:34.668644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ba308-6ed4-40e8-a252-a72c63f08396 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:34.685103 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 466/939] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:34.690589 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ba308-6ed4-40e8-a252-a72c63f08396 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:34.773392 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009869e-5231-4894-816c-d7bc4d409754 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:34.790233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ba308-6ed4-40e8-a252-a72c63f08396 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:34.809094 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66338f24-49f9-4780-824f-e3a3c18a8a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:34.809908 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66338f24-49f9-4780-824f-e3a3c18a8a35 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:34.810194 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66338f24-49f9-4780-824f-e3a3c18a8a35 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:34.810471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66338f24-49f9-4780-824f-e3a3c18a8a35 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:34.811130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66338f24-49f9-4780-824f-e3a3c18a8a35 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:34.813594 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66338f24-49f9-4780-824f-e3a3c18a8a35 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:34.825113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842f12c-45ff-4444-9d83-36ddd184a9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:34.825917 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-66338f24-49f9-4780-824f-e3a3c18a8a35 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 11:42:34.826090 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842f12c-45ff-4444-9d83-36ddd184a9fe None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:34.826236 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842f12c-45ff-4444-9d83-36ddd184a9fe None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:34.826457 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842f12c-45ff-4444-9d83-36ddd184a9fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:34.831956 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 474/940] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 11:42:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:34.834580 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66338f24-49f9-4780-824f-e3a3c18a8a35 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:34.835499 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842f12c-45ff-4444-9d83-36ddd184a9fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:34.836993 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842f12c-45ff-4444-9d83-36ddd184a9fe None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:34.852357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-5842f12c-45ff-4444-9d83-36ddd184a9fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 11:42:34.853883 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 467/941] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 11:42:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:34.859477 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842f12c-45ff-4444-9d83-36ddd184a9fe None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:34.942183 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66338f24-49f9-4780-824f-e3a3c18a8a35 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:34.957141 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842f12c-45ff-4444-9d83-36ddd184a9fe None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:34.979601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13560407-fcb2-4c13-8678-061ed8714f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:34.980296 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13560407-fcb2-4c13-8678-061ed8714f11 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:34.980764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13560407-fcb2-4c13-8678-061ed8714f11 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:34.981050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13560407-fcb2-4c13-8678-061ed8714f11 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:34.981782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13560407-fcb2-4c13-8678-061ed8714f11 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:34.982090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13560407-fcb2-4c13-8678-061ed8714f11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:34.983510 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13560407-fcb2-4c13-8678-061ed8714f11 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:34.993777 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 475/942] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 11:42:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:34.994215 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8a1f1-ba44-4356-97c9-02cca386ff2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:34.994733 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13560407-fcb2-4c13-8678-061ed8714f11 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:34.994904 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8a1f1-ba44-4356-97c9-02cca386ff2c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:34.995156 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8a1f1-ba44-4356-97c9-02cca386ff2c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:34.995433 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8a1f1-ba44-4356-97c9-02cca386ff2c None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:34.996302 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8a1f1-ba44-4356-97c9-02cca386ff2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:34.996606 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8a1f1-ba44-4356-97c9-02cca386ff2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:34.998045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8a1f1-ba44-4356-97c9-02cca386ff2c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:35.019638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 468/943] 10.222.0.52 () {56 vars in 1149 bytes} [Tue Mar 8 11:42:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:35.021579 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8a1f1-ba44-4356-97c9-02cca386ff2c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:35.097668 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13560407-fcb2-4c13-8678-061ed8714f11 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:35.119085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8a1f1-ba44-4356-97c9-02cca386ff2c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:35.132758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e745edd-0a9d-4798-ac7a-790a166c334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:35.133429 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e745edd-0a9d-4798-ac7a-790a166c334a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:35.133716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e745edd-0a9d-4798-ac7a-790a166c334a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:35.133996 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e745edd-0a9d-4798-ac7a-790a166c334a None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:35.134700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e745edd-0a9d-4798-ac7a-790a166c334a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:35.135069 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e745edd-0a9d-4798-ac7a-790a166c334a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:35.136661 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e745edd-0a9d-4798-ac7a-790a166c334a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:35.147143 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 476/944] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 11:42:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:35.148320 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e745edd-0a9d-4798-ac7a-790a166c334a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:35.154166 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8823c00-04ce-43a2-9692-5356e0059c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:35.154961 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8823c00-04ce-43a2-9692-5356e0059c47 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:35.155234 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8823c00-04ce-43a2-9692-5356e0059c47 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:35.155499 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8823c00-04ce-43a2-9692-5356e0059c47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:35.165680 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8823c00-04ce-43a2-9692-5356e0059c47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:35.167123 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8823c00-04ce-43a2-9692-5356e0059c47 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:35.183838 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-a8823c00-04ce-43a2-9692-5356e0059c47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:35.193581 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 469/945] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:35.193581 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8823c00-04ce-43a2-9692-5356e0059c47 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:35.249473 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e745edd-0a9d-4798-ac7a-790a166c334a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:35.283999 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fe333-e145-4999-9bc6-4a34fb777339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:35.284665 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fe333-e145-4999-9bc6-4a34fb777339 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:35.284950 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fe333-e145-4999-9bc6-4a34fb777339 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:35.285225 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fe333-e145-4999-9bc6-4a34fb777339 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:35.286031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fe333-e145-4999-9bc6-4a34fb777339 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:35.287651 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fe333-e145-4999-9bc6-4a34fb777339 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:35.293523 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8823c00-04ce-43a2-9692-5356e0059c47 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:35.328201 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41791e26-85ea-43be-b942-77a1ad1ddf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:35.328870 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41791e26-85ea-43be-b942-77a1ad1ddf88 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:35.329147 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41791e26-85ea-43be-b942-77a1ad1ddf88 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:35.329419 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41791e26-85ea-43be-b942-77a1ad1ddf88 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:35.330125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41791e26-85ea-43be-b942-77a1ad1ddf88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:35.330427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41791e26-85ea-43be-b942-77a1ad1ddf88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:35.331805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41791e26-85ea-43be-b942-77a1ad1ddf88 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:35.343062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 470/946] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:35.349071 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41791e26-85ea-43be-b942-77a1ad1ddf88 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:35.379843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 477/947] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 11:42:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:42:35.470402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41791e26-85ea-43be-b942-77a1ad1ddf88 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:35.514796 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15f6f3-96ce-4617-bcd0-52cecdf3663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:35.516681 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15f6f3-96ce-4617-bcd0-52cecdf3663f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:35.517221 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15f6f3-96ce-4617-bcd0-52cecdf3663f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:35.517750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15f6f3-96ce-4617-bcd0-52cecdf3663f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:35.526114 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15f6f3-96ce-4617-bcd0-52cecdf3663f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:35.528016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15f6f3-96ce-4617-bcd0-52cecdf3663f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:35.543942 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-2b15f6f3-96ce-4617-bcd0-52cecdf3663f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:35.545878 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 471/948] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:35.553106 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fe333-e145-4999-9bc6-4a34fb777339 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:35.658464 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fe333-e145-4999-9bc6-4a34fb777339 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:35.694451 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfde8e5-e811-45c4-9cfe-ce8bd6d547bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:35.695480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfde8e5-e811-45c4-9cfe-ce8bd6d547bc None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:35.695956 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfde8e5-e811-45c4-9cfe-ce8bd6d547bc None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:35.696394 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfde8e5-e811-45c4-9cfe-ce8bd6d547bc None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:35.711390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfde8e5-e811-45c4-9cfe-ce8bd6d547bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:35.711390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfde8e5-e811-45c4-9cfe-ce8bd6d547bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:35.711390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfde8e5-e811-45c4-9cfe-ce8bd6d547bc None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:35.714782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 478/949] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:35.721143 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15f6f3-96ce-4617-bcd0-52cecdf3663f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:35.826039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15f6f3-96ce-4617-bcd0-52cecdf3663f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:35.866075 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addee6f2-7ef8-4b5d-82cb-6ca333b7afa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:35.866991 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addee6f2-7ef8-4b5d-82cb-6ca333b7afa3 None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:35.867274 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addee6f2-7ef8-4b5d-82cb-6ca333b7afa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:35.868769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addee6f2-7ef8-4b5d-82cb-6ca333b7afa3 None admin] PATH_INFO: `/v3/projects/7c390663688b466f98ff480c31ba21bc/users/34d5824ea4a54b65a3eaa6deeb9dc416/roles/5b24bb8e8b36434f986d06603c8ac351` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:35.870844 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addee6f2-7ef8-4b5d-82cb-6ca333b7afa3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c390663688b466f98ff480c31ba21bc, user_id=34d5824ea4a54b65a3eaa6deeb9dc416, role_id=5b24bb8e8b36434f986d06603c8ac351)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:35.872434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addee6f2-7ef8-4b5d-82cb-6ca333b7afa3 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:35.941312 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 472/950] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:42:35 2022] PUT /identity/v3/projects/7c390663688b466f98ff480c31ba21bc/users/34d5824ea4a54b65a3eaa6deeb9dc416/roles/5b24bb8e8b36434f986d06603c8ac351 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:42:36.072124 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58f4d7-e0be-4770-9dd3-8e917d0c4939 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:36.072680 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58f4d7-e0be-4770-9dd3-8e917d0c4939 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:36.072680 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58f4d7-e0be-4770-9dd3-8e917d0c4939 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:36.074861 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 479/951] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:36.081007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eecdc-e974-4b35-aee6-293b3d3ddf70 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:36.081667 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eecdc-e974-4b35-aee6-293b3d3ddf70 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:36.081973 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eecdc-e974-4b35-aee6-293b3d3ddf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:36.111984 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-314eecdc-e974-4b35-aee6-293b3d3ddf70 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:36.113213 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-314eecdc-e974-4b35-aee6-293b3d3ddf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:36.167177 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fdfab-3b71-46fa-8ed1-71d1d2e3c231 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:36.167458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fdfab-3b71-46fa-8ed1-71d1d2e3c231 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:36.167763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fdfab-3b71-46fa-8ed1-71d1d2e3c231 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:36.169656 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 480/952] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:36.175387 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff09567-377a-4a5f-b664-01c0654231bd None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:36.175694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff09567-377a-4a5f-b664-01c0654231bd None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:36.175966 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff09567-377a-4a5f-b664-01c0654231bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:36.190952 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 473/953] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:36.209171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-7ff09567-377a-4a5f-b664-01c0654231bd None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:36.210481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-7ff09567-377a-4a5f-b664-01c0654231bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:36.211010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314eecdc-e974-4b35-aee6-293b3d3ddf70 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:36.300124 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 481/954] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:36.315821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314eecdc-e974-4b35-aee6-293b3d3ddf70 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:36.324401 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff09567-377a-4a5f-b664-01c0654231bd None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:36.351380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2b78e-e672-4a82-ac59-b8cd3f3d3819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:36.352242 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2b78e-e672-4a82-ac59-b8cd3f3d3819 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:36.352517 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2b78e-e672-4a82-ac59-b8cd3f3d3819 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:36.352791 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2b78e-e672-4a82-ac59-b8cd3f3d3819 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:36.353496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2b78e-e672-4a82-ac59-b8cd3f3d3819 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:36.354865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2b78e-e672-4a82-ac59-b8cd3f3d3819 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:36.366016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-59b2b78e-e672-4a82-ac59-b8cd3f3d3819 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 08 11:42:36.367607 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 474/955] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:36.373460 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2b78e-e672-4a82-ac59-b8cd3f3d3819 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:36.441194 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff09567-377a-4a5f-b664-01c0654231bd None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:36.480022 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b406c-c359-407e-a644-0544f9977dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:36.480810 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b406c-c359-407e-a644-0544f9977dd4 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:36.481095 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b406c-c359-407e-a644-0544f9977dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:36.481390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b406c-c359-407e-a644-0544f9977dd4 None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:36.482102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b406c-c359-407e-a644-0544f9977dd4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:36.484124 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b406c-c359-407e-a644-0544f9977dd4 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:36.485518 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.common [None req-997b406c-c359-407e-a644-0544f9977dd4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 08 11:42:36.497876 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2b78e-e672-4a82-ac59-b8cd3f3d3819 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:36.523219 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.sql.core [None req-997b406c-c359-407e-a644-0544f9977dd4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 08 11:42:36.523219 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 08 11:42:36.523219 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [parameters: {'id': 'c8c6de0166dc4dcab0f550069264c8a9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 08 11:42:36.523219 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86145) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 08 11:42:36.531710 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-997b406c-c359-407e-a644-0544f9977dd4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c8c6de0166dc4dcab0f550069264c8a9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c8c6de0166dc4dcab0f550069264c8a9. Mar 08 11:42:36.531954 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a979992-6768-4ee5-9b0a-73025660a436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:36.532688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a979992-6768-4ee5-9b0a-73025660a436 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:36.533039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a979992-6768-4ee5-9b0a-73025660a436 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:36.533372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a979992-6768-4ee5-9b0a-73025660a436 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:36.533547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 482/956] 10.222.0.52 () {60 vars in 1140 bytes} [Tue Mar 8 11:42:36 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:36.534251 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a979992-6768-4ee5-9b0a-73025660a436 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:36.534670 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a979992-6768-4ee5-9b0a-73025660a436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:36.538394 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a979992-6768-4ee5-9b0a-73025660a436 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:36.540182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b406c-c359-407e-a644-0544f9977dd4 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:36.547615 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 475/957] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 11:42:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:36.549327 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a979992-6768-4ee5-9b0a-73025660a436 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:36.653598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a979992-6768-4ee5-9b0a-73025660a436 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:36.683362 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b406c-c359-407e-a644-0544f9977dd4 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:36.694269 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c49cf3-0cfc-46ee-8944-14be09120afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:36.694944 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c49cf3-0cfc-46ee-8944-14be09120afa None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:36.695558 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c49cf3-0cfc-46ee-8944-14be09120afa None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:36.695845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c49cf3-0cfc-46ee-8944-14be09120afa None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:36.696878 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c49cf3-0cfc-46ee-8944-14be09120afa None admin] RBAC: Adding query filter params (type=compute) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:36.697190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c49cf3-0cfc-46ee-8944-14be09120afa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:36.699067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c49cf3-0cfc-46ee-8944-14be09120afa None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:36.707705 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 476/958] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 11:42:36 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:36.727862 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef69e9-eb69-47d6-a957-7117c7514f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:36.728733 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef69e9-eb69-47d6-a957-7117c7514f03 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:36.729046 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef69e9-eb69-47d6-a957-7117c7514f03 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:36.729331 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef69e9-eb69-47d6-a957-7117c7514f03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:36.738088 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef69e9-eb69-47d6-a957-7117c7514f03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:36.739772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef69e9-eb69-47d6-a957-7117c7514f03 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:36.755323 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-30ef69e9-eb69-47d6-a957-7117c7514f03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:36.756997 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 483/959] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:36.764739 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c49cf3-0cfc-46ee-8944-14be09120afa None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:36.882852 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c49cf3-0cfc-46ee-8944-14be09120afa None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:36.918723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e30bf-d9d3-41cc-8b92-10795b4860ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:36.919388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e30bf-d9d3-41cc-8b92-10795b4860ef None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:36.919701 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e30bf-d9d3-41cc-8b92-10795b4860ef None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:36.919978 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e30bf-d9d3-41cc-8b92-10795b4860ef None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:36.920721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e30bf-d9d3-41cc-8b92-10795b4860ef None admin] RBAC: Adding query filter params (name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:36.921049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e30bf-d9d3-41cc-8b92-10795b4860ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:36.922783 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e30bf-d9d3-41cc-8b92-10795b4860ef None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:36.940885 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 477/960] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 11:42:36 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:37.818274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfa7be-ffda-4089-8877-14fe400385c9 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:37.818904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfa7be-ffda-4089-8877-14fe400385c9 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:37.818904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfa7be-ffda-4089-8877-14fe400385c9 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:37.823802 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 484/961] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:37.829940 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c0322-e15c-483d-bd18-5f810584f967 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:37.830834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c0322-e15c-483d-bd18-5f810584f967 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:37.831334 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c0322-e15c-483d-bd18-5f810584f967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:37.848907 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-5e4c0322-e15c-483d-bd18-5f810584f967 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:37.850428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5e4c0322-e15c-483d-bd18-5f810584f967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:37.930916 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 478/962] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:37.954472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfa7be-ffda-4089-8877-14fe400385c9 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:38.060091 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfa7be-ffda-4089-8877-14fe400385c9 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:38.095018 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc01d2-d058-4171-a692-386486470df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:38.095829 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc01d2-d058-4171-a692-386486470df4 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:38.096111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc01d2-d058-4171-a692-386486470df4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:38.096381 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc01d2-d058-4171-a692-386486470df4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:38.097031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc01d2-d058-4171-a692-386486470df4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:38.098608 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc01d2-d058-4171-a692-386486470df4 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:38.110538 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-25fc01d2-d058-4171-a692-386486470df4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 11:42:38.112055 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 485/963] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 11:42:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:38.117903 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c0322-e15c-483d-bd18-5f810584f967 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:38.222525 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c0322-e15c-483d-bd18-5f810584f967 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:38.257010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d2016-e850-4855-8c82-7cc865be91f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:38.257679 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d2016-e850-4855-8c82-7cc865be91f6 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:38.257964 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d2016-e850-4855-8c82-7cc865be91f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:38.258239 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d2016-e850-4855-8c82-7cc865be91f6 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:38.258939 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d2016-e850-4855-8c82-7cc865be91f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:38.259243 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d2016-e850-4855-8c82-7cc865be91f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:38.260635 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d2016-e850-4855-8c82-7cc865be91f6 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:38.265798 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 479/964] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 11:42:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:38.271371 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc01d2-d058-4171-a692-386486470df4 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:38.378296 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc01d2-d058-4171-a692-386486470df4 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:38.379776 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf04f6a-5f1c-49a1-8048-31a87b36feee None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:38.380072 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf04f6a-5f1c-49a1-8048-31a87b36feee None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:38.380348 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf04f6a-5f1c-49a1-8048-31a87b36feee None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:38.383514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 480/965] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:38.387498 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de8d65-d301-4a91-99fc-7c73e139f993 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:38.388054 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de8d65-d301-4a91-99fc-7c73e139f993 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:38.388537 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de8d65-d301-4a91-99fc-7c73e139f993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:38.408863 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-33de8d65-d301-4a91-99fc-7c73e139f993 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:38.410347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-33de8d65-d301-4a91-99fc-7c73e139f993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:38.411924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3400c2-1108-4f7c-b981-221726815169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:38.412677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3400c2-1108-4f7c-b981-221726815169 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:38.412963 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3400c2-1108-4f7c-b981-221726815169 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:38.413236 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3400c2-1108-4f7c-b981-221726815169 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:38.413934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3400c2-1108-4f7c-b981-221726815169 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:38.414239 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3400c2-1108-4f7c-b981-221726815169 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:38.415623 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3400c2-1108-4f7c-b981-221726815169 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:38.421869 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 486/966] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 11:42:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:38.426946 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3400c2-1108-4f7c-b981-221726815169 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:38.494307 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 481/967] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:38.519382 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de8d65-d301-4a91-99fc-7c73e139f993 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:38.538804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3400c2-1108-4f7c-b981-221726815169 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:38.571720 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44843bc7-0924-40e1-9983-76ed36d7b31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:38.572384 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44843bc7-0924-40e1-9983-76ed36d7b31a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:38.572665 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44843bc7-0924-40e1-9983-76ed36d7b31a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:38.572939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44843bc7-0924-40e1-9983-76ed36d7b31a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:38.573723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44843bc7-0924-40e1-9983-76ed36d7b31a None admin] RBAC: Adding query filter params (interface=admin, service_id=cbd75833219144369a01d1f47c9c4071, region_id=RegionOne) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:38.574033 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44843bc7-0924-40e1-9983-76ed36d7b31a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:38.575403 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44843bc7-0924-40e1-9983-76ed36d7b31a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:38.585498 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 487/968] 10.222.0.52 () {56 vars in 1249 bytes} [Tue Mar 8 11:42:38 2022] GET /identity/v3/endpoints?service_id=cbd75833219144369a01d1f47c9c4071&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:38.586524 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44843bc7-0924-40e1-9983-76ed36d7b31a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:38.633841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de8d65-d301-4a91-99fc-7c73e139f993 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:38.678725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71956e35-a815-48ed-a470-140658dc04fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:38.680211 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71956e35-a815-48ed-a470-140658dc04fb None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:38.680724 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71956e35-a815-48ed-a470-140658dc04fb None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:38.681331 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71956e35-a815-48ed-a470-140658dc04fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:38.695175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71956e35-a815-48ed-a470-140658dc04fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:38.701818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44843bc7-0924-40e1-9983-76ed36d7b31a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:38.703222 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-71956e35-a815-48ed-a470-140658dc04fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 11:42:38.709491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 482/969] 10.222.0.52 () {56 vars in 1120 bytes} [Tue Mar 8 11:42:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:38.710536 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71956e35-a815-48ed-a470-140658dc04fb None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:38.754675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b35261-0bd8-494f-ad62-0d1cf49d6dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:38.756232 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b35261-0bd8-494f-ad62-0d1cf49d6dea None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:38.756735 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b35261-0bd8-494f-ad62-0d1cf49d6dea None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:38.757560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b35261-0bd8-494f-ad62-0d1cf49d6dea None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:38.758770 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b35261-0bd8-494f-ad62-0d1cf49d6dea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:38.760999 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b35261-0bd8-494f-ad62-0d1cf49d6dea None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:38.775559 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 488/970] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 11:42:38 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 11:42:38.823900 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71956e35-a815-48ed-a470-140658dc04fb None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:38.862060 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dd9a0-17f3-4cf7-b21c-cb07169b042c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:38.862864 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dd9a0-17f3-4cf7-b21c-cb07169b042c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:38.863029 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dd9a0-17f3-4cf7-b21c-cb07169b042c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:38.863286 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dd9a0-17f3-4cf7-b21c-cb07169b042c None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:38.864068 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dd9a0-17f3-4cf7-b21c-cb07169b042c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:38.864373 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dd9a0-17f3-4cf7-b21c-cb07169b042c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:38.865760 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dd9a0-17f3-4cf7-b21c-cb07169b042c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:38.875841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 483/971] 10.222.0.52 () {56 vars in 1115 bytes} [Tue Mar 8 11:42:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:38.884768 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b35261-0bd8-494f-ad62-0d1cf49d6dea None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:38.993887 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b35261-0bd8-494f-ad62-0d1cf49d6dea None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:39.027153 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73daeb0-3582-41db-9cd5-dd86301e1186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:39.028313 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73daeb0-3582-41db-9cd5-dd86301e1186 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:39.028820 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73daeb0-3582-41db-9cd5-dd86301e1186 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:39.029293 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73daeb0-3582-41db-9cd5-dd86301e1186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:39.041298 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73daeb0-3582-41db-9cd5-dd86301e1186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:39.052786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73daeb0-3582-41db-9cd5-dd86301e1186 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:39.060272 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-e73daeb0-3582-41db-9cd5-dd86301e1186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:39.061965 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 489/972] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:39.067728 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dd9a0-17f3-4cf7-b21c-cb07169b042c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:39.117666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c886c91-3bb1-4d76-939f-f6f45cd906fc None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:39.117963 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c886c91-3bb1-4d76-939f-f6f45cd906fc None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:39.118251 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c886c91-3bb1-4d76-939f-f6f45cd906fc None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:39.120312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 490/973] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:39.126801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be786fab-5866-4d16-820a-b7323fffbf84 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:39.127373 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be786fab-5866-4d16-820a-b7323fffbf84 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:39.127828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be786fab-5866-4d16-820a-b7323fffbf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:39.155998 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-be786fab-5866-4d16-820a-b7323fffbf84 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:39.158341 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-be786fab-5866-4d16-820a-b7323fffbf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:39.174334 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dd9a0-17f3-4cf7-b21c-cb07169b042c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:39.219344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f5a46-fd40-4eeb-a99f-5ff3267e0227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:39.220066 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f5a46-fd40-4eeb-a99f-5ff3267e0227 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:39.220349 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f5a46-fd40-4eeb-a99f-5ff3267e0227 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:39.220606 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f5a46-fd40-4eeb-a99f-5ff3267e0227 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:39.221306 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f5a46-fd40-4eeb-a99f-5ff3267e0227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:39.221606 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f5a46-fd40-4eeb-a99f-5ff3267e0227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:39.222980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f5a46-fd40-4eeb-a99f-5ff3267e0227 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:39.235570 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 484/974] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:39.240870 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f5a46-fd40-4eeb-a99f-5ff3267e0227 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:39.259692 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 491/975] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:39.275066 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be786fab-5866-4d16-820a-b7323fffbf84 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:39.351425 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f5a46-fd40-4eeb-a99f-5ff3267e0227 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:39.392528 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b461c6-dd5b-411e-94e0-8a0c4d81ec41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:39.393179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b461c6-dd5b-411e-94e0-8a0c4d81ec41 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:39.393458 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b461c6-dd5b-411e-94e0-8a0c4d81ec41 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:39.393727 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b461c6-dd5b-411e-94e0-8a0c4d81ec41 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:39.396994 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be786fab-5866-4d16-820a-b7323fffbf84 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:39.401283 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b461c6-dd5b-411e-94e0-8a0c4d81ec41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:39.402728 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b461c6-dd5b-411e-94e0-8a0c4d81ec41 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:39.417667 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-41b461c6-dd5b-411e-94e0-8a0c4d81ec41 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 11:42:39.419572 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 485/976] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 11:42:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:39.427019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b461c6-dd5b-411e-94e0-8a0c4d81ec41 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:39.443937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d860e6-19fb-4e85-8af5-92849d39e036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:39.444446 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d860e6-19fb-4e85-8af5-92849d39e036 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:39.444867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d860e6-19fb-4e85-8af5-92849d39e036 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:39.445145 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d860e6-19fb-4e85-8af5-92849d39e036 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:39.445897 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d860e6-19fb-4e85-8af5-92849d39e036 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:39.447241 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d860e6-19fb-4e85-8af5-92849d39e036 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:39.528981 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 492/977] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 11:42:39 2022] POST /identity/v3/services => generated 242 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:42:39.530351 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b0d6f-b8bc-4837-b891-b8adb730cadc None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:39.530637 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b0d6f-b8bc-4837-b891-b8adb730cadc None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:39.530913 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b461c6-dd5b-411e-94e0-8a0c4d81ec41 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:39.531021 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b0d6f-b8bc-4837-b891-b8adb730cadc None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:39.535562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 493/978] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:39.538595 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004622c-74b4-430d-b70c-179fff5f66d0 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:39.538880 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004622c-74b4-430d-b70c-179fff5f66d0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:39.539153 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004622c-74b4-430d-b70c-179fff5f66d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:39.558293 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-8004622c-74b4-430d-b70c-179fff5f66d0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:39.559535 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-8004622c-74b4-430d-b70c-179fff5f66d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:39.586639 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ffc84-3dda-4135-9611-c084bb0510e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:39.587746 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ffc84-3dda-4135-9611-c084bb0510e1 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:39.588233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ffc84-3dda-4135-9611-c084bb0510e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:39.588707 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ffc84-3dda-4135-9611-c084bb0510e1 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:39.589840 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ffc84-3dda-4135-9611-c084bb0510e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:39.590483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ffc84-3dda-4135-9611-c084bb0510e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:39.592195 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ffc84-3dda-4135-9611-c084bb0510e1 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:39.617566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 486/979] 10.222.0.52 () {56 vars in 1149 bytes} [Tue Mar 8 11:42:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:39.618677 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ffc84-3dda-4135-9611-c084bb0510e1 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:39.633469 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 494/980] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:39.658904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004622c-74b4-430d-b70c-179fff5f66d0 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:39.756552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ffc84-3dda-4135-9611-c084bb0510e1 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:39.771816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004622c-74b4-430d-b70c-179fff5f66d0 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:39.807691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8176dd-ddba-42d0-b2c0-ee8b85426c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:39.808721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8176dd-ddba-42d0-b2c0-ee8b85426c64 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:39.809226 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8176dd-ddba-42d0-b2c0-ee8b85426c64 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:39.809700 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8176dd-ddba-42d0-b2c0-ee8b85426c64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:39.816746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c71d8c-9691-4e42-9c03-060299d5aa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:39.817434 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c71d8c-9691-4e42-9c03-060299d5aa5d None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:39.817715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c71d8c-9691-4e42-9c03-060299d5aa5d None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:39.817991 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c71d8c-9691-4e42-9c03-060299d5aa5d None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:39.818703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c71d8c-9691-4e42-9c03-060299d5aa5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:39.820209 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c71d8c-9691-4e42-9c03-060299d5aa5d None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:39.859859 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.sql.core [None req-f1c71d8c-9691-4e42-9c03-060299d5aa5d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 08 11:42:39.859859 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 08 11:42:39.859859 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [parameters: {'user_id': 'f3b6e153f01c4394b70a8641528c14be', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 08 11:42:39.859859 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86145) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 08 11:42:39.865578 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-f1c71d8c-9691-4e42-9c03-060299d5aa5d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 08 11:42:39.871801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 495/981] 10.222.0.52 () {60 vars in 1131 bytes} [Tue Mar 8 11:42:39 2022] POST /identity/v3/users => generated 160 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:39.873482 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c71d8c-9691-4e42-9c03-060299d5aa5d None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:39.896490 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8176dd-ddba-42d0-b2c0-ee8b85426c64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:39.898498 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8176dd-ddba-42d0-b2c0-ee8b85426c64 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:39.987223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c71d8c-9691-4e42-9c03-060299d5aa5d None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:40.021838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d448721-faf3-4efd-a115-6856a040e7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:40.023238 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d448721-faf3-4efd-a115-6856a040e7ed None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:40.023783 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d448721-faf3-4efd-a115-6856a040e7ed None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:40.024257 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d448721-faf3-4efd-a115-6856a040e7ed None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:40.026090 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 487/982] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:39 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:42:40.032570 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8176dd-ddba-42d0-b2c0-ee8b85426c64 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:40.037302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d448721-faf3-4efd-a115-6856a040e7ed None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:40.038989 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d448721-faf3-4efd-a115-6856a040e7ed None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:40.053263 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-2d448721-faf3-4efd-a115-6856a040e7ed None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 11:42:40.054838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 496/983] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:42:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:40.060097 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d448721-faf3-4efd-a115-6856a040e7ed None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:40.137861 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8176dd-ddba-42d0-b2c0-ee8b85426c64 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:40.161391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d448721-faf3-4efd-a115-6856a040e7ed None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:40.174238 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0768df4-cd2c-49db-a32a-3ee01e6a0f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:40.175064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0768df4-cd2c-49db-a32a-3ee01e6a0f7e None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:40.175345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0768df4-cd2c-49db-a32a-3ee01e6a0f7e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:40.175664 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0768df4-cd2c-49db-a32a-3ee01e6a0f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:40.185936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0768df4-cd2c-49db-a32a-3ee01e6a0f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:40.193130 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0768df4-cd2c-49db-a32a-3ee01e6a0f7e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:40.197793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309abdd9-aa1d-461b-ae17-aea9b318686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:40.198574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309abdd9-aa1d-461b-ae17-aea9b318686d None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:40.198955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309abdd9-aa1d-461b-ae17-aea9b318686d None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:40.199329 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309abdd9-aa1d-461b-ae17-aea9b318686d None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:40.200256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309abdd9-aa1d-461b-ae17-aea9b318686d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:40.200959 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309abdd9-aa1d-461b-ae17-aea9b318686d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:40.202740 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309abdd9-aa1d-461b-ae17-aea9b318686d None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:40.215374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-b0768df4-cd2c-49db-a32a-3ee01e6a0f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:40.221865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 488/984] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:40.222901 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0768df4-cd2c-49db-a32a-3ee01e6a0f7e None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:40.251549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 497/985] 10.222.0.52 () {56 vars in 1101 bytes} [Tue Mar 8 11:42:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:40.335010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0768df4-cd2c-49db-a32a-3ee01e6a0f7e None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:40.370402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940db017-529e-4d85-860c-d1bdad863ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:40.371135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940db017-529e-4d85-860c-d1bdad863ce3 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:40.371421 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940db017-529e-4d85-860c-d1bdad863ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:40.371720 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940db017-529e-4d85-860c-d1bdad863ce3 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:40.372511 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940db017-529e-4d85-860c-d1bdad863ce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:40.372825 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940db017-529e-4d85-860c-d1bdad863ce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:40.374365 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940db017-529e-4d85-860c-d1bdad863ce3 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:40.387277 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 489/986] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:40.393214 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309abdd9-aa1d-461b-ae17-aea9b318686d None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:40.498667 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309abdd9-aa1d-461b-ae17-aea9b318686d None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:40.533838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab8a35-7e27-4388-b68f-0f736cfa6452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:40.534644 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab8a35-7e27-4388-b68f-0f736cfa6452 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:40.534925 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab8a35-7e27-4388-b68f-0f736cfa6452 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:40.535206 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab8a35-7e27-4388-b68f-0f736cfa6452 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:40.542215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab8a35-7e27-4388-b68f-0f736cfa6452 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:40.543719 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab8a35-7e27-4388-b68f-0f736cfa6452 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:40.557422 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-17ab8a35-7e27-4388-b68f-0f736cfa6452 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:40.558934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 498/987] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:40.565501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940db017-529e-4d85-860c-d1bdad863ce3 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:40.664474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940db017-529e-4d85-860c-d1bdad863ce3 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:40.696747 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58a6d1-1825-495f-a7d3-6266699b7118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:40.697415 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58a6d1-1825-495f-a7d3-6266699b7118 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:40.697699 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58a6d1-1825-495f-a7d3-6266699b7118 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:40.697974 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58a6d1-1825-495f-a7d3-6266699b7118 None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:40.698747 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58a6d1-1825-495f-a7d3-6266699b7118 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:40.699057 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58a6d1-1825-495f-a7d3-6266699b7118 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:40.700537 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58a6d1-1825-495f-a7d3-6266699b7118 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:40.713083 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 490/988] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:40.719002 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab8a35-7e27-4388-b68f-0f736cfa6452 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:40.820117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab8a35-7e27-4388-b68f-0f736cfa6452 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:40.852771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ae1ac-ec7f-49e1-873a-d760c1889894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:40.853572 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ae1ac-ec7f-49e1-873a-d760c1889894 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:40.853855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ae1ac-ec7f-49e1-873a-d760c1889894 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:40.854127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ae1ac-ec7f-49e1-873a-d760c1889894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:40.854943 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ae1ac-ec7f-49e1-873a-d760c1889894 None admin] RBAC: Adding query filter params (role.id=5b24bb8e8b36434f986d06603c8ac351, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=34d5824ea4a54b65a3eaa6deeb9dc416) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:40.855263 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ae1ac-ec7f-49e1-873a-d760c1889894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:40.856730 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ae1ac-ec7f-49e1-873a-d760c1889894 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:40.867613 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 499/989] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:40 2022] GET /identity/v3/role_assignments?user.id=34d5824ea4a54b65a3eaa6deeb9dc416&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=5b24bb8e8b36434f986d06603c8ac351 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:41.169085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862b340-c494-4f57-9e92-685c7980cac4 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:41.169605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862b340-c494-4f57-9e92-685c7980cac4 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:41.169605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862b340-c494-4f57-9e92-685c7980cac4 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:41.171619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 491/990] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:41.176855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232aa5c-a880-4d50-a76b-261da0777508 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:41.177265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232aa5c-a880-4d50-a76b-261da0777508 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:41.177424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232aa5c-a880-4d50-a76b-261da0777508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:41.197187 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-1232aa5c-a880-4d50-a76b-261da0777508 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:41.198720 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-1232aa5c-a880-4d50-a76b-261da0777508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:41.267567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 500/991] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:41.287739 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862b340-c494-4f57-9e92-685c7980cac4 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:41.384104 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862b340-c494-4f57-9e92-685c7980cac4 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:41.417324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d846460-1941-4b56-ba7d-2626addee3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:41.418134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d846460-1941-4b56-ba7d-2626addee3ce None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:41.418419 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d846460-1941-4b56-ba7d-2626addee3ce None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:41.418695 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d846460-1941-4b56-ba7d-2626addee3ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:41.419395 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d846460-1941-4b56-ba7d-2626addee3ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:41.420843 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d846460-1941-4b56-ba7d-2626addee3ce None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:41.431777 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-2d846460-1941-4b56-ba7d-2626addee3ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 11:42:41.433155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 492/992] 10.222.0.52 () {56 vars in 1126 bytes} [Tue Mar 8 11:42:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:41.439587 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232aa5c-a880-4d50-a76b-261da0777508 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:41.534843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232aa5c-a880-4d50-a76b-261da0777508 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:41.568542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f80967-cb52-4eb7-9fef-56b6cd43a567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:41.569267 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f80967-cb52-4eb7-9fef-56b6cd43a567 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:41.569551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f80967-cb52-4eb7-9fef-56b6cd43a567 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:41.569826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f80967-cb52-4eb7-9fef-56b6cd43a567 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:41.570598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f80967-cb52-4eb7-9fef-56b6cd43a567 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:41.570908 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f80967-cb52-4eb7-9fef-56b6cd43a567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:41.572318 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f80967-cb52-4eb7-9fef-56b6cd43a567 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:41.577846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 501/993] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 11:42:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:41.583513 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d846460-1941-4b56-ba7d-2626addee3ce None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:41.683506 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d846460-1941-4b56-ba7d-2626addee3ce None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:41.716218 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae41ab-a6bf-40a8-92bc-8e4d960be699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:41.716891 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae41ab-a6bf-40a8-92bc-8e4d960be699 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:41.717173 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae41ab-a6bf-40a8-92bc-8e4d960be699 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:41.717450 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae41ab-a6bf-40a8-92bc-8e4d960be699 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:41.718210 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae41ab-a6bf-40a8-92bc-8e4d960be699 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:41.718519 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae41ab-a6bf-40a8-92bc-8e4d960be699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:41.719931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae41ab-a6bf-40a8-92bc-8e4d960be699 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:41.730563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 493/994] 10.222.0.52 () {56 vars in 1122 bytes} [Tue Mar 8 11:42:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:41.730720 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f80967-cb52-4eb7-9fef-56b6cd43a567 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:41.825388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f80967-cb52-4eb7-9fef-56b6cd43a567 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:41.857578 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008268da-fc88-483e-9846-0fadd2b1c2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:41.859009 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008268da-fc88-483e-9846-0fadd2b1c2fa None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:41.859513 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008268da-fc88-483e-9846-0fadd2b1c2fa None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:41.859968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008268da-fc88-483e-9846-0fadd2b1c2fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:41.860868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008268da-fc88-483e-9846-0fadd2b1c2fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:41.862388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008268da-fc88-483e-9846-0fadd2b1c2fa None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:41.947629 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 502/995] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 11:42:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:42:41.958870 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae05c4-d548-4391-a08e-41611b5212e7 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:41.959161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae05c4-d548-4391-a08e-41611b5212e7 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:41.959444 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae05c4-d548-4391-a08e-41611b5212e7 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:41.961473 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 494/996] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:41.968033 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cc8c6-89f2-4d61-8053-ee3c0ec811ee None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:41.968343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cc8c6-89f2-4d61-8053-ee3c0ec811ee None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:41.968632 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cc8c6-89f2-4d61-8053-ee3c0ec811ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:41.987587 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-ad0cc8c6-89f2-4d61-8053-ee3c0ec811ee None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:41.988864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-ad0cc8c6-89f2-4d61-8053-ee3c0ec811ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:42.071556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 503/997] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:41 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:42.093792 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae05c4-d548-4391-a08e-41611b5212e7 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:42.199778 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae05c4-d548-4391-a08e-41611b5212e7 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:42.232698 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54194e-5181-4e8a-9ac3-de8b8a2eb43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:42.234052 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54194e-5181-4e8a-9ac3-de8b8a2eb43b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:42.234333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54194e-5181-4e8a-9ac3-de8b8a2eb43b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:42.234592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54194e-5181-4e8a-9ac3-de8b8a2eb43b None admin] PATH_INFO: `/v3/services/compute` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:42.235243 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54194e-5181-4e8a-9ac3-de8b8a2eb43b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:42.236659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54194e-5181-4e8a-9ac3-de8b8a2eb43b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:42.247344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-0a54194e-5181-4e8a-9ac3-de8b8a2eb43b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 08 11:42:42.248749 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 495/998] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:42.254633 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cc8c6-89f2-4d61-8053-ee3c0ec811ee None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:42.349724 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cc8c6-89f2-4d61-8053-ee3c0ec811ee None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:42.382225 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086116b0-c438-46fa-a4fa-287ce96a39d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:42.382891 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086116b0-c438-46fa-a4fa-287ce96a39d3 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:42.383175 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086116b0-c438-46fa-a4fa-287ce96a39d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:42.383451 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086116b0-c438-46fa-a4fa-287ce96a39d3 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:42.384177 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086116b0-c438-46fa-a4fa-287ce96a39d3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:42.384485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086116b0-c438-46fa-a4fa-287ce96a39d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:42.385878 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086116b0-c438-46fa-a4fa-287ce96a39d3 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:42.391217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 504/999] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 11:42:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:42.396678 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54194e-5181-4e8a-9ac3-de8b8a2eb43b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:42.493475 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54194e-5181-4e8a-9ac3-de8b8a2eb43b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:42.527696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd23f3-2374-4aab-9ecb-c690711489a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:42.532959 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd23f3-2374-4aab-9ecb-c690711489a7 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:42.533238 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd23f3-2374-4aab-9ecb-c690711489a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:42.533510 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd23f3-2374-4aab-9ecb-c690711489a7 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:42.534211 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd23f3-2374-4aab-9ecb-c690711489a7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:42.534515 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd23f3-2374-4aab-9ecb-c690711489a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:42.535992 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd23f3-2374-4aab-9ecb-c690711489a7 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:42.546845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 496/1000] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 11:42:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:42.552736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086116b0-c438-46fa-a4fa-287ce96a39d3 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:42.649006 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086116b0-c438-46fa-a4fa-287ce96a39d3 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:42.681607 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83448d-88e0-43af-96a0-d219fb2a6122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:42.682342 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83448d-88e0-43af-96a0-d219fb2a6122 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:42.682537 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83448d-88e0-43af-96a0-d219fb2a6122 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:42.682808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83448d-88e0-43af-96a0-d219fb2a6122 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:42.683609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83448d-88e0-43af-96a0-d219fb2a6122 None admin] RBAC: Adding query filter params (interface=public, service_id=846f8fd458994540a0a9a2f6cbef20c1, region_id=RegionOne) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:42.683923 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83448d-88e0-43af-96a0-d219fb2a6122 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:42.685301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83448d-88e0-43af-96a0-d219fb2a6122 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:42.691253 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 505/1001] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 11:42:42 2022] GET /identity/v3/endpoints?service_id=846f8fd458994540a0a9a2f6cbef20c1&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:42.696479 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd23f3-2374-4aab-9ecb-c690711489a7 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:42.794317 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd23f3-2374-4aab-9ecb-c690711489a7 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:42.828074 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb231ed9-fbb5-4b3f-aa30-6e8d7415e544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:42.828625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231ed9-fbb5-4b3f-aa30-6e8d7415e544 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:42.828902 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231ed9-fbb5-4b3f-aa30-6e8d7415e544 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:42.829173 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231ed9-fbb5-4b3f-aa30-6e8d7415e544 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:42.829858 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb231ed9-fbb5-4b3f-aa30-6e8d7415e544 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:42.831256 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb231ed9-fbb5-4b3f-aa30-6e8d7415e544 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:42.838293 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 497/1002] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 11:42:42 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 11:42:43.218158 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a040d2c-ef17-43d6-b898-9dd6f990acc5 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:43.218158 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a040d2c-ef17-43d6-b898-9dd6f990acc5 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:43.218527 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a040d2c-ef17-43d6-b898-9dd6f990acc5 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:43.220390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 506/1003] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:43.225977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6656b-0b63-4fbf-83ea-851ec130b5c8 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:43.226432 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6656b-0b63-4fbf-83ea-851ec130b5c8 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:43.226605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6656b-0b63-4fbf-83ea-851ec130b5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:43.244393 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-42e6656b-0b63-4fbf-83ea-851ec130b5c8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:43.245677 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-42e6656b-0b63-4fbf-83ea-851ec130b5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:43.318281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 498/1004] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:43 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:43.340511 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a040d2c-ef17-43d6-b898-9dd6f990acc5 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:43.437848 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a040d2c-ef17-43d6-b898-9dd6f990acc5 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:43.470530 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad479b-7db3-40bd-8a72-c5c026d9c228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:43.471240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad479b-7db3-40bd-8a72-c5c026d9c228 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:43.471542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad479b-7db3-40bd-8a72-c5c026d9c228 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:43.471813 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad479b-7db3-40bd-8a72-c5c026d9c228 None admin] PATH_INFO: `/v3/services/image` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:43.472450 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad479b-7db3-40bd-8a72-c5c026d9c228 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:43.473817 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad479b-7db3-40bd-8a72-c5c026d9c228 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:43.484676 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-35ad479b-7db3-40bd-8a72-c5c026d9c228 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 08 11:42:43.485992 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 507/1005] 10.222.0.52 () {56 vars in 1105 bytes} [Tue Mar 8 11:42:43 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:43.491890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6656b-0b63-4fbf-83ea-851ec130b5c8 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:43.587426 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6656b-0b63-4fbf-83ea-851ec130b5c8 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:43.621497 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9fdd0-17f5-475f-8337-03baff168fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:43.622183 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9fdd0-17f5-475f-8337-03baff168fc0 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:43.622465 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9fdd0-17f5-475f-8337-03baff168fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:43.622743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9fdd0-17f5-475f-8337-03baff168fc0 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:43.623514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9fdd0-17f5-475f-8337-03baff168fc0 None admin] RBAC: Adding query filter params (name=image) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:43.623949 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9fdd0-17f5-475f-8337-03baff168fc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:43.625398 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9fdd0-17f5-475f-8337-03baff168fc0 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:43.632548 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 499/1006] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:43.638173 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad479b-7db3-40bd-8a72-c5c026d9c228 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:43.735952 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad479b-7db3-40bd-8a72-c5c026d9c228 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:43.767394 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa94af1-e7e0-49c3-bf19-80b637990749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:43.768078 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa94af1-e7e0-49c3-bf19-80b637990749 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:43.768359 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa94af1-e7e0-49c3-bf19-80b637990749 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:43.768632 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa94af1-e7e0-49c3-bf19-80b637990749 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:43.769325 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa94af1-e7e0-49c3-bf19-80b637990749 None admin] RBAC: Adding query filter params (type=image) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:43.769627 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa94af1-e7e0-49c3-bf19-80b637990749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:43.771000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa94af1-e7e0-49c3-bf19-80b637990749 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:43.775766 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 508/1007] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:43 2022] GET /identity/v3/services?type=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:44.325470 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8895ca9-9a6c-4089-a7fe-add7955dec08 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:44.325974 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8895ca9-9a6c-4089-a7fe-add7955dec08 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:44.326048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8895ca9-9a6c-4089-a7fe-add7955dec08 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:44.328544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 500/1008] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:44.333683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65699a-0c13-4842-9233-be27f0b2b195 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:44.334045 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65699a-0c13-4842-9233-be27f0b2b195 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:44.334418 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65699a-0c13-4842-9233-be27f0b2b195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:44.350889 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-db65699a-0c13-4842-9233-be27f0b2b195 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:44.352116 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-db65699a-0c13-4842-9233-be27f0b2b195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:44.415591 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 509/1009] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:44 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:44.439416 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8895ca9-9a6c-4089-a7fe-add7955dec08 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:44.538522 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8895ca9-9a6c-4089-a7fe-add7955dec08 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:44.572513 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9310ec1-285b-4bca-8b53-fe7b1d2aaf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:44.573312 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9310ec1-285b-4bca-8b53-fe7b1d2aaf43 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:44.573597 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9310ec1-285b-4bca-8b53-fe7b1d2aaf43 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:44.573878 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9310ec1-285b-4bca-8b53-fe7b1d2aaf43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:44.575059 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9310ec1-285b-4bca-8b53-fe7b1d2aaf43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:44.576614 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9310ec1-285b-4bca-8b53-fe7b1d2aaf43 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:44.578937 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 501/1010] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:44.584449 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65699a-0c13-4842-9233-be27f0b2b195 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:44.678892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65699a-0c13-4842-9233-be27f0b2b195 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:44.710980 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dccae-f188-4b0b-a6cf-eb2138b2543f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:44.711668 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dccae-f188-4b0b-a6cf-eb2138b2543f None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:44.711953 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dccae-f188-4b0b-a6cf-eb2138b2543f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:44.712228 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dccae-f188-4b0b-a6cf-eb2138b2543f None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:44.712943 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dccae-f188-4b0b-a6cf-eb2138b2543f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:44.714382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dccae-f188-4b0b-a6cf-eb2138b2543f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:44.809472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 510/1011] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 11:42:44 2022] POST /identity/v3/projects => generated 311 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:42:45.215102 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa49eb5-8a50-4399-ae8a-02b6ecc2c80e None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:45.215406 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa49eb5-8a50-4399-ae8a-02b6ecc2c80e None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:45.215695 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa49eb5-8a50-4399-ae8a-02b6ecc2c80e None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:45.218206 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 502/1012] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:45.223639 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9156b9-f8d6-407a-aba5-d2bfedf13a0e None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:45.223936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9156b9-f8d6-407a-aba5-d2bfedf13a0e None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:45.224249 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9156b9-f8d6-407a-aba5-d2bfedf13a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:45.241325 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-3f9156b9-f8d6-407a-aba5-d2bfedf13a0e None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:45.242503 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3f9156b9-f8d6-407a-aba5-d2bfedf13a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:45.305661 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 511/1013] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:45 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:45.328078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa49eb5-8a50-4399-ae8a-02b6ecc2c80e None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:45.424027 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa49eb5-8a50-4399-ae8a-02b6ecc2c80e None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:45.458804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f63649-f76e-4875-8a8c-3cda49131531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:45.459546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f63649-f76e-4875-8a8c-3cda49131531 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:45.459831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f63649-f76e-4875-8a8c-3cda49131531 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:45.460103 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f63649-f76e-4875-8a8c-3cda49131531 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:45.460751 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f63649-f76e-4875-8a8c-3cda49131531 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:45.462103 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f63649-f76e-4875-8a8c-3cda49131531 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:45.473445 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-44f63649-f76e-4875-8a8c-3cda49131531 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 08 11:42:45.474763 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 503/1014] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:45.480642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9156b9-f8d6-407a-aba5-d2bfedf13a0e None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:45.576932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9156b9-f8d6-407a-aba5-d2bfedf13a0e None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:45.609246 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f0011-aab4-46ec-9919-f84d3efb263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:45.609921 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f0011-aab4-46ec-9919-f84d3efb263f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:45.610205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f0011-aab4-46ec-9919-f84d3efb263f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:45.610487 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f0011-aab4-46ec-9919-f84d3efb263f None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:45.611188 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f0011-aab4-46ec-9919-f84d3efb263f None admin] RBAC: Adding query filter params (name=compute) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:45.611496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f0011-aab4-46ec-9919-f84d3efb263f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:45.612904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f0011-aab4-46ec-9919-f84d3efb263f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:45.617903 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 512/1015] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 11:42:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:45.623299 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f63649-f76e-4875-8a8c-3cda49131531 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:45.725276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f63649-f76e-4875-8a8c-3cda49131531 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:45.758618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a1d4d-9b30-494e-af1b-adc7f19500e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:45.759296 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a1d4d-9b30-494e-af1b-adc7f19500e0 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:45.759601 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a1d4d-9b30-494e-af1b-adc7f19500e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:45.759880 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a1d4d-9b30-494e-af1b-adc7f19500e0 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:45.760582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a1d4d-9b30-494e-af1b-adc7f19500e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:45.760890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a1d4d-9b30-494e-af1b-adc7f19500e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:45.762252 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a1d4d-9b30-494e-af1b-adc7f19500e0 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:45.767892 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 504/1016] 10.222.0.52 () {56 vars in 1112 bytes} [Tue Mar 8 11:42:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:45.773477 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f0011-aab4-46ec-9919-f84d3efb263f None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:45.869580 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f0011-aab4-46ec-9919-f84d3efb263f None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:45.903961 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab83fdb-8a96-4d7a-a3d5-2fb48f0caf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:45.904626 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab83fdb-8a96-4d7a-a3d5-2fb48f0caf42 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:45.905637 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab83fdb-8a96-4d7a-a3d5-2fb48f0caf42 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:45.906118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab83fdb-8a96-4d7a-a3d5-2fb48f0caf42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:45.906977 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab83fdb-8a96-4d7a-a3d5-2fb48f0caf42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:45.909325 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab83fdb-8a96-4d7a-a3d5-2fb48f0caf42 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:45.977579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 513/1017] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 11:42:45 2022] POST /identity/v3/endpoints => generated 334 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:42:46.078998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f3a47-c675-471a-a909-3a54e611712f None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:46.079353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f3a47-c675-471a-a909-3a54e611712f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:46.079592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f3a47-c675-471a-a909-3a54e611712f None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:46.081584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 505/1018] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:46.087184 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0721e-39cd-47af-a632-f9531b703440 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:46.087474 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0721e-39cd-47af-a632-f9531b703440 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:46.087783 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0721e-39cd-47af-a632-f9531b703440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:46.106328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-9fe0721e-39cd-47af-a632-f9531b703440 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:46.107581 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-9fe0721e-39cd-47af-a632-f9531b703440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:46.319682 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 514/1019] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:46 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:46.338433 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f3a47-c675-471a-a909-3a54e611712f None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:46.440977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f3a47-c675-471a-a909-3a54e611712f None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:46.473738 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99ba4a-206f-404f-b074-a72ad2c9f784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:46.474410 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99ba4a-206f-404f-b074-a72ad2c9f784 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:46.474691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99ba4a-206f-404f-b074-a72ad2c9f784 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:46.474962 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99ba4a-206f-404f-b074-a72ad2c9f784 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:46.475717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99ba4a-206f-404f-b074-a72ad2c9f784 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:46.477093 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99ba4a-206f-404f-b074-a72ad2c9f784 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:46.564597 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 506/1020] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 11:42:46 2022] POST /identity/v3/services => generated 242 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:42:47.183758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4073132-a64e-45c9-96db-41190d9731ee None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:47.184275 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4073132-a64e-45c9-96db-41190d9731ee None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:47.184352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4073132-a64e-45c9-96db-41190d9731ee None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:47.186671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 515/1021] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:47.192066 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c6439-6498-42cc-9b19-1f67542be4f0 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:47.192356 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c6439-6498-42cc-9b19-1f67542be4f0 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:47.192636 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c6439-6498-42cc-9b19-1f67542be4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:47.211743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-7c9c6439-6498-42cc-9b19-1f67542be4f0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:47.212936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-7c9c6439-6498-42cc-9b19-1f67542be4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:47.287780 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 507/1022] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:47.312119 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4073132-a64e-45c9-96db-41190d9731ee None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:47.408329 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4073132-a64e-45c9-96db-41190d9731ee None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:47.440258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab0397-dbe0-4139-a1b8-f49f4ece56cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:47.440967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab0397-dbe0-4139-a1b8-f49f4ece56cf None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:47.441247 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab0397-dbe0-4139-a1b8-f49f4ece56cf None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:47.441519 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab0397-dbe0-4139-a1b8-f49f4ece56cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:47.442690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab0397-dbe0-4139-a1b8-f49f4ece56cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:47.444171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab0397-dbe0-4139-a1b8-f49f4ece56cf None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:47.450428 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 516/1023] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:47.452516 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c6439-6498-42cc-9b19-1f67542be4f0 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:47.547345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c6439-6498-42cc-9b19-1f67542be4f0 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:47.580073 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802547f-c153-462b-914c-4b76ce6043b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:47.580837 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802547f-c153-462b-914c-4b76ce6043b3 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:47.581134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802547f-c153-462b-914c-4b76ce6043b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:47.581412 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802547f-c153-462b-914c-4b76ce6043b3 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:47.582131 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802547f-c153-462b-914c-4b76ce6043b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:47.583584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802547f-c153-462b-914c-4b76ce6043b3 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:47.687227 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 508/1024] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:42:47 2022] POST /identity/v3/users => generated 285 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:42:48.419063 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57083f-cdfb-4384-855b-dd86b91199b4 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:48.419787 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57083f-cdfb-4384-855b-dd86b91199b4 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:48.419787 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57083f-cdfb-4384-855b-dd86b91199b4 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:48.421635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 517/1025] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:48.426831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1397b-c230-4526-8020-3e62672243a3 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:48.427131 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1397b-c230-4526-8020-3e62672243a3 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:48.427413 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1397b-c230-4526-8020-3e62672243a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:48.444324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-a6b1397b-c230-4526-8020-3e62672243a3 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:48.445452 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a6b1397b-c230-4526-8020-3e62672243a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:48.510646 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 509/1026] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:48.535567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57083f-cdfb-4384-855b-dd86b91199b4 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:48.640308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57083f-cdfb-4384-855b-dd86b91199b4 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:48.672535 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafafc9c-42ed-455b-87f8-247fb9ae0f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:48.673340 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafafc9c-42ed-455b-87f8-247fb9ae0f5a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:48.673621 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafafc9c-42ed-455b-87f8-247fb9ae0f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:48.673896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafafc9c-42ed-455b-87f8-247fb9ae0f5a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:48.683498 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafafc9c-42ed-455b-87f8-247fb9ae0f5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:48.691774 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-cafafc9c-42ed-455b-87f8-247fb9ae0f5a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 11:42:48.693168 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 518/1027] 10.222.0.52 () {56 vars in 1120 bytes} [Tue Mar 8 11:42:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:48.699010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1397b-c230-4526-8020-3e62672243a3 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:48.794651 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1397b-c230-4526-8020-3e62672243a3 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:48.829293 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326b393-a9ae-4867-b998-f18910053b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:48.829970 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326b393-a9ae-4867-b998-f18910053b12 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:48.830250 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326b393-a9ae-4867-b998-f18910053b12 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:48.830583 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326b393-a9ae-4867-b998-f18910053b12 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:48.831334 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326b393-a9ae-4867-b998-f18910053b12 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:48.831671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326b393-a9ae-4867-b998-f18910053b12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:48.833059 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326b393-a9ae-4867-b998-f18910053b12 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:48.845480 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 510/1028] 10.222.0.52 () {56 vars in 1115 bytes} [Tue Mar 8 11:42:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:48.846666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafafc9c-42ed-455b-87f8-247fb9ae0f5a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:48.899161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c6713-34d9-4bbb-b237-c0b456c32d51 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:48.899694 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c6713-34d9-4bbb-b237-c0b456c32d51 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:48.900077 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c6713-34d9-4bbb-b237-c0b456c32d51 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:48.902011 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 511/1029] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:42:48.908707 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94e615-0322-40eb-84ce-f1468ece1288 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:48.909016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94e615-0322-40eb-84ce-f1468ece1288 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:48.909275 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94e615-0322-40eb-84ce-f1468ece1288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:48.935017 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-ef94e615-0322-40eb-84ce-f1468ece1288 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:48.936821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ef94e615-0322-40eb-84ce-f1468ece1288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:48.963287 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafafc9c-42ed-455b-87f8-247fb9ae0f5a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:48.996543 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186968d9-7823-45dc-84a3-aab5023f3899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:48.997332 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186968d9-7823-45dc-84a3-aab5023f3899 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:48.997612 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186968d9-7823-45dc-84a3-aab5023f3899 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:48.997888 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186968d9-7823-45dc-84a3-aab5023f3899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:49.005148 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 512/1030] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:49.010539 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186968d9-7823-45dc-84a3-aab5023f3899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:49.012139 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186968d9-7823-45dc-84a3-aab5023f3899 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:49.027837 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94e615-0322-40eb-84ce-f1468ece1288 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:49.029024 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-186968d9-7823-45dc-84a3-aab5023f3899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:49.034975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 519/1031] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:49.035821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186968d9-7823-45dc-84a3-aab5023f3899 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:49.127993 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94e615-0322-40eb-84ce-f1468ece1288 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:49.131471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186968d9-7823-45dc-84a3-aab5023f3899 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:49.164043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f7a97-2040-4af1-bbf3-15a1fab355de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:49.164262 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377448b9-7a2d-4446-9bab-15b460af09af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:49.164833 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f7a97-2040-4af1-bbf3-15a1fab355de None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:49.164951 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377448b9-7a2d-4446-9bab-15b460af09af None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:49.165117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377448b9-7a2d-4446-9bab-15b460af09af None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:49.165212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f7a97-2040-4af1-bbf3-15a1fab355de None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:49.165375 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377448b9-7a2d-4446-9bab-15b460af09af None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:49.165467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f7a97-2040-4af1-bbf3-15a1fab355de None admin] PATH_INFO: `/v3/services/image` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:49.166007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f7a97-2040-4af1-bbf3-15a1fab355de None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:49.166102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377448b9-7a2d-4446-9bab-15b460af09af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:49.166355 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377448b9-7a2d-4446-9bab-15b460af09af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:49.167378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f7a97-2040-4af1-bbf3-15a1fab355de None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:49.167772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377448b9-7a2d-4446-9bab-15b460af09af None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:49.178246 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-8d7f7a97-2040-4af1-bbf3-15a1fab355de None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 08 11:42:49.184639 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 520/1032] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:49.184765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 513/1033] 10.222.0.52 () {56 vars in 1105 bytes} [Tue Mar 8 11:42:49 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:49.185682 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377448b9-7a2d-4446-9bab-15b460af09af None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:49.190891 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f7a97-2040-4af1-bbf3-15a1fab355de None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:49.293287 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377448b9-7a2d-4446-9bab-15b460af09af None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:49.312512 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f7a97-2040-4af1-bbf3-15a1fab355de None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:49.328761 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463793d6-1096-43fb-a7cd-16bfcc667363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:49.329434 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463793d6-1096-43fb-a7cd-16bfcc667363 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:49.329720 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463793d6-1096-43fb-a7cd-16bfcc667363 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:49.329997 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463793d6-1096-43fb-a7cd-16bfcc667363 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:49.330703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463793d6-1096-43fb-a7cd-16bfcc667363 None admin] RBAC: Adding query filter params (name=image) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:49.331080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463793d6-1096-43fb-a7cd-16bfcc667363 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:49.332497 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463793d6-1096-43fb-a7cd-16bfcc667363 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:49.337315 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 521/1034] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:49.343416 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463793d6-1096-43fb-a7cd-16bfcc667363 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:49.351449 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5609d3-9c7a-4b97-b3c5-3e47f7aff7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:49.352922 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5609d3-9c7a-4b97-b3c5-3e47f7aff7ad None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:49.353359 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5609d3-9c7a-4b97-b3c5-3e47f7aff7ad None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:49.353788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5609d3-9c7a-4b97-b3c5-3e47f7aff7ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:49.364633 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5609d3-9c7a-4b97-b3c5-3e47f7aff7ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:49.366266 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5609d3-9c7a-4b97-b3c5-3e47f7aff7ad None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:49.382244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-9c5609d3-9c7a-4b97-b3c5-3e47f7aff7ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 11:42:49.388189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 514/1035] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 11:42:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:49.390031 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5609d3-9c7a-4b97-b3c5-3e47f7aff7ad None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:49.452276 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463793d6-1096-43fb-a7cd-16bfcc667363 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:49.486139 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fef91-76a0-4306-bc72-73ed0ce430d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:49.486799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fef91-76a0-4306-bc72-73ed0ce430d4 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:49.487080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fef91-76a0-4306-bc72-73ed0ce430d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:49.487352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fef91-76a0-4306-bc72-73ed0ce430d4 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:49.488085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fef91-76a0-4306-bc72-73ed0ce430d4 None admin] RBAC: Adding query filter params (type=image) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:49.488394 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fef91-76a0-4306-bc72-73ed0ce430d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:49.489754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fef91-76a0-4306-bc72-73ed0ce430d4 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:49.493189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5609d3-9c7a-4b97-b3c5-3e47f7aff7ad None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:49.494644 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 522/1036] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:49.500446 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fef91-76a0-4306-bc72-73ed0ce430d4 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:49.530733 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e9ad1-7bdd-4c6b-b4a0-a0f3d78b07f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:49.531479 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e9ad1-7bdd-4c6b-b4a0-a0f3d78b07f5 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:49.531920 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e9ad1-7bdd-4c6b-b4a0-a0f3d78b07f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:49.532204 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e9ad1-7bdd-4c6b-b4a0-a0f3d78b07f5 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:49.533048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e9ad1-7bdd-4c6b-b4a0-a0f3d78b07f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:49.533360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e9ad1-7bdd-4c6b-b4a0-a0f3d78b07f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:49.534804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e9ad1-7bdd-4c6b-b4a0-a0f3d78b07f5 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:49.558480 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 515/1037] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 11:42:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:49.559440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e9ad1-7bdd-4c6b-b4a0-a0f3d78b07f5 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:49.609984 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fef91-76a0-4306-bc72-73ed0ce430d4 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:49.649541 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be50d3-29c8-46d7-90f5-c3708f5a46ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:49.650208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be50d3-29c8-46d7-90f5-c3708f5a46ae None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:49.650491 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be50d3-29c8-46d7-90f5-c3708f5a46ae None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:49.650772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be50d3-29c8-46d7-90f5-c3708f5a46ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:49.651584 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be50d3-29c8-46d7-90f5-c3708f5a46ae None admin] RBAC: Adding query filter params (interface=public, service_id=fc6a2b80438f4fccb88bf033b58e76ad, region_id=RegionOne) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:49.651902 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be50d3-29c8-46d7-90f5-c3708f5a46ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:49.653286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be50d3-29c8-46d7-90f5-c3708f5a46ae None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:49.658383 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e9ad1-7bdd-4c6b-b4a0-a0f3d78b07f5 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:49.663274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 523/1038] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 11:42:49 2022] GET /identity/v3/endpoints?service_id=fc6a2b80438f4fccb88bf033b58e76ad&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:49.664093 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be50d3-29c8-46d7-90f5-c3708f5a46ae None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:49.695910 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022ae3f-588c-4e8a-9a6f-a94b09d24baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:49.696614 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022ae3f-588c-4e8a-9a6f-a94b09d24baa None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:49.696896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022ae3f-588c-4e8a-9a6f-a94b09d24baa None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:49.697175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022ae3f-588c-4e8a-9a6f-a94b09d24baa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:49.765971 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be50d3-29c8-46d7-90f5-c3708f5a46ae None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:49.769640 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022ae3f-588c-4e8a-9a6f-a94b09d24baa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:49.771108 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022ae3f-588c-4e8a-9a6f-a94b09d24baa None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:49.799812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d75172-f0b9-4515-8b2f-1cc03c472d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:49.800510 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d75172-f0b9-4515-8b2f-1cc03c472d50 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:49.800794 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d75172-f0b9-4515-8b2f-1cc03c472d50 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:49.801072 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d75172-f0b9-4515-8b2f-1cc03c472d50 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:49.801753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d75172-f0b9-4515-8b2f-1cc03c472d50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:49.803134 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d75172-f0b9-4515-8b2f-1cc03c472d50 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:49.813759 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 524/1039] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 11:42:49 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 11:42:49.881489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 516/1040] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:49 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 11:42:49.886998 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d75172-f0b9-4515-8b2f-1cc03c472d50 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:49.996836 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d75172-f0b9-4515-8b2f-1cc03c472d50 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:50.034095 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40febb-accd-4d95-836f-d076da4664a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:50.034885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40febb-accd-4d95-836f-d076da4664a2 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:50.035161 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40febb-accd-4d95-836f-d076da4664a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:50.035428 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40febb-accd-4d95-836f-d076da4664a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:50.046385 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40febb-accd-4d95-836f-d076da4664a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:50.047939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40febb-accd-4d95-836f-d076da4664a2 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:50.060142 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82526378-405f-4eb4-aca4-5772e22ca2ef None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:50.060429 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82526378-405f-4eb4-aca4-5772e22ca2ef None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:50.061256 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82526378-405f-4eb4-aca4-5772e22ca2ef None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:50.063172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 517/1041] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:42:50.064924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-ac40febb-accd-4d95-836f-d076da4664a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:50.070479 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 525/1042] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:50.071809 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c9d51-7c35-480a-99fd-fa5e74660fcd None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:50.071925 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40febb-accd-4d95-836f-d076da4664a2 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:50.072120 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c9d51-7c35-480a-99fd-fa5e74660fcd None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:50.072360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c9d51-7c35-480a-99fd-fa5e74660fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:50.088803 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-703c9d51-7c35-480a-99fd-fa5e74660fcd None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:50.089989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-703c9d51-7c35-480a-99fd-fa5e74660fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:50.167542 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 518/1043] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:50.168982 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40febb-accd-4d95-836f-d076da4664a2 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:50.181409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c9d51-7c35-480a-99fd-fa5e74660fcd None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:50.209333 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b25860-4fb6-4c7f-bee1-a9fecbf50aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:50.210007 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b25860-4fb6-4c7f-bee1-a9fecbf50aeb None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:50.210286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b25860-4fb6-4c7f-bee1-a9fecbf50aeb None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:50.210562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b25860-4fb6-4c7f-bee1-a9fecbf50aeb None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:50.211286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b25860-4fb6-4c7f-bee1-a9fecbf50aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:50.211629 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b25860-4fb6-4c7f-bee1-a9fecbf50aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:50.213014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b25860-4fb6-4c7f-bee1-a9fecbf50aeb None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:50.225054 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 526/1044] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:50.230287 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b25860-4fb6-4c7f-bee1-a9fecbf50aeb None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:50.282050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c9d51-7c35-480a-99fd-fa5e74660fcd None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:50.314613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce407e72-7793-40ca-8165-539e8680c434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:50.315458 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce407e72-7793-40ca-8165-539e8680c434 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:50.315721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce407e72-7793-40ca-8165-539e8680c434 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:50.315998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce407e72-7793-40ca-8165-539e8680c434 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:50.325911 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce407e72-7793-40ca-8165-539e8680c434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:50.326810 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b25860-4fb6-4c7f-bee1-a9fecbf50aeb None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:50.333335 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-ce407e72-7793-40ca-8165-539e8680c434 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:42:50.334709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 519/1045] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:42:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:50.340395 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce407e72-7793-40ca-8165-539e8680c434 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:50.361557 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524a11-7b51-4b83-8d75-8b0a7985c0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:50.362469 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524a11-7b51-4b83-8d75-8b0a7985c0aa None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:50.362754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524a11-7b51-4b83-8d75-8b0a7985c0aa None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:50.363027 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524a11-7b51-4b83-8d75-8b0a7985c0aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:50.369576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a524a11-7b51-4b83-8d75-8b0a7985c0aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:50.371043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a524a11-7b51-4b83-8d75-8b0a7985c0aa None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:50.384578 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-1a524a11-7b51-4b83-8d75-8b0a7985c0aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:50.385749 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 527/1046] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:50.391992 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524a11-7b51-4b83-8d75-8b0a7985c0aa None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:50.440965 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce407e72-7793-40ca-8165-539e8680c434 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:50.475234 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60da49-c661-4265-b430-44374bbe809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:50.475946 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60da49-c661-4265-b430-44374bbe809d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:50.476231 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60da49-c661-4265-b430-44374bbe809d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:50.476507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60da49-c661-4265-b430-44374bbe809d None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:50.477246 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60da49-c661-4265-b430-44374bbe809d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:50.477555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60da49-c661-4265-b430-44374bbe809d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:50.478928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60da49-c661-4265-b430-44374bbe809d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:50.487925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 520/1047] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:42:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:50.493356 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524a11-7b51-4b83-8d75-8b0a7985c0aa None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:50.493816 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60da49-c661-4265-b430-44374bbe809d None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:50.526814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2a2f2-75b6-4b53-80d4-f3c568eb208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:50.527474 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a2f2-75b6-4b53-80d4-f3c568eb208f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:50.527792 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a2f2-75b6-4b53-80d4-f3c568eb208f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:50.528065 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a2f2-75b6-4b53-80d4-f3c568eb208f None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:50.528868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2a2f2-75b6-4b53-80d4-f3c568eb208f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:50.529185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2a2f2-75b6-4b53-80d4-f3c568eb208f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:50.531247 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2a2f2-75b6-4b53-80d4-f3c568eb208f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:50.543353 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 528/1048] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:50.549080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2a2f2-75b6-4b53-80d4-f3c568eb208f None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:50.591219 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60da49-c661-4265-b430-44374bbe809d None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:50.626720 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f8bd7-4044-4382-bb2c-eae6bdd4970a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:50.627630 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f8bd7-4044-4382-bb2c-eae6bdd4970a None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:50.627910 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f8bd7-4044-4382-bb2c-eae6bdd4970a None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:50.628183 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f8bd7-4044-4382-bb2c-eae6bdd4970a None admin] PATH_INFO: `/v3/users/c4c298c6dd394dfd972fafe93df13238` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:50.644539 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f8bd7-4044-4382-bb2c-eae6bdd4970a None admin] RBAC: Authorizing `identity:get_user(user_id=c4c298c6dd394dfd972fafe93df13238)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:50.646007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f8bd7-4044-4382-bb2c-eae6bdd4970a None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:50.646111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2a2f2-75b6-4b53-80d4-f3c568eb208f None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:50.652657 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 521/1049] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:42:50 2022] GET /identity/v3/users/c4c298c6dd394dfd972fafe93df13238 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:50.653445 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f8bd7-4044-4382-bb2c-eae6bdd4970a None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:50.685406 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5780bc-87ae-4329-b8d8-1ba8b9dc5b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:50.686740 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5780bc-87ae-4329-b8d8-1ba8b9dc5b9e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:50.687022 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5780bc-87ae-4329-b8d8-1ba8b9dc5b9e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:50.687290 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5780bc-87ae-4329-b8d8-1ba8b9dc5b9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:50.688297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5780bc-87ae-4329-b8d8-1ba8b9dc5b9e None admin] RBAC: Adding query filter params (role.id=5b24bb8e8b36434f986d06603c8ac351, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=534fd902f96043068e99ca0537cf57c5) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:50.688602 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5780bc-87ae-4329-b8d8-1ba8b9dc5b9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:50.690024 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5780bc-87ae-4329-b8d8-1ba8b9dc5b9e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:50.695312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 529/1050] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:50 2022] GET /identity/v3/role_assignments?user.id=534fd902f96043068e99ca0537cf57c5&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=5b24bb8e8b36434f986d06603c8ac351 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:50.760268 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f8bd7-4044-4382-bb2c-eae6bdd4970a None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:50.796930 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f862a8-bdfa-449d-bc77-c3af36b51187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:50.798041 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f862a8-bdfa-449d-bc77-c3af36b51187 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:50.798543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f862a8-bdfa-449d-bc77-c3af36b51187 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:50.799065 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f862a8-bdfa-449d-bc77-c3af36b51187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:50.869707 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f862a8-bdfa-449d-bc77-c3af36b51187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:50.871330 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f862a8-bdfa-449d-bc77-c3af36b51187 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:50.969100 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 522/1051] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:50 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 11:42:50.975158 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5780bc-87ae-4329-b8d8-1ba8b9dc5b9e None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:51.069313 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5780bc-87ae-4329-b8d8-1ba8b9dc5b9e None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:51.101293 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18751c-b25b-49ed-b3f1-be3d5827cad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:51.102202 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18751c-b25b-49ed-b3f1-be3d5827cad7 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:51.102485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18751c-b25b-49ed-b3f1-be3d5827cad7 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:51.102806 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18751c-b25b-49ed-b3f1-be3d5827cad7 None admin] PATH_INFO: `/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:51.104008 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18751c-b25b-49ed-b3f1-be3d5827cad7 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe06d88a4de4c02986eb7d175c9e96f)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:51.105423 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18751c-b25b-49ed-b3f1-be3d5827cad7 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:51.108134 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 530/1052] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:42:50 2022] GET /identity/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:51.113835 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f862a8-bdfa-449d-bc77-c3af36b51187 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:51.213422 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f862a8-bdfa-449d-bc77-c3af36b51187 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:51.245963 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dedbf-830a-47fb-a6af-90cde93f0f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:51.246615 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dedbf-830a-47fb-a6af-90cde93f0f04 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:51.246891 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dedbf-830a-47fb-a6af-90cde93f0f04 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:51.247161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dedbf-830a-47fb-a6af-90cde93f0f04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:51.248050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dedbf-830a-47fb-a6af-90cde93f0f04 None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=cbe06d88a4de4c02986eb7d175c9e96f, user.id=c4c298c6dd394dfd972fafe93df13238) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:51.248356 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dedbf-830a-47fb-a6af-90cde93f0f04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:51.249779 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dedbf-830a-47fb-a6af-90cde93f0f04 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:51.255173 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 523/1053] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:51 2022] GET /identity/v3/role_assignments?user.id=c4c298c6dd394dfd972fafe93df13238&scope.project.id=cbe06d88a4de4c02986eb7d175c9e96f&role.id=c2642d38bc964424a5edc330e0d4471d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:52.155836 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e6cce-8efd-4856-87d6-a9703fdba4f5 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:52.156391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e6cce-8efd-4856-87d6-a9703fdba4f5 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:52.156391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e6cce-8efd-4856-87d6-a9703fdba4f5 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:52.158170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 531/1054] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:52.163540 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ccfe1-21bc-47c0-92d3-711b7eeff765 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:52.163948 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ccfe1-21bc-47c0-92d3-711b7eeff765 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:52.164110 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ccfe1-21bc-47c0-92d3-711b7eeff765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:52.180405 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-2f8ccfe1-21bc-47c0-92d3-711b7eeff765 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:52.181568 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-2f8ccfe1-21bc-47c0-92d3-711b7eeff765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:52.252187 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 524/1055] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:52.276060 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e6cce-8efd-4856-87d6-a9703fdba4f5 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:52.380663 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e6cce-8efd-4856-87d6-a9703fdba4f5 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:52.415287 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2a2a9-ffc6-45b3-8f88-4278d3a949ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:52.416032 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2a2a9-ffc6-45b3-8f88-4278d3a949ff None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:52.416315 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2a2a9-ffc6-45b3-8f88-4278d3a949ff None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:52.416591 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2a2a9-ffc6-45b3-8f88-4278d3a949ff None admin] PATH_INFO: `/v3/services/image` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:52.417241 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2a2a9-ffc6-45b3-8f88-4278d3a949ff None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:52.418608 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2a2a9-ffc6-45b3-8f88-4278d3a949ff None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:52.429660 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-9dc2a2a9-ffc6-45b3-8f88-4278d3a949ff None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 08 11:42:52.430999 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 532/1056] 10.222.0.52 () {56 vars in 1105 bytes} [Tue Mar 8 11:42:52 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:52.437593 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ccfe1-21bc-47c0-92d3-711b7eeff765 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:52.536110 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ccfe1-21bc-47c0-92d3-711b7eeff765 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:52.569673 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdc236-f266-420f-bcf5-046b9f648c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:52.570347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdc236-f266-420f-bcf5-046b9f648c07 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:52.570632 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdc236-f266-420f-bcf5-046b9f648c07 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:52.570907 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdc236-f266-420f-bcf5-046b9f648c07 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:52.571638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdc236-f266-420f-bcf5-046b9f648c07 None admin] RBAC: Adding query filter params (name=image) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:52.571948 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdc236-f266-420f-bcf5-046b9f648c07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:52.573328 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdc236-f266-420f-bcf5-046b9f648c07 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:52.583483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 525/1057] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:52.584312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2a2a9-ffc6-45b3-8f88-4278d3a949ff None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:52.683318 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2a2a9-ffc6-45b3-8f88-4278d3a949ff None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:52.715073 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2ed23-bcec-4d47-aa10-dfa01c7b9b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:52.715761 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2ed23-bcec-4d47-aa10-dfa01c7b9b7e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:52.716045 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2ed23-bcec-4d47-aa10-dfa01c7b9b7e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:52.716318 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2ed23-bcec-4d47-aa10-dfa01c7b9b7e None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:52.717546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2ed23-bcec-4d47-aa10-dfa01c7b9b7e None admin] RBAC: Adding query filter params (type=image) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:52.717853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2ed23-bcec-4d47-aa10-dfa01c7b9b7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:52.719227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2ed23-bcec-4d47-aa10-dfa01c7b9b7e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:52.724001 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 533/1058] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:52.729428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdc236-f266-420f-bcf5-046b9f648c07 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:52.826773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdc236-f266-420f-bcf5-046b9f648c07 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:52.859141 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4c126-8919-4741-97c1-0803d2cbb65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:52.859826 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4c126-8919-4741-97c1-0803d2cbb65f None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:52.860113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4c126-8919-4741-97c1-0803d2cbb65f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:52.860385 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4c126-8919-4741-97c1-0803d2cbb65f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:52.861125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4c126-8919-4741-97c1-0803d2cbb65f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:52.862512 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4c126-8919-4741-97c1-0803d2cbb65f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:52.955711 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 526/1059] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 11:42:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 11:42:52.995096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fe3a4-8e44-4cdf-95e7-66905f46cddd None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:52.995379 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fe3a4-8e44-4cdf-95e7-66905f46cddd None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:52.995690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fe3a4-8e44-4cdf-95e7-66905f46cddd None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:52.997490 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 534/1060] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:53.003172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f50fc4-a755-41e6-920e-441acd78ac80 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:53.003457 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f50fc4-a755-41e6-920e-441acd78ac80 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:53.003769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f50fc4-a755-41e6-920e-441acd78ac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:53.022388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-b4f50fc4-a755-41e6-920e-441acd78ac80 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:53.023603 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b4f50fc4-a755-41e6-920e-441acd78ac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:53.101911 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 527/1061] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:53.126220 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fe3a4-8e44-4cdf-95e7-66905f46cddd None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:53.233349 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fe3a4-8e44-4cdf-95e7-66905f46cddd None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:53.264923 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1dcb7-362e-4965-9280-20e7c50921c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:53.265726 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1dcb7-362e-4965-9280-20e7c50921c8 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:53.266003 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1dcb7-362e-4965-9280-20e7c50921c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:53.266273 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1dcb7-362e-4965-9280-20e7c50921c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:53.276158 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1dcb7-362e-4965-9280-20e7c50921c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:53.283870 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-35e1dcb7-362e-4965-9280-20e7c50921c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 11:42:53.285238 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 535/1062] 10.222.0.52 () {56 vars in 1120 bytes} [Tue Mar 8 11:42:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:53.291038 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f50fc4-a755-41e6-920e-441acd78ac80 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:53.383985 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f50fc4-a755-41e6-920e-441acd78ac80 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:53.416916 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c49d78-29db-49bb-a8f7-6a064711800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:53.417587 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c49d78-29db-49bb-a8f7-6a064711800d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:53.417864 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c49d78-29db-49bb-a8f7-6a064711800d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:53.418136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c49d78-29db-49bb-a8f7-6a064711800d None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:53.418868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c49d78-29db-49bb-a8f7-6a064711800d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:53.419170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c49d78-29db-49bb-a8f7-6a064711800d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:53.421370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c49d78-29db-49bb-a8f7-6a064711800d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:53.429193 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 528/1063] 10.222.0.52 () {56 vars in 1115 bytes} [Tue Mar 8 11:42:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:53.434742 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1dcb7-362e-4965-9280-20e7c50921c8 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:53.529867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1dcb7-362e-4965-9280-20e7c50921c8 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:53.549682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69402dd-1e90-44ea-b626-90f6d79e1962 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:53.549975 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69402dd-1e90-44ea-b626-90f6d79e1962 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:53.550256 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69402dd-1e90-44ea-b626-90f6d79e1962 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:53.552086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 529/1064] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:53.556878 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41c8dd-6dc3-4561-9080-4cf6e216e332 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:53.557169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41c8dd-6dc3-4561-9080-4cf6e216e332 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:53.557448 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41c8dd-6dc3-4561-9080-4cf6e216e332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:53.562539 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19175e20-46a0-47fd-8edf-470b489eaa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:53.563328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19175e20-46a0-47fd-8edf-470b489eaa22 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:53.563690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19175e20-46a0-47fd-8edf-470b489eaa22 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:53.563953 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19175e20-46a0-47fd-8edf-470b489eaa22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:53.575067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-5a41c8dd-6dc3-4561-9080-4cf6e216e332 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:53.575431 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19175e20-46a0-47fd-8edf-470b489eaa22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:53.576892 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5a41c8dd-6dc3-4561-9080-4cf6e216e332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:53.577563 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19175e20-46a0-47fd-8edf-470b489eaa22 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:53.594475 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-19175e20-46a0-47fd-8edf-470b489eaa22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:53.600199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 536/1065] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:53.601573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19175e20-46a0-47fd-8edf-470b489eaa22 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:53.644152 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 530/1066] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:53.667722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41c8dd-6dc3-4561-9080-4cf6e216e332 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:53.700687 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19175e20-46a0-47fd-8edf-470b489eaa22 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:53.734598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef885cd-e932-4af1-b437-99f215080337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:53.735271 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef885cd-e932-4af1-b437-99f215080337 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:53.735569 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef885cd-e932-4af1-b437-99f215080337 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:53.735849 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef885cd-e932-4af1-b437-99f215080337 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:53.736565 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef885cd-e932-4af1-b437-99f215080337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:53.736872 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef885cd-e932-4af1-b437-99f215080337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:53.738241 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef885cd-e932-4af1-b437-99f215080337 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:53.750028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 537/1067] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:53.755285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef885cd-e932-4af1-b437-99f215080337 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:53.764381 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41c8dd-6dc3-4561-9080-4cf6e216e332 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:53.802437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37036b4-bf50-4d2f-ae61-b80d570b8dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:53.803172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37036b4-bf50-4d2f-ae61-b80d570b8dda None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:53.803456 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37036b4-bf50-4d2f-ae61-b80d570b8dda None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:53.803775 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37036b4-bf50-4d2f-ae61-b80d570b8dda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:53.815318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37036b4-bf50-4d2f-ae61-b80d570b8dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:53.822329 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-e37036b4-bf50-4d2f-ae61-b80d570b8dda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:42:53.823618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 531/1068] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:42:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:53.830089 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37036b4-bf50-4d2f-ae61-b80d570b8dda None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:53.851236 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef885cd-e932-4af1-b437-99f215080337 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:53.884948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247f0e9-5e9f-4fb0-9697-0a33ed5bbb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:53.885734 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247f0e9-5e9f-4fb0-9697-0a33ed5bbb54 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:53.886013 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247f0e9-5e9f-4fb0-9697-0a33ed5bbb54 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:53.886284 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247f0e9-5e9f-4fb0-9697-0a33ed5bbb54 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:53.894451 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247f0e9-5e9f-4fb0-9697-0a33ed5bbb54 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:53.895938 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247f0e9-5e9f-4fb0-9697-0a33ed5bbb54 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:53.910178 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-4247f0e9-5e9f-4fb0-9697-0a33ed5bbb54 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 11:42:53.911683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 538/1069] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 11:42:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:53.916954 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247f0e9-5e9f-4fb0-9697-0a33ed5bbb54 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:53.931917 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37036b4-bf50-4d2f-ae61-b80d570b8dda None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:53.970845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff0ab0-a3ad-4869-aa0f-adcf58df0991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:53.971557 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff0ab0-a3ad-4869-aa0f-adcf58df0991 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:53.971847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff0ab0-a3ad-4869-aa0f-adcf58df0991 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:53.972122 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff0ab0-a3ad-4869-aa0f-adcf58df0991 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:53.972872 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff0ab0-a3ad-4869-aa0f-adcf58df0991 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:53.973183 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff0ab0-a3ad-4869-aa0f-adcf58df0991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:53.974626 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff0ab0-a3ad-4869-aa0f-adcf58df0991 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:53.987552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 532/1070] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:53.990651 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff0ab0-a3ad-4869-aa0f-adcf58df0991 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:54.017863 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247f0e9-5e9f-4fb0-9697-0a33ed5bbb54 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:54.053152 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87047262-c29e-4513-8a77-5680f5d7032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:54.053364 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87047262-c29e-4513-8a77-5680f5d7032a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:54.053551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87047262-c29e-4513-8a77-5680f5d7032a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:54.053829 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87047262-c29e-4513-8a77-5680f5d7032a None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:54.054659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87047262-c29e-4513-8a77-5680f5d7032a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:54.054971 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87047262-c29e-4513-8a77-5680f5d7032a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:54.056449 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87047262-c29e-4513-8a77-5680f5d7032a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:54.073821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 539/1071] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 11:42:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:54.079328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87047262-c29e-4513-8a77-5680f5d7032a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:54.094421 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff0ab0-a3ad-4869-aa0f-adcf58df0991 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:54.130672 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66654120-3269-4ba0-8c66-02b9a091df30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:54.131949 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66654120-3269-4ba0-8c66-02b9a091df30 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:54.132230 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66654120-3269-4ba0-8c66-02b9a091df30 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:54.132507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66654120-3269-4ba0-8c66-02b9a091df30 None admin] PATH_INFO: `/v3/users/c4c298c6dd394dfd972fafe93df13238` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:54.133733 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66654120-3269-4ba0-8c66-02b9a091df30 None admin] RBAC: Authorizing `identity:get_user(user_id=c4c298c6dd394dfd972fafe93df13238)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:54.135269 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66654120-3269-4ba0-8c66-02b9a091df30 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:54.137099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 533/1072] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:42:53 2022] GET /identity/v3/users/c4c298c6dd394dfd972fafe93df13238 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:54.142826 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66654120-3269-4ba0-8c66-02b9a091df30 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:54.179394 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87047262-c29e-4513-8a77-5680f5d7032a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:54.214031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602068ac-0713-485b-9e51-7aa24a531342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:54.214824 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602068ac-0713-485b-9e51-7aa24a531342 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:54.215111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602068ac-0713-485b-9e51-7aa24a531342 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:54.215394 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602068ac-0713-485b-9e51-7aa24a531342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:54.226221 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602068ac-0713-485b-9e51-7aa24a531342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:54.227710 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602068ac-0713-485b-9e51-7aa24a531342 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:54.245967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-602068ac-0713-485b-9e51-7aa24a531342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:54.247850 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 540/1073] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:54.247959 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66654120-3269-4ba0-8c66-02b9a091df30 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:54.253471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602068ac-0713-485b-9e51-7aa24a531342 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:54.286304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83d2c2-4207-4e77-9c7f-9df7e0353876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:54.287165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83d2c2-4207-4e77-9c7f-9df7e0353876 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:54.287445 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83d2c2-4207-4e77-9c7f-9df7e0353876 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:54.287745 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83d2c2-4207-4e77-9c7f-9df7e0353876 None admin] PATH_INFO: `/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:54.288926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83d2c2-4207-4e77-9c7f-9df7e0353876 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe06d88a4de4c02986eb7d175c9e96f)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:54.290358 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83d2c2-4207-4e77-9c7f-9df7e0353876 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:54.295885 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 534/1074] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:42:54 2022] GET /identity/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:54.298212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83d2c2-4207-4e77-9c7f-9df7e0353876 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:54.349432 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602068ac-0713-485b-9e51-7aa24a531342 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:54.382421 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85643251-b927-4110-b52b-88b011c6b766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:54.383074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85643251-b927-4110-b52b-88b011c6b766 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:54.383359 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85643251-b927-4110-b52b-88b011c6b766 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:54.383675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85643251-b927-4110-b52b-88b011c6b766 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:54.384367 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85643251-b927-4110-b52b-88b011c6b766 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:54.384673 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85643251-b927-4110-b52b-88b011c6b766 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:54.386034 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85643251-b927-4110-b52b-88b011c6b766 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:54.397307 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 541/1075] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:54.398970 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83d2c2-4207-4e77-9c7f-9df7e0353876 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:54.402601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85643251-b927-4110-b52b-88b011c6b766 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:54.433380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9c36f-9d08-4ef5-9d0c-2e42a4faecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:54.434284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9c36f-9d08-4ef5-9d0c-2e42a4faecd0 None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:54.434565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9c36f-9d08-4ef5-9d0c-2e42a4faecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:54.434837 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9c36f-9d08-4ef5-9d0c-2e42a4faecd0 None admin] PATH_INFO: `/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f/users/c4c298c6dd394dfd972fafe93df13238/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:54.437397 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9c36f-9d08-4ef5-9d0c-2e42a4faecd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbe06d88a4de4c02986eb7d175c9e96f, user_id=c4c298c6dd394dfd972fafe93df13238, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:54.438835 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9c36f-9d08-4ef5-9d0c-2e42a4faecd0 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:54.500588 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85643251-b927-4110-b52b-88b011c6b766 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:54.511311 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 535/1076] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:42:54 2022] PUT /identity/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f/users/c4c298c6dd394dfd972fafe93df13238/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 11:42:54.537428 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a382e18-8236-46d3-97d0-68cd4a23ac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:54.538251 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a382e18-8236-46d3-97d0-68cd4a23ac03 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:54.538532 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a382e18-8236-46d3-97d0-68cd4a23ac03 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:54.538805 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a382e18-8236-46d3-97d0-68cd4a23ac03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:54.547195 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a382e18-8236-46d3-97d0-68cd4a23ac03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:54.548713 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a382e18-8236-46d3-97d0-68cd4a23ac03 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:54.563928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-4a382e18-8236-46d3-97d0-68cd4a23ac03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:54.565195 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 542/1077] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:54.571180 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9c36f-9d08-4ef5-9d0c-2e42a4faecd0 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:54.675204 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9c36f-9d08-4ef5-9d0c-2e42a4faecd0 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:54.710499 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c16456-568d-4efd-95a3-daffad0f7567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:54.711245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c16456-568d-4efd-95a3-daffad0f7567 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:54.711597 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c16456-568d-4efd-95a3-daffad0f7567 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:54.711847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c16456-568d-4efd-95a3-daffad0f7567 None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:54.712618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c16456-568d-4efd-95a3-daffad0f7567 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:54.712960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c16456-568d-4efd-95a3-daffad0f7567 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:54.714372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c16456-568d-4efd-95a3-daffad0f7567 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:54.726645 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 536/1078] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:54.733303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a382e18-8236-46d3-97d0-68cd4a23ac03 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:54.828611 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a382e18-8236-46d3-97d0-68cd4a23ac03 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:54.860897 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd5d11-948e-43e5-ac4a-e55c8219a747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:54.861797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd5d11-948e-43e5-ac4a-e55c8219a747 None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:54.862077 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd5d11-948e-43e5-ac4a-e55c8219a747 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:54.862353 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd5d11-948e-43e5-ac4a-e55c8219a747 None admin] PATH_INFO: `/v3/projects/7c390663688b466f98ff480c31ba21bc/users/534fd902f96043068e99ca0537cf57c5/roles/5b24bb8e8b36434f986d06603c8ac351` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:54.864620 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd5d11-948e-43e5-ac4a-e55c8219a747 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c390663688b466f98ff480c31ba21bc, user_id=534fd902f96043068e99ca0537cf57c5, role_id=5b24bb8e8b36434f986d06603c8ac351)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:54.866059 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd5d11-948e-43e5-ac4a-e55c8219a747 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:54.939770 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 543/1079] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:42:54 2022] PUT /identity/v3/projects/7c390663688b466f98ff480c31ba21bc/users/534fd902f96043068e99ca0537cf57c5/roles/5b24bb8e8b36434f986d06603c8ac351 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:42:55.311952 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6f5b6-65bf-4cf1-8939-981a08f0c529 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:55.312519 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6f5b6-65bf-4cf1-8939-981a08f0c529 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:55.312519 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6f5b6-65bf-4cf1-8939-981a08f0c529 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:55.314294 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 537/1080] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:55.319388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e2ace-3e30-4f52-b8b8-46a66c5f4a2e None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:55.319821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e2ace-3e30-4f52-b8b8-46a66c5f4a2e None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:55.319983 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e2ace-3e30-4f52-b8b8-46a66c5f4a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:55.336437 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-d30e2ace-3e30-4f52-b8b8-46a66c5f4a2e None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:55.337605 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d30e2ace-3e30-4f52-b8b8-46a66c5f4a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:55.403213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 544/1081] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:55.426347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6f5b6-65bf-4cf1-8939-981a08f0c529 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:55.521415 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6f5b6-65bf-4cf1-8939-981a08f0c529 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:55.553584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35ee28-1d91-41a5-9bb2-016cf376b6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:55.554245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35ee28-1d91-41a5-9bb2-016cf376b6c8 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:55.554557 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35ee28-1d91-41a5-9bb2-016cf376b6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:55.554827 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35ee28-1d91-41a5-9bb2-016cf376b6c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:55.619626 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35ee28-1d91-41a5-9bb2-016cf376b6c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:55.621161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35ee28-1d91-41a5-9bb2-016cf376b6c8 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:55.718800 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 538/1082] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:42:55.724322 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e2ace-3e30-4f52-b8b8-46a66c5f4a2e None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:55.818807 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e2ace-3e30-4f52-b8b8-46a66c5f4a2e None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:55.850503 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c148229-c1ff-48a6-9f99-0156ff159677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:55.851292 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c148229-c1ff-48a6-9f99-0156ff159677 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:55.851598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c148229-c1ff-48a6-9f99-0156ff159677 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:55.851876 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c148229-c1ff-48a6-9f99-0156ff159677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:55.861980 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c148229-c1ff-48a6-9f99-0156ff159677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:55.863423 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c148229-c1ff-48a6-9f99-0156ff159677 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:55.880621 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-6c148229-c1ff-48a6-9f99-0156ff159677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:55.881941 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 545/1083] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:55.887736 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35ee28-1d91-41a5-9bb2-016cf376b6c8 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:55.985371 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35ee28-1d91-41a5-9bb2-016cf376b6c8 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:56.017822 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4c311-ecfd-430f-86af-56d896a4530a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:56.018492 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4c311-ecfd-430f-86af-56d896a4530a None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:56.018774 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4c311-ecfd-430f-86af-56d896a4530a None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:56.019048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4c311-ecfd-430f-86af-56d896a4530a None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:56.019791 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4c311-ecfd-430f-86af-56d896a4530a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:56.020099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4c311-ecfd-430f-86af-56d896a4530a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:56.021734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4c311-ecfd-430f-86af-56d896a4530a None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:56.039574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 539/1084] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:56.927546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81912f29-a666-4a7b-858d-b95941fe21e4 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:56.928104 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81912f29-a666-4a7b-858d-b95941fe21e4 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:56.928104 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81912f29-a666-4a7b-858d-b95941fe21e4 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:56.929869 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 546/1085] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:42:56.935178 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3722b-476c-47fc-880f-59977eee6374 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:56.935709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3722b-476c-47fc-880f-59977eee6374 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:56.935803 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3722b-476c-47fc-880f-59977eee6374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:56.952289 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-beb3722b-476c-47fc-880f-59977eee6374 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:56.953483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-beb3722b-476c-47fc-880f-59977eee6374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:57.016385 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 540/1086] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:42:57.040239 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81912f29-a666-4a7b-858d-b95941fe21e4 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:57.136773 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81912f29-a666-4a7b-858d-b95941fe21e4 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:57.168976 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4109d-6ae7-4857-9580-cbd75c340801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:57.170305 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4109d-6ae7-4857-9580-cbd75c340801 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:57.170684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4109d-6ae7-4857-9580-cbd75c340801 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:57.170962 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4109d-6ae7-4857-9580-cbd75c340801 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:57.180662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4109d-6ae7-4857-9580-cbd75c340801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:57.187853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-56d4109d-6ae7-4857-9580-cbd75c340801 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:42:57.189270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 547/1087] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:42:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:57.195099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3722b-476c-47fc-880f-59977eee6374 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:57.220604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff963e-ae7f-43b3-97c8-f15278a8cce5 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:57.220879 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff963e-ae7f-43b3-97c8-f15278a8cce5 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:57.221149 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff963e-ae7f-43b3-97c8-f15278a8cce5 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:57.222931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 548/1088] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:42:57.227775 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51296f8c-3987-4581-8812-6cfaf1470fc1 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:57.228058 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51296f8c-3987-4581-8812-6cfaf1470fc1 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:57.228330 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51296f8c-3987-4581-8812-6cfaf1470fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:57.244978 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-51296f8c-3987-4581-8812-6cfaf1470fc1 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:42:57.246150 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-51296f8c-3987-4581-8812-6cfaf1470fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:42:57.291418 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3722b-476c-47fc-880f-59977eee6374 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:57.308865 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 549/1089] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:42:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:42:57.322614 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424a4cf-b0c4-4ada-8e45-4325a2b8cc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:57.323286 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424a4cf-b0c4-4ada-8e45-4325a2b8cc7f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:57.323597 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424a4cf-b0c4-4ada-8e45-4325a2b8cc7f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:57.323874 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424a4cf-b0c4-4ada-8e45-4325a2b8cc7f None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:57.324610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424a4cf-b0c4-4ada-8e45-4325a2b8cc7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:57.324917 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424a4cf-b0c4-4ada-8e45-4325a2b8cc7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:57.326801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424a4cf-b0c4-4ada-8e45-4325a2b8cc7f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:57.333638 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51296f8c-3987-4581-8812-6cfaf1470fc1 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:57.339014 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 541/1090] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:42:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:57.339967 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424a4cf-b0c4-4ada-8e45-4325a2b8cc7f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:57.425340 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51296f8c-3987-4581-8812-6cfaf1470fc1 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:57.432406 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424a4cf-b0c4-4ada-8e45-4325a2b8cc7f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:57.457947 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35a927-a691-4db8-b3af-6150dccee7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:57.458748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35a927-a691-4db8-b3af-6150dccee7c6 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:57.459088 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35a927-a691-4db8-b3af-6150dccee7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:57.459371 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35a927-a691-4db8-b3af-6150dccee7c6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:57.464800 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6e4db-cdb9-412a-8099-02a2bfb07555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:57.465674 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6e4db-cdb9-412a-8099-02a2bfb07555 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:57.465957 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6e4db-cdb9-412a-8099-02a2bfb07555 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:57.466274 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6e4db-cdb9-412a-8099-02a2bfb07555 None admin] PATH_INFO: `/v3/users/c4c298c6dd394dfd972fafe93df13238` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:57.468051 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6e4db-cdb9-412a-8099-02a2bfb07555 None admin] RBAC: Authorizing `identity:get_user(user_id=c4c298c6dd394dfd972fafe93df13238)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:57.469484 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6e4db-cdb9-412a-8099-02a2bfb07555 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:57.469611 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35a927-a691-4db8-b3af-6150dccee7c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:42:57.471097 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 542/1091] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:42:57 2022] GET /identity/v3/users/c4c298c6dd394dfd972fafe93df13238 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:57.476644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6e4db-cdb9-412a-8099-02a2bfb07555 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:57.477850 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-bc35a927-a691-4db8-b3af-6150dccee7c6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 11:42:57.484031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 550/1092] 10.222.0.52 () {56 vars in 1120 bytes} [Tue Mar 8 11:42:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:57.485005 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35a927-a691-4db8-b3af-6150dccee7c6 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:57.569529 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6e4db-cdb9-412a-8099-02a2bfb07555 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:57.577745 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35a927-a691-4db8-b3af-6150dccee7c6 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:57.601706 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107097d-146c-45b6-a184-6527ccfdbf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:57.602352 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107097d-146c-45b6-a184-6527ccfdbf46 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:57.602633 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107097d-146c-45b6-a184-6527ccfdbf46 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:57.602909 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107097d-146c-45b6-a184-6527ccfdbf46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:57.609901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8c67-503e-4a20-9de4-693051d1162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:57.610559 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8c67-503e-4a20-9de4-693051d1162d None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:57.610839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8c67-503e-4a20-9de4-693051d1162d None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:57.611116 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8c67-503e-4a20-9de4-693051d1162d None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:57.611880 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b8c67-503e-4a20-9de4-693051d1162d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:57.612599 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b8c67-503e-4a20-9de4-693051d1162d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:57.613973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b8c67-503e-4a20-9de4-693051d1162d None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:57.621837 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 551/1093] 10.222.0.52 () {56 vars in 1115 bytes} [Tue Mar 8 11:42:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:57.628030 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8c67-503e-4a20-9de4-693051d1162d None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:57.670052 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107097d-146c-45b6-a184-6527ccfdbf46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:57.671507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107097d-146c-45b6-a184-6527ccfdbf46 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:57.730406 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8c67-503e-4a20-9de4-693051d1162d None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:57.762489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e3a75-0839-4d6e-a2d1-1ee84edee920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:57.763621 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e3a75-0839-4d6e-a2d1-1ee84edee920 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:57.763968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e3a75-0839-4d6e-a2d1-1ee84edee920 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:57.764303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e3a75-0839-4d6e-a2d1-1ee84edee920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:57.766415 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 543/1094] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 11:42:57.772162 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107097d-146c-45b6-a184-6527ccfdbf46 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:57.775192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e3a75-0839-4d6e-a2d1-1ee84edee920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:57.776674 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e3a75-0839-4d6e-a2d1-1ee84edee920 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:57.792912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-946e3a75-0839-4d6e-a2d1-1ee84edee920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:57.794111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 552/1095] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:57.800301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e3a75-0839-4d6e-a2d1-1ee84edee920 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:57.864491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107097d-146c-45b6-a184-6527ccfdbf46 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:57.893305 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e3a75-0839-4d6e-a2d1-1ee84edee920 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:57.895482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20810da-7166-4a92-8685-884d4a3e1016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:57.896673 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20810da-7166-4a92-8685-884d4a3e1016 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:57.896957 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20810da-7166-4a92-8685-884d4a3e1016 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:57.897233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20810da-7166-4a92-8685-884d4a3e1016 None admin] PATH_INFO: `/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:57.898410 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20810da-7166-4a92-8685-884d4a3e1016 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe06d88a4de4c02986eb7d175c9e96f)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:57.899883 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20810da-7166-4a92-8685-884d4a3e1016 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:57.901566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 544/1096] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:42:57 2022] GET /identity/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:57.907937 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20810da-7166-4a92-8685-884d4a3e1016 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:57.926492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b37c69-7fe5-4ca0-81d6-21b6222cedfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:57.927152 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b37c69-7fe5-4ca0-81d6-21b6222cedfb None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:57.927435 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b37c69-7fe5-4ca0-81d6-21b6222cedfb None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:57.927733 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b37c69-7fe5-4ca0-81d6-21b6222cedfb None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:57.928444 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b37c69-7fe5-4ca0-81d6-21b6222cedfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:57.928751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b37c69-7fe5-4ca0-81d6-21b6222cedfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:57.930117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b37c69-7fe5-4ca0-81d6-21b6222cedfb None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:57.941293 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 553/1097] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:57.946675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b37c69-7fe5-4ca0-81d6-21b6222cedfb None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:58.009159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20810da-7166-4a92-8685-884d4a3e1016 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:58.046856 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b37c69-7fe5-4ca0-81d6-21b6222cedfb None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:58.049116 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ae7c6-279a-4c02-ab08-b5414b5a182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:58.049869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ae7c6-279a-4c02-ab08-b5414b5a182b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:58.050150 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ae7c6-279a-4c02-ab08-b5414b5a182b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:58.050420 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ae7c6-279a-4c02-ab08-b5414b5a182b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:58.051233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ae7c6-279a-4c02-ab08-b5414b5a182b None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=cbe06d88a4de4c02986eb7d175c9e96f, user.id=c4c298c6dd394dfd972fafe93df13238) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:58.051561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ae7c6-279a-4c02-ab08-b5414b5a182b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:58.052990 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ae7c6-279a-4c02-ab08-b5414b5a182b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:58.058615 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 545/1098] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:57 2022] GET /identity/v3/role_assignments?user.id=c4c298c6dd394dfd972fafe93df13238&scope.project.id=cbe06d88a4de4c02986eb7d175c9e96f&role.id=c2642d38bc964424a5edc330e0d4471d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:42:58.080824 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd51e5-49f6-4b12-9b89-81069b327054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:58.081644 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd51e5-49f6-4b12-9b89-81069b327054 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:58.081927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd51e5-49f6-4b12-9b89-81069b327054 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:58.082205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd51e5-49f6-4b12-9b89-81069b327054 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:58.090349 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd51e5-49f6-4b12-9b89-81069b327054 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:58.092779 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd51e5-49f6-4b12-9b89-81069b327054 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:58.107644 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-9ccd51e5-49f6-4b12-9b89-81069b327054 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 11:42:58.108989 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 554/1099] 10.222.0.52 () {56 vars in 1093 bytes} [Tue Mar 8 11:42:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:58.114988 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ae7c6-279a-4c02-ab08-b5414b5a182b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:58.217787 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ae7c6-279a-4c02-ab08-b5414b5a182b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:58.251645 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af7426-24da-4165-9988-fb050162e9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:58.252327 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af7426-24da-4165-9988-fb050162e9be None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:58.252609 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af7426-24da-4165-9988-fb050162e9be None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:58.252890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af7426-24da-4165-9988-fb050162e9be None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:58.253722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af7426-24da-4165-9988-fb050162e9be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:58.254034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af7426-24da-4165-9988-fb050162e9be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:58.255464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af7426-24da-4165-9988-fb050162e9be None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:58.273267 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 546/1100] 10.222.0.52 () {56 vars in 1133 bytes} [Tue Mar 8 11:42:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:58.279639 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd51e5-49f6-4b12-9b89-81069b327054 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:58.379639 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd51e5-49f6-4b12-9b89-81069b327054 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:58.412389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341cf1c-0b42-4332-8924-c1482c171bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:58.413031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341cf1c-0b42-4332-8924-c1482c171bfa None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:58.413312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341cf1c-0b42-4332-8924-c1482c171bfa None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:58.413586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341cf1c-0b42-4332-8924-c1482c171bfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:58.476471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341cf1c-0b42-4332-8924-c1482c171bfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:58.477915 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341cf1c-0b42-4332-8924-c1482c171bfa None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:58.569525 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 555/1101] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:42:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:42:58.575088 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af7426-24da-4165-9988-fb050162e9be None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:58.667535 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af7426-24da-4165-9988-fb050162e9be None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:58.700030 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43459e7e-287f-4b33-9606-a9cdb4719795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:58.701543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43459e7e-287f-4b33-9606-a9cdb4719795 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:58.701823 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43459e7e-287f-4b33-9606-a9cdb4719795 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:58.702094 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43459e7e-287f-4b33-9606-a9cdb4719795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:58.712416 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43459e7e-287f-4b33-9606-a9cdb4719795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:58.715005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43459e7e-287f-4b33-9606-a9cdb4719795 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:58.738363 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-43459e7e-287f-4b33-9606-a9cdb4719795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:42:58.740177 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 547/1102] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:42:58.745844 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341cf1c-0b42-4332-8924-c1482c171bfa None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:58.841185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341cf1c-0b42-4332-8924-c1482c171bfa None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:58.875135 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9d6c4-8a35-4be0-b93a-8aab45381f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:58.875918 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d6c4-8a35-4be0-b93a-8aab45381f8c None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:58.876199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d6c4-8a35-4be0-b93a-8aab45381f8c None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:58.876472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d6c4-8a35-4be0-b93a-8aab45381f8c None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:58.877181 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9d6c4-8a35-4be0-b93a-8aab45381f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:58.877486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9d6c4-8a35-4be0-b93a-8aab45381f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:58.878851 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9d6c4-8a35-4be0-b93a-8aab45381f8c None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:58.889688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 556/1103] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:58.895191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43459e7e-287f-4b33-9606-a9cdb4719795 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:58.989214 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43459e7e-287f-4b33-9606-a9cdb4719795 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:59.021564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b85f7-8bae-4c31-8e89-1a9066099004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:59.022357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b85f7-8bae-4c31-8e89-1a9066099004 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:59.022636 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b85f7-8bae-4c31-8e89-1a9066099004 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:59.022907 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b85f7-8bae-4c31-8e89-1a9066099004 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:59.029330 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b85f7-8bae-4c31-8e89-1a9066099004 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:59.030783 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b85f7-8bae-4c31-8e89-1a9066099004 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:59.043239 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-e18b85f7-8bae-4c31-8e89-1a9066099004 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:42:59.045121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 548/1104] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:42:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:42:59.050649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9d6c4-8a35-4be0-b93a-8aab45381f8c None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:59.157216 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9d6c4-8a35-4be0-b93a-8aab45381f8c None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:59.188934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214e593-8340-4114-bb69-0e98c8b8eccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:59.189593 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214e593-8340-4114-bb69-0e98c8b8eccb None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:59.189877 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214e593-8340-4114-bb69-0e98c8b8eccb None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:59.190148 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214e593-8340-4114-bb69-0e98c8b8eccb None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:59.190918 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214e593-8340-4114-bb69-0e98c8b8eccb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:59.191223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214e593-8340-4114-bb69-0e98c8b8eccb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:59.192684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214e593-8340-4114-bb69-0e98c8b8eccb None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:59.209283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 557/1105] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:42:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:42:59.210530 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b85f7-8bae-4c31-8e89-1a9066099004 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:42:59.308149 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b85f7-8bae-4c31-8e89-1a9066099004 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:42:59.339026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77bbc9-868c-4951-88e3-0314dc2205c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:42:59.339714 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77bbc9-868c-4951-88e3-0314dc2205c8 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:42:59.339998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77bbc9-868c-4951-88e3-0314dc2205c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:42:59.340272 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77bbc9-868c-4951-88e3-0314dc2205c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:42:59.341749 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77bbc9-868c-4951-88e3-0314dc2205c8 None admin] RBAC: Adding query filter params (role.id=5b24bb8e8b36434f986d06603c8ac351, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=534fd902f96043068e99ca0537cf57c5) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:42:59.342293 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77bbc9-868c-4951-88e3-0314dc2205c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:42:59.343754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77bbc9-868c-4951-88e3-0314dc2205c8 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:42:59.349285 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 549/1106] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:42:59 2022] GET /identity/v3/role_assignments?user.id=534fd902f96043068e99ca0537cf57c5&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=5b24bb8e8b36434f986d06603c8ac351 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:00.415433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92b0aa-8058-494f-b5d6-894f75589f4b None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:00.416010 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92b0aa-8058-494f-b5d6-894f75589f4b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:00.416010 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92b0aa-8058-494f-b5d6-894f75589f4b None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:00.417806 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 558/1107] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:43:00.423054 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6e96d-acfe-4094-960c-73bbced5e3bb None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:00.423470 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6e96d-acfe-4094-960c-73bbced5e3bb None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:00.423644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6e96d-acfe-4094-960c-73bbced5e3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:00.439962 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-5ba6e96d-acfe-4094-960c-73bbced5e3bb None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:00.441143 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5ba6e96d-acfe-4094-960c-73bbced5e3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:00.502282 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 550/1108] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:43:00.527452 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92b0aa-8058-494f-b5d6-894f75589f4b None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:00.621198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92b0aa-8058-494f-b5d6-894f75589f4b None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:00.653115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39f8d4-6c60-4565-a7a2-456a56e4535c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:00.654078 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39f8d4-6c60-4565-a7a2-456a56e4535c None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:00.654354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39f8d4-6c60-4565-a7a2-456a56e4535c None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:00.654623 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39f8d4-6c60-4565-a7a2-456a56e4535c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:00.655801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39f8d4-6c60-4565-a7a2-456a56e4535c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:00.657221 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39f8d4-6c60-4565-a7a2-456a56e4535c None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:00.658793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 559/1109] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:43:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:00.664281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6e96d-acfe-4094-960c-73bbced5e3bb None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:00.756842 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6e96d-acfe-4094-960c-73bbced5e3bb None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:00.788267 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60974a58-83f2-46f6-a18a-b8635784f756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:00.788925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60974a58-83f2-46f6-a18a-b8635784f756 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:00.789200 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60974a58-83f2-46f6-a18a-b8635784f756 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:00.789471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60974a58-83f2-46f6-a18a-b8635784f756 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:00.790164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60974a58-83f2-46f6-a18a-b8635784f756 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:00.791610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60974a58-83f2-46f6-a18a-b8635784f756 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:00.869113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 551/1110] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:43:00 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:43:03.197603 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d423d0b-dde9-464d-907a-48ae59001f5e None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:03.198070 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d423d0b-dde9-464d-907a-48ae59001f5e None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:03.198162 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d423d0b-dde9-464d-907a-48ae59001f5e None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:03.199967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 560/1111] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:43:03.205676 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024c076-24ed-4ab6-b21f-b9beb4a06797 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:03.206081 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024c076-24ed-4ab6-b21f-b9beb4a06797 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:03.206225 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024c076-24ed-4ab6-b21f-b9beb4a06797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:03.223545 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-0024c076-24ed-4ab6-b21f-b9beb4a06797 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:03.224761 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0024c076-24ed-4ab6-b21f-b9beb4a06797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:03.286689 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 552/1112] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:43:03.310012 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d423d0b-dde9-464d-907a-48ae59001f5e None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:03.439984 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d423d0b-dde9-464d-907a-48ae59001f5e None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:03.473699 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19b1bd-73df-4948-844b-24b2bb9a6791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:03.474478 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19b1bd-73df-4948-844b-24b2bb9a6791 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:03.474757 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19b1bd-73df-4948-844b-24b2bb9a6791 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:03.475031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19b1bd-73df-4948-844b-24b2bb9a6791 None admin] PATH_INFO: `/v3/roles/2ca014d08f26466b980433e75e765505` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:03.476517 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19b1bd-73df-4948-844b-24b2bb9a6791 None admin] RBAC: Authorizing `identity:get_role(role_id=2ca014d08f26466b980433e75e765505)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:03.477954 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19b1bd-73df-4948-844b-24b2bb9a6791 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:03.482066 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 561/1113] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:43:03 2022] GET /identity/v3/roles/2ca014d08f26466b980433e75e765505 => generated 223 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:03.485132 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024c076-24ed-4ab6-b21f-b9beb4a06797 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:03.631159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024c076-24ed-4ab6-b21f-b9beb4a06797 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:03.664187 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d31f06-01b4-45e7-8099-363b8abe1d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:03.665047 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d31f06-01b4-45e7-8099-363b8abe1d82 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:03.665326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d31f06-01b4-45e7-8099-363b8abe1d82 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:03.665598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d31f06-01b4-45e7-8099-363b8abe1d82 None admin] PATH_INFO: `/v3/users/656382fd8be648fa90451952a6b7305c` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:03.677777 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d31f06-01b4-45e7-8099-363b8abe1d82 None admin] RBAC: Authorizing `identity:get_user(user_id=656382fd8be648fa90451952a6b7305c)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:03.679330 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d31f06-01b4-45e7-8099-363b8abe1d82 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:03.680979 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 553/1114] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:43:03 2022] GET /identity/v3/users/656382fd8be648fa90451952a6b7305c => generated 286 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:03.687244 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19b1bd-73df-4948-844b-24b2bb9a6791 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:03.789408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19b1bd-73df-4948-844b-24b2bb9a6791 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:03.820983 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9549c52-f40d-4fe6-9b1f-b6c446a48f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:03.821628 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9549c52-f40d-4fe6-9b1f-b6c446a48f59 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:03.821911 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9549c52-f40d-4fe6-9b1f-b6c446a48f59 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:03.822189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9549c52-f40d-4fe6-9b1f-b6c446a48f59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:03.884188 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9549c52-f40d-4fe6-9b1f-b6c446a48f59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:03.885636 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9549c52-f40d-4fe6-9b1f-b6c446a48f59 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:03.979885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 562/1115] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:43:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:43:03.986420 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d31f06-01b4-45e7-8099-363b8abe1d82 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:04.086811 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d31f06-01b4-45e7-8099-363b8abe1d82 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:04.118724 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083425a-7fbb-4d77-aa02-3643463bedae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:04.119607 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083425a-7fbb-4d77-aa02-3643463bedae None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:04.119892 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083425a-7fbb-4d77-aa02-3643463bedae None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:04.120166 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083425a-7fbb-4d77-aa02-3643463bedae None admin] PATH_INFO: `/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:04.121336 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083425a-7fbb-4d77-aa02-3643463bedae None admin] RBAC: Authorizing `identity:get_project(project_id=cbe06d88a4de4c02986eb7d175c9e96f)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:04.122767 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083425a-7fbb-4d77-aa02-3643463bedae None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:04.125156 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 554/1116] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:43:03 2022] GET /identity/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:04.131230 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9549c52-f40d-4fe6-9b1f-b6c446a48f59 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:04.224478 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9549c52-f40d-4fe6-9b1f-b6c446a48f59 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:04.256919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feeae70-ff08-4061-9688-f57b3ab07ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:04.257560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feeae70-ff08-4061-9688-f57b3ab07ad9 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:04.257843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feeae70-ff08-4061-9688-f57b3ab07ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:04.258121 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feeae70-ff08-4061-9688-f57b3ab07ad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:04.258932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feeae70-ff08-4061-9688-f57b3ab07ad9 None admin] RBAC: Adding query filter params (role.id=2ca014d08f26466b980433e75e765505, scope.project.id=cbe06d88a4de4c02986eb7d175c9e96f, user.id=656382fd8be648fa90451952a6b7305c) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:43:04.259241 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feeae70-ff08-4061-9688-f57b3ab07ad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:04.260720 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feeae70-ff08-4061-9688-f57b3ab07ad9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:04.265899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 563/1117] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:43:04 2022] GET /identity/v3/role_assignments?user.id=656382fd8be648fa90451952a6b7305c&scope.project.id=cbe06d88a4de4c02986eb7d175c9e96f&role.id=2ca014d08f26466b980433e75e765505 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:06.538824 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb8f2d-2487-4fbf-8927-8e408bfbd27d None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:06.539324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb8f2d-2487-4fbf-8927-8e408bfbd27d None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:06.539324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb8f2d-2487-4fbf-8927-8e408bfbd27d None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:06.541103 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 555/1118] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:43:06.546351 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a4cbb-e56b-40ad-b35a-eb4fbb8c8a59 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:06.546720 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a4cbb-e56b-40ad-b35a-eb4fbb8c8a59 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:06.546907 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a4cbb-e56b-40ad-b35a-eb4fbb8c8a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:06.563227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-643a4cbb-e56b-40ad-b35a-eb4fbb8c8a59 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:06.564437 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-643a4cbb-e56b-40ad-b35a-eb4fbb8c8a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:06.626609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 564/1119] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:43:06.650207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb8f2d-2487-4fbf-8927-8e408bfbd27d None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:06.744195 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb8f2d-2487-4fbf-8927-8e408bfbd27d None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:06.776203 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac109e4d-f59a-43da-af4b-e70f66662ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:06.777039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac109e4d-f59a-43da-af4b-e70f66662ebb None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:06.777316 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac109e4d-f59a-43da-af4b-e70f66662ebb None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:06.777587 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac109e4d-f59a-43da-af4b-e70f66662ebb None admin] PATH_INFO: `/v3/roles/2ca014d08f26466b980433e75e765505` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:06.779040 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac109e4d-f59a-43da-af4b-e70f66662ebb None admin] RBAC: Authorizing `identity:get_role(role_id=2ca014d08f26466b980433e75e765505)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:06.780516 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac109e4d-f59a-43da-af4b-e70f66662ebb None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:06.781871 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 556/1120] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:43:06 2022] GET /identity/v3/roles/2ca014d08f26466b980433e75e765505 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:06.787629 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a4cbb-e56b-40ad-b35a-eb4fbb8c8a59 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:06.879592 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a4cbb-e56b-40ad-b35a-eb4fbb8c8a59 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:06.911328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c08359-d6c4-4ba7-89cf-6b0fc7183e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:06.912199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c08359-d6c4-4ba7-89cf-6b0fc7183e20 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:06.912479 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c08359-d6c4-4ba7-89cf-6b0fc7183e20 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:06.912751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c08359-d6c4-4ba7-89cf-6b0fc7183e20 None admin] PATH_INFO: `/v3/users/656382fd8be648fa90451952a6b7305c` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:06.913914 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c08359-d6c4-4ba7-89cf-6b0fc7183e20 None admin] RBAC: Authorizing `identity:get_user(user_id=656382fd8be648fa90451952a6b7305c)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:06.915351 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c08359-d6c4-4ba7-89cf-6b0fc7183e20 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:06.916985 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 565/1121] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:43:06 2022] GET /identity/v3/users/656382fd8be648fa90451952a6b7305c => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:06.922555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac109e4d-f59a-43da-af4b-e70f66662ebb None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:07.015696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac109e4d-f59a-43da-af4b-e70f66662ebb None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:07.047456 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a57b58-0e56-43ae-a4b1-932f2822c868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:07.048856 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a57b58-0e56-43ae-a4b1-932f2822c868 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:07.048856 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a57b58-0e56-43ae-a4b1-932f2822c868 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:07.048856 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a57b58-0e56-43ae-a4b1-932f2822c868 None admin] PATH_INFO: `/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:07.049988 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a57b58-0e56-43ae-a4b1-932f2822c868 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe06d88a4de4c02986eb7d175c9e96f)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:07.051393 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a57b58-0e56-43ae-a4b1-932f2822c868 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:07.053061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 557/1122] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:43:06 2022] GET /identity/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:07.058707 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c08359-d6c4-4ba7-89cf-6b0fc7183e20 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:07.151085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c08359-d6c4-4ba7-89cf-6b0fc7183e20 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:07.182545 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17fa08-5fa2-4255-a5db-5dac8713ebc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:07.183406 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17fa08-5fa2-4255-a5db-5dac8713ebc2 None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:07.183713 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17fa08-5fa2-4255-a5db-5dac8713ebc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:07.183988 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17fa08-5fa2-4255-a5db-5dac8713ebc2 None admin] PATH_INFO: `/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f/users/656382fd8be648fa90451952a6b7305c/roles/2ca014d08f26466b980433e75e765505` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:07.186772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17fa08-5fa2-4255-a5db-5dac8713ebc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbe06d88a4de4c02986eb7d175c9e96f, user_id=656382fd8be648fa90451952a6b7305c, role_id=2ca014d08f26466b980433e75e765505)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:07.188214 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17fa08-5fa2-4255-a5db-5dac8713ebc2 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:07.257023 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 566/1123] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:43:07 2022] PUT /identity/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f/users/656382fd8be648fa90451952a6b7305c/roles/2ca014d08f26466b980433e75e765505 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:43:09.487756 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d750c-b431-48b3-966b-e7a817176bbd None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:09.488257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d750c-b431-48b3-966b-e7a817176bbd None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:09.488257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d750c-b431-48b3-966b-e7a817176bbd None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:09.489985 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 558/1124] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:43:09.495081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b580e-4086-4eaa-977d-54faa23f4ea3 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:09.495487 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b580e-4086-4eaa-977d-54faa23f4ea3 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:09.495670 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b580e-4086-4eaa-977d-54faa23f4ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:09.512525 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-b21b580e-4086-4eaa-977d-54faa23f4ea3 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:09.513903 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-b21b580e-4086-4eaa-977d-54faa23f4ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:09.576985 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 567/1125] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:43:09.600050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d750c-b431-48b3-966b-e7a817176bbd None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:09.693658 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d750c-b431-48b3-966b-e7a817176bbd None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:09.725037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631928f2-e480-4433-b111-988b9e2fc1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:09.725877 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631928f2-e480-4433-b111-988b9e2fc1af None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:09.726155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631928f2-e480-4433-b111-988b9e2fc1af None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:09.726428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631928f2-e480-4433-b111-988b9e2fc1af None admin] PATH_INFO: `/v3/roles/2ca014d08f26466b980433e75e765505` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:09.727896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631928f2-e480-4433-b111-988b9e2fc1af None admin] RBAC: Authorizing `identity:get_role(role_id=2ca014d08f26466b980433e75e765505)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:09.729253 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631928f2-e480-4433-b111-988b9e2fc1af None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:09.730571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 559/1126] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:43:09 2022] GET /identity/v3/roles/2ca014d08f26466b980433e75e765505 => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:09.736817 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b580e-4086-4eaa-977d-54faa23f4ea3 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:09.828113 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b580e-4086-4eaa-977d-54faa23f4ea3 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:09.861064 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08760f43-9013-4131-af0e-552b05c0dfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:09.861912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08760f43-9013-4131-af0e-552b05c0dfd2 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:09.862190 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08760f43-9013-4131-af0e-552b05c0dfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:09.862461 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08760f43-9013-4131-af0e-552b05c0dfd2 None admin] PATH_INFO: `/v3/users/656382fd8be648fa90451952a6b7305c` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:09.863651 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08760f43-9013-4131-af0e-552b05c0dfd2 None admin] RBAC: Authorizing `identity:get_user(user_id=656382fd8be648fa90451952a6b7305c)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:09.865082 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08760f43-9013-4131-af0e-552b05c0dfd2 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:09.866675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 568/1127] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:43:09 2022] GET /identity/v3/users/656382fd8be648fa90451952a6b7305c => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:09.872404 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631928f2-e480-4433-b111-988b9e2fc1af None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:09.964159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631928f2-e480-4433-b111-988b9e2fc1af None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:09.995386 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d267e-6e80-4856-9099-89318bd28012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:09.996050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d267e-6e80-4856-9099-89318bd28012 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:09.996330 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d267e-6e80-4856-9099-89318bd28012 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:09.996604 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d267e-6e80-4856-9099-89318bd28012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:10.063436 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d267e-6e80-4856-9099-89318bd28012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:10.064914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d267e-6e80-4856-9099-89318bd28012 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:10.158251 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 560/1128] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:43:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:43:10.163930 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08760f43-9013-4131-af0e-552b05c0dfd2 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:10.255213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08760f43-9013-4131-af0e-552b05c0dfd2 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:10.287240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f405dc0-0d46-4bc4-b2fc-49cbae6b7646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:10.288104 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f405dc0-0d46-4bc4-b2fc-49cbae6b7646 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:10.288382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f405dc0-0d46-4bc4-b2fc-49cbae6b7646 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:10.288654 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f405dc0-0d46-4bc4-b2fc-49cbae6b7646 None admin] PATH_INFO: `/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:10.289799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f405dc0-0d46-4bc4-b2fc-49cbae6b7646 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe06d88a4de4c02986eb7d175c9e96f)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:10.291223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f405dc0-0d46-4bc4-b2fc-49cbae6b7646 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:10.292906 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 569/1129] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:43:10 2022] GET /identity/v3/projects/cbe06d88a4de4c02986eb7d175c9e96f => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:10.299272 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d267e-6e80-4856-9099-89318bd28012 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:10.391175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d267e-6e80-4856-9099-89318bd28012 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:10.422519 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaff8f7-3ece-4251-be6c-4bb31a0342d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:10.423105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaff8f7-3ece-4251-be6c-4bb31a0342d5 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:10.423388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaff8f7-3ece-4251-be6c-4bb31a0342d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:10.423690 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaff8f7-3ece-4251-be6c-4bb31a0342d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:10.424498 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaff8f7-3ece-4251-be6c-4bb31a0342d5 None admin] RBAC: Adding query filter params (role.id=2ca014d08f26466b980433e75e765505, scope.project.id=cbe06d88a4de4c02986eb7d175c9e96f, user.id=656382fd8be648fa90451952a6b7305c) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:43:10.424806 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaff8f7-3ece-4251-be6c-4bb31a0342d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:10.426216 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaff8f7-3ece-4251-be6c-4bb31a0342d5 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:10.431672 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 561/1130] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:43:10 2022] GET /identity/v3/role_assignments?user.id=656382fd8be648fa90451952a6b7305c&scope.project.id=cbe06d88a4de4c02986eb7d175c9e96f&role.id=2ca014d08f26466b980433e75e765505 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:12.693356 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1c0f4-52b9-4749-9d10-cda5ea6246e0 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:12.693891 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1c0f4-52b9-4749-9d10-cda5ea6246e0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:12.693891 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1c0f4-52b9-4749-9d10-cda5ea6246e0 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:12.695705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 570/1131] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:43:12.700955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099835c-a0e3-4ea0-a04c-3e06f19f4d4c None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:12.701357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099835c-a0e3-4ea0-a04c-3e06f19f4d4c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:12.701505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099835c-a0e3-4ea0-a04c-3e06f19f4d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:12.718522 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-f099835c-a0e3-4ea0-a04c-3e06f19f4d4c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:12.719740 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f099835c-a0e3-4ea0-a04c-3e06f19f4d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:12.782799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 562/1132] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:43:12.805878 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1c0f4-52b9-4749-9d10-cda5ea6246e0 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:12.900085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1c0f4-52b9-4749-9d10-cda5ea6246e0 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:12.932180 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f45461-9371-4afd-b745-e467980f95c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:12.932948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f45461-9371-4afd-b745-e467980f95c2 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:12.933230 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f45461-9371-4afd-b745-e467980f95c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:12.933505 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f45461-9371-4afd-b745-e467980f95c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:12.934659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f45461-9371-4afd-b745-e467980f95c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:12.936168 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f45461-9371-4afd-b745-e467980f95c2 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:12.937760 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 571/1133] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:43:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:12.943514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099835c-a0e3-4ea0-a04c-3e06f19f4d4c None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:13.036223 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099835c-a0e3-4ea0-a04c-3e06f19f4d4c None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:13.067661 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1219b-ddf5-4416-9303-2dc03da0c6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:13.068324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1219b-ddf5-4416-9303-2dc03da0c6f5 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:13.068605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1219b-ddf5-4416-9303-2dc03da0c6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:13.068879 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1219b-ddf5-4416-9303-2dc03da0c6f5 None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:13.069593 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1219b-ddf5-4416-9303-2dc03da0c6f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:13.071023 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1219b-ddf5-4416-9303-2dc03da0c6f5 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:13.164989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 563/1134] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 11:43:12 2022] POST /identity/v3/projects => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 11:43:15.491714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39ae73-9a4e-42af-be27-6a7b6d7dadb8 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:15.492215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39ae73-9a4e-42af-be27-6a7b6d7dadb8 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:15.492215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39ae73-9a4e-42af-be27-6a7b6d7dadb8 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:15.493990 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 572/1135] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:43:15.499177 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4103a4a-2712-4fc8-9b85-d7f82876436c None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:15.499613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4103a4a-2712-4fc8-9b85-d7f82876436c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:15.499764 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4103a4a-2712-4fc8-9b85-d7f82876436c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:15.516667 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-a4103a4a-2712-4fc8-9b85-d7f82876436c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:15.517849 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a4103a4a-2712-4fc8-9b85-d7f82876436c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:15.581388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 564/1136] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:43:15.605859 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39ae73-9a4e-42af-be27-6a7b6d7dadb8 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:15.702163 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39ae73-9a4e-42af-be27-6a7b6d7dadb8 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:15.733669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17b045-82b8-4288-8825-8b3d9135d2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:15.734434 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17b045-82b8-4288-8825-8b3d9135d2c9 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:15.734714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17b045-82b8-4288-8825-8b3d9135d2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:15.734988 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17b045-82b8-4288-8825-8b3d9135d2c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:15.736171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17b045-82b8-4288-8825-8b3d9135d2c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:15.737596 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17b045-82b8-4288-8825-8b3d9135d2c9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:15.739179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 573/1137] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:43:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:15.744954 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4103a4a-2712-4fc8-9b85-d7f82876436c None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:15.838201 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4103a4a-2712-4fc8-9b85-d7f82876436c None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:15.870588 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d2487-04ac-49a5-8540-be9cde3f6019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:15.871247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d2487-04ac-49a5-8540-be9cde3f6019 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:15.871566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d2487-04ac-49a5-8540-be9cde3f6019 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:15.871852 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d2487-04ac-49a5-8540-be9cde3f6019 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:15.873188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d2487-04ac-49a5-8540-be9cde3f6019 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:15.874631 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d2487-04ac-49a5-8540-be9cde3f6019 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:15.970829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 565/1138] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:43:15 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:43:18.300590 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2f2d6-0544-411d-9175-5cf1caacbc63 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:18.301104 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2f2d6-0544-411d-9175-5cf1caacbc63 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:18.301192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2f2d6-0544-411d-9175-5cf1caacbc63 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:18.302917 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 574/1139] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:43:18.308028 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c10d86-b0a7-496f-b2ac-c0376ce93682 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:18.308436 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c10d86-b0a7-496f-b2ac-c0376ce93682 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:18.308579 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c10d86-b0a7-496f-b2ac-c0376ce93682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:18.324796 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-c6c10d86-b0a7-496f-b2ac-c0376ce93682 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:18.326474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c6c10d86-b0a7-496f-b2ac-c0376ce93682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:18.388256 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 566/1140] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:43:18.412142 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2f2d6-0544-411d-9175-5cf1caacbc63 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:18.505700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2f2d6-0544-411d-9175-5cf1caacbc63 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:18.538150 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c57c2-44de-41f5-a79c-e70e81d26d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:18.538923 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c57c2-44de-41f5-a79c-e70e81d26d20 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:18.539204 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c57c2-44de-41f5-a79c-e70e81d26d20 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:18.539482 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c57c2-44de-41f5-a79c-e70e81d26d20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:18.549106 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c57c2-44de-41f5-a79c-e70e81d26d20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:43:18.555871 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-178c57c2-44de-41f5-a79c-e70e81d26d20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:43:18.557019 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 575/1141] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:43:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:43:18.564507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c10d86-b0a7-496f-b2ac-c0376ce93682 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:18.657046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c10d86-b0a7-496f-b2ac-c0376ce93682 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:18.688716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac18b3-cf79-45c8-aa69-f3d33c3a4ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:18.689381 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac18b3-cf79-45c8-aa69-f3d33c3a4ccd None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:18.689660 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac18b3-cf79-45c8-aa69-f3d33c3a4ccd None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:18.689933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac18b3-cf79-45c8-aa69-f3d33c3a4ccd None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:18.690667 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac18b3-cf79-45c8-aa69-f3d33c3a4ccd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:43:18.690973 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac18b3-cf79-45c8-aa69-f3d33c3a4ccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:18.692359 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac18b3-cf79-45c8-aa69-f3d33c3a4ccd None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:18.700556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 567/1142] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:43:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:18.706073 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c57c2-44de-41f5-a79c-e70e81d26d20 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:18.801265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c57c2-44de-41f5-a79c-e70e81d26d20 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:18.838508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db94cd6-478e-41e0-9cbb-9d974962cba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:18.839368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db94cd6-478e-41e0-9cbb-9d974962cba3 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:18.839679 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db94cd6-478e-41e0-9cbb-9d974962cba3 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:18.839958 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db94cd6-478e-41e0-9cbb-9d974962cba3 None admin] PATH_INFO: `/v3/users/c823d853d34b4504834a5d1a8d904268` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:18.852496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db94cd6-478e-41e0-9cbb-9d974962cba3 None admin] RBAC: Authorizing `identity:get_user(user_id=c823d853d34b4504834a5d1a8d904268)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:18.853936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db94cd6-478e-41e0-9cbb-9d974962cba3 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:18.855582 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 576/1143] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:43:18 2022] GET /identity/v3/users/c823d853d34b4504834a5d1a8d904268 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:18.861589 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac18b3-cf79-45c8-aa69-f3d33c3a4ccd None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:18.955299 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac18b3-cf79-45c8-aa69-f3d33c3a4ccd None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:18.986962 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed4a07-0240-429c-a4fc-42673d60b265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:18.987644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed4a07-0240-429c-a4fc-42673d60b265 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:18.987927 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed4a07-0240-429c-a4fc-42673d60b265 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:18.988202 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed4a07-0240-429c-a4fc-42673d60b265 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:19.051733 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed4a07-0240-429c-a4fc-42673d60b265 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:19.053120 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed4a07-0240-429c-a4fc-42673d60b265 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:19.150854 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 568/1144] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:43:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:43:19.157493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db94cd6-478e-41e0-9cbb-9d974962cba3 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:19.249189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db94cd6-478e-41e0-9cbb-9d974962cba3 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:19.281234 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c0938-5c89-4e0f-ad16-5e98b59ac209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:19.282075 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c0938-5c89-4e0f-ad16-5e98b59ac209 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:19.282352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c0938-5c89-4e0f-ad16-5e98b59ac209 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:19.282624 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c0938-5c89-4e0f-ad16-5e98b59ac209 None admin] PATH_INFO: `/v3/projects/d8cbf71097c44791aea82a25a5691156` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:19.283796 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c0938-5c89-4e0f-ad16-5e98b59ac209 None admin] RBAC: Authorizing `identity:get_project(project_id=d8cbf71097c44791aea82a25a5691156)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:19.285211 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c0938-5c89-4e0f-ad16-5e98b59ac209 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:19.286863 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 577/1145] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:43:19 2022] GET /identity/v3/projects/d8cbf71097c44791aea82a25a5691156 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:19.292865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed4a07-0240-429c-a4fc-42673d60b265 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:19.384691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed4a07-0240-429c-a4fc-42673d60b265 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:19.430079 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8eaef4-245c-4de5-91d2-4687fd0f895b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:19.430739 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eaef4-245c-4de5-91d2-4687fd0f895b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:19.431022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eaef4-245c-4de5-91d2-4687fd0f895b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:19.431298 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eaef4-245c-4de5-91d2-4687fd0f895b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:19.432146 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8eaef4-245c-4de5-91d2-4687fd0f895b None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=d8cbf71097c44791aea82a25a5691156, user.id=c823d853d34b4504834a5d1a8d904268) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:43:19.432458 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8eaef4-245c-4de5-91d2-4687fd0f895b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:19.433914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8eaef4-245c-4de5-91d2-4687fd0f895b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:19.439815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 569/1146] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:43:19 2022] GET /identity/v3/role_assignments?user.id=c823d853d34b4504834a5d1a8d904268&scope.project.id=d8cbf71097c44791aea82a25a5691156&role.id=c2642d38bc964424a5edc330e0d4471d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:21.703007 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e0a59-eef7-4aa4-9391-787f96715bc5 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:21.703576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e0a59-eef7-4aa4-9391-787f96715bc5 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:21.703576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e0a59-eef7-4aa4-9391-787f96715bc5 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:21.705384 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 578/1147] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:43:21.710559 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383597eb-034a-41c5-ac98-cf228496ddaa None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:21.711054 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383597eb-034a-41c5-ac98-cf228496ddaa None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:21.711154 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383597eb-034a-41c5-ac98-cf228496ddaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:21.728919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-383597eb-034a-41c5-ac98-cf228496ddaa None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:21.730096 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-383597eb-034a-41c5-ac98-cf228496ddaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:21.792577 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 570/1148] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:43:21.815431 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e0a59-eef7-4aa4-9391-787f96715bc5 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:21.909978 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e0a59-eef7-4aa4-9391-787f96715bc5 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:21.941541 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9459f-edfc-4452-81d9-cf698157852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:21.942306 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9459f-edfc-4452-81d9-cf698157852e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:21.942586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9459f-edfc-4452-81d9-cf698157852e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:21.942862 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9459f-edfc-4452-81d9-cf698157852e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:21.953064 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9459f-edfc-4452-81d9-cf698157852e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:43:21.959790 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-9be9459f-edfc-4452-81d9-cf698157852e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:43:21.960950 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 579/1149] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:43:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:43:21.967359 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383597eb-034a-41c5-ac98-cf228496ddaa None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:22.062392 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383597eb-034a-41c5-ac98-cf228496ddaa None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:22.094725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67c760-7db1-476b-a62b-9d746c30d726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:22.095392 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67c760-7db1-476b-a62b-9d746c30d726 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:22.095704 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67c760-7db1-476b-a62b-9d746c30d726 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:22.095985 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67c760-7db1-476b-a62b-9d746c30d726 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:22.096723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67c760-7db1-476b-a62b-9d746c30d726 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:43:22.097032 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67c760-7db1-476b-a62b-9d746c30d726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:22.098390 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67c760-7db1-476b-a62b-9d746c30d726 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:22.105983 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 571/1150] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:43:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:43:22.111738 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9459f-edfc-4452-81d9-cf698157852e None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:22.205445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9459f-edfc-4452-81d9-cf698157852e None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:22.237768 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c96777-4636-4c45-90a2-1da347ffb059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:22.238622 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c96777-4636-4c45-90a2-1da347ffb059 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:22.238903 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c96777-4636-4c45-90a2-1da347ffb059 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:22.239175 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c96777-4636-4c45-90a2-1da347ffb059 None admin] PATH_INFO: `/v3/users/c823d853d34b4504834a5d1a8d904268` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:22.240370 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c96777-4636-4c45-90a2-1da347ffb059 None admin] RBAC: Authorizing `identity:get_user(user_id=c823d853d34b4504834a5d1a8d904268)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:22.241791 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c96777-4636-4c45-90a2-1da347ffb059 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:22.243388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 580/1151] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:43:22 2022] GET /identity/v3/users/c823d853d34b4504834a5d1a8d904268 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:22.249344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67c760-7db1-476b-a62b-9d746c30d726 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:22.341921 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67c760-7db1-476b-a62b-9d746c30d726 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:22.372669 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ccefb-5528-45dc-9997-5cfd4512ad32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:22.373506 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ccefb-5528-45dc-9997-5cfd4512ad32 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:22.373784 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ccefb-5528-45dc-9997-5cfd4512ad32 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:22.374055 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ccefb-5528-45dc-9997-5cfd4512ad32 None admin] PATH_INFO: `/v3/projects/d8cbf71097c44791aea82a25a5691156` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:22.375201 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ccefb-5528-45dc-9997-5cfd4512ad32 None admin] RBAC: Authorizing `identity:get_project(project_id=d8cbf71097c44791aea82a25a5691156)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:22.376637 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ccefb-5528-45dc-9997-5cfd4512ad32 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:22.378269 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 572/1152] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:43:22 2022] GET /identity/v3/projects/d8cbf71097c44791aea82a25a5691156 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:22.384139 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c96777-4636-4c45-90a2-1da347ffb059 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:22.477186 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c96777-4636-4c45-90a2-1da347ffb059 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:22.508451 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b21c-58e5-4e85-9cd7-fe6902ee2888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:22.509322 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b21c-58e5-4e85-9cd7-fe6902ee2888 None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:22.509604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b21c-58e5-4e85-9cd7-fe6902ee2888 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:22.509879 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b21c-58e5-4e85-9cd7-fe6902ee2888 None admin] PATH_INFO: `/v3/projects/d8cbf71097c44791aea82a25a5691156/users/c823d853d34b4504834a5d1a8d904268/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:22.511818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055b21c-58e5-4e85-9cd7-fe6902ee2888 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8cbf71097c44791aea82a25a5691156, user_id=c823d853d34b4504834a5d1a8d904268, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:22.513466 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055b21c-58e5-4e85-9cd7-fe6902ee2888 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:22.604088 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 581/1153] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:43:22 2022] PUT /identity/v3/projects/d8cbf71097c44791aea82a25a5691156/users/c823d853d34b4504834a5d1a8d904268/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:43:24.883342 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cbaaf-5a83-46cb-8d64-b706f669e0c8 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:24.883923 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cbaaf-5a83-46cb-8d64-b706f669e0c8 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:24.883923 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cbaaf-5a83-46cb-8d64-b706f669e0c8 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:24.885748 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 573/1154] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:43:24.891137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ec3c-f7e6-4e6c-8df6-1e2c14022e3f None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:24.891554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ec3c-f7e6-4e6c-8df6-1e2c14022e3f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:24.891721 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ec3c-f7e6-4e6c-8df6-1e2c14022e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:24.908681 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-f3d5ec3c-f7e6-4e6c-8df6-1e2c14022e3f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:24.909855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f3d5ec3c-f7e6-4e6c-8df6-1e2c14022e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:24.971930 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 582/1155] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:43:24.994843 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cbaaf-5a83-46cb-8d64-b706f669e0c8 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:25.101497 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cbaaf-5a83-46cb-8d64-b706f669e0c8 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:25.132830 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacde98-140f-4978-b919-0d3f123c6170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:25.133665 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacde98-140f-4978-b919-0d3f123c6170 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:25.133898 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacde98-140f-4978-b919-0d3f123c6170 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:25.134172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacde98-140f-4978-b919-0d3f123c6170 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:25.145174 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacde98-140f-4978-b919-0d3f123c6170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:43:25.152019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-5bacde98-140f-4978-b919-0d3f123c6170 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:43:25.153834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 574/1156] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:43:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:43:25.160033 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ec3c-f7e6-4e6c-8df6-1e2c14022e3f None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:25.255976 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ec3c-f7e6-4e6c-8df6-1e2c14022e3f None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:25.292866 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c486c-a05e-4210-b14a-c6bd66156fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:25.293681 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c486c-a05e-4210-b14a-c6bd66156fd3 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:25.293975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c486c-a05e-4210-b14a-c6bd66156fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:25.294254 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c486c-a05e-4210-b14a-c6bd66156fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:25.294991 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c486c-a05e-4210-b14a-c6bd66156fd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:43:25.295302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c486c-a05e-4210-b14a-c6bd66156fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:25.296715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c486c-a05e-4210-b14a-c6bd66156fd3 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:25.304646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 583/1157] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:43:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:25.310585 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacde98-140f-4978-b919-0d3f123c6170 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:25.407829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacde98-140f-4978-b919-0d3f123c6170 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:25.439188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66acc59-331e-4c83-9abe-1e9fbb302f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:25.440069 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66acc59-331e-4c83-9abe-1e9fbb302f1c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:25.440347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66acc59-331e-4c83-9abe-1e9fbb302f1c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:25.440617 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66acc59-331e-4c83-9abe-1e9fbb302f1c None admin] PATH_INFO: `/v3/users/c823d853d34b4504834a5d1a8d904268` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:25.441776 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66acc59-331e-4c83-9abe-1e9fbb302f1c None admin] RBAC: Authorizing `identity:get_user(user_id=c823d853d34b4504834a5d1a8d904268)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:25.443205 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66acc59-331e-4c83-9abe-1e9fbb302f1c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:25.444866 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 575/1158] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:43:25 2022] GET /identity/v3/users/c823d853d34b4504834a5d1a8d904268 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:25.451708 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c486c-a05e-4210-b14a-c6bd66156fd3 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:25.544568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c486c-a05e-4210-b14a-c6bd66156fd3 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:25.575847 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f6452-3a92-4c26-9b6b-f7b0b91322b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:25.576470 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f6452-3a92-4c26-9b6b-f7b0b91322b2 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:25.576749 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f6452-3a92-4c26-9b6b-f7b0b91322b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:25.577019 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f6452-3a92-4c26-9b6b-f7b0b91322b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:25.639395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f6452-3a92-4c26-9b6b-f7b0b91322b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:25.640873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f6452-3a92-4c26-9b6b-f7b0b91322b2 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:25.732156 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 584/1159] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:43:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:43:25.737974 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66acc59-331e-4c83-9abe-1e9fbb302f1c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:25.830926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66acc59-331e-4c83-9abe-1e9fbb302f1c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:25.865888 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6f888-50ab-4c62-9383-f8a3cd5ea132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:25.866821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6f888-50ab-4c62-9383-f8a3cd5ea132 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:25.867098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6f888-50ab-4c62-9383-f8a3cd5ea132 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:25.867367 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6f888-50ab-4c62-9383-f8a3cd5ea132 None admin] PATH_INFO: `/v3/projects/d8cbf71097c44791aea82a25a5691156` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:25.868578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6f888-50ab-4c62-9383-f8a3cd5ea132 None admin] RBAC: Authorizing `identity:get_project(project_id=d8cbf71097c44791aea82a25a5691156)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:25.870147 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6f888-50ab-4c62-9383-f8a3cd5ea132 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:25.872837 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 576/1160] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:43:25 2022] GET /identity/v3/projects/d8cbf71097c44791aea82a25a5691156 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:25.878941 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f6452-3a92-4c26-9b6b-f7b0b91322b2 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:25.985985 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f6452-3a92-4c26-9b6b-f7b0b91322b2 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:26.018246 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5290d3-a1a5-453d-be97-7121a3b7e007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:26.019157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5290d3-a1a5-453d-be97-7121a3b7e007 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:26.019438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5290d3-a1a5-453d-be97-7121a3b7e007 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:26.019742 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5290d3-a1a5-453d-be97-7121a3b7e007 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:26.020554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5290d3-a1a5-453d-be97-7121a3b7e007 None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=d8cbf71097c44791aea82a25a5691156, user.id=c823d853d34b4504834a5d1a8d904268) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:43:26.020865 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5290d3-a1a5-453d-be97-7121a3b7e007 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:26.022296 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5290d3-a1a5-453d-be97-7121a3b7e007 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:26.028096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 585/1161] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:43:25 2022] GET /identity/v3/role_assignments?user.id=c823d853d34b4504834a5d1a8d904268&scope.project.id=d8cbf71097c44791aea82a25a5691156&role.id=c2642d38bc964424a5edc330e0d4471d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:28.378950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c4813-f619-4f5b-85f8-3a083bce0e43 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:28.379502 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c4813-f619-4f5b-85f8-3a083bce0e43 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:28.379502 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c4813-f619-4f5b-85f8-3a083bce0e43 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:28.381337 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 577/1162] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:43:28.387405 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120f7bf-5344-47e5-8c27-62a5732265f0 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:28.387904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120f7bf-5344-47e5-8c27-62a5732265f0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:28.388012 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120f7bf-5344-47e5-8c27-62a5732265f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:28.404427 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-2120f7bf-5344-47e5-8c27-62a5732265f0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:28.405602 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-2120f7bf-5344-47e5-8c27-62a5732265f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:28.468470 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 586/1163] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:43:28.491498 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c4813-f619-4f5b-85f8-3a083bce0e43 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:28.586420 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c4813-f619-4f5b-85f8-3a083bce0e43 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:28.619262 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaae95b-db75-4d4c-a116-d67fcce5f206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:28.619926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaae95b-db75-4d4c-a116-d67fcce5f206 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:28.620208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaae95b-db75-4d4c-a116-d67fcce5f206 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:28.620479 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaae95b-db75-4d4c-a116-d67fcce5f206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:28.683561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaae95b-db75-4d4c-a116-d67fcce5f206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:28.685039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaae95b-db75-4d4c-a116-d67fcce5f206 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:28.777836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 578/1164] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:43:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:43:28.783593 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120f7bf-5344-47e5-8c27-62a5732265f0 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:28.896886 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120f7bf-5344-47e5-8c27-62a5732265f0 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:28.928922 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923c6e9-1707-4b03-b0ef-4cc1a8438528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:28.929732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923c6e9-1707-4b03-b0ef-4cc1a8438528 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:28.930011 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923c6e9-1707-4b03-b0ef-4cc1a8438528 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:28.930283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923c6e9-1707-4b03-b0ef-4cc1a8438528 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:28.936675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923c6e9-1707-4b03-b0ef-4cc1a8438528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:28.938106 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923c6e9-1707-4b03-b0ef-4cc1a8438528 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:28.951265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-a923c6e9-1707-4b03-b0ef-4cc1a8438528 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 08 11:43:28.952434 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 587/1165] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 11:43:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:43:28.958478 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaae95b-db75-4d4c-a116-d67fcce5f206 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:29.050379 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaae95b-db75-4d4c-a116-d67fcce5f206 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:29.081776 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8c445-d1be-4895-b073-7ac368d00a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:29.082422 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8c445-d1be-4895-b073-7ac368d00a94 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:29.082701 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8c445-d1be-4895-b073-7ac368d00a94 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:29.082972 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8c445-d1be-4895-b073-7ac368d00a94 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:29.083703 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8c445-d1be-4895-b073-7ac368d00a94 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:43:29.084006 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8c445-d1be-4895-b073-7ac368d00a94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:29.085356 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8c445-d1be-4895-b073-7ac368d00a94 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:29.092850 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 579/1166] 10.222.0.52 () {56 vars in 1115 bytes} [Tue Mar 8 11:43:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:31.364123 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a1dc5-18a6-4562-aa77-e0925328749e None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:31.364710 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a1dc5-18a6-4562-aa77-e0925328749e None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:31.364710 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a1dc5-18a6-4562-aa77-e0925328749e None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:31.366506 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 588/1167] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:43:31.372150 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60420900-7c7a-444d-bdc4-ca4ad43025e9 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:31.372603 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60420900-7c7a-444d-bdc4-ca4ad43025e9 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:31.372692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60420900-7c7a-444d-bdc4-ca4ad43025e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:31.390436 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-60420900-7c7a-444d-bdc4-ca4ad43025e9 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:31.391762 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-60420900-7c7a-444d-bdc4-ca4ad43025e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:31.460622 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 580/1168] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:43:31.485739 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a1dc5-18a6-4562-aa77-e0925328749e None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:31.593885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a1dc5-18a6-4562-aa77-e0925328749e None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:31.632738 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1935325-d9c6-40fd-b307-bac6ac9bfde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:31.633511 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1935325-d9c6-40fd-b307-bac6ac9bfde2 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:31.633791 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1935325-d9c6-40fd-b307-bac6ac9bfde2 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:31.634062 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1935325-d9c6-40fd-b307-bac6ac9bfde2 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:31.634806 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1935325-d9c6-40fd-b307-bac6ac9bfde2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:31.636714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1935325-d9c6-40fd-b307-bac6ac9bfde2 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:31.719994 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 589/1169] 10.222.0.52 () {60 vars in 1138 bytes} [Tue Mar 8 11:43:31 2022] POST /identity/v3/domains => generated 267 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:43:34.127074 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00d693-960c-4eed-a0c3-8719f4a10030 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:34.127654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00d693-960c-4eed-a0c3-8719f4a10030 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:34.127654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00d693-960c-4eed-a0c3-8719f4a10030 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:34.129414 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 581/1170] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:43:34.134694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4dc7-3468-479c-a6f6-11e532209b57 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:34.135108 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4dc7-3468-479c-a6f6-11e532209b57 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:34.135244 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4dc7-3468-479c-a6f6-11e532209b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:34.152173 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-e02e4dc7-3468-479c-a6f6-11e532209b57 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:34.153291 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-e02e4dc7-3468-479c-a6f6-11e532209b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:34.219816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 590/1171] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:43:34.243385 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00d693-960c-4eed-a0c3-8719f4a10030 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:34.337744 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00d693-960c-4eed-a0c3-8719f4a10030 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:34.370318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2d0d1-f803-403a-8dd0-d83d47e4a04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:34.371344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2d0d1-f803-403a-8dd0-d83d47e4a04d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:34.371672 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2d0d1-f803-403a-8dd0-d83d47e4a04d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:34.371951 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2d0d1-f803-403a-8dd0-d83d47e4a04d None admin] PATH_INFO: `/v3/domains/044e6d5c580f4bd6a3dd08a990e5bc59` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:34.381903 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2d0d1-f803-403a-8dd0-d83d47e4a04d None admin] RBAC: Authorizing `identity:get_domain(domain_id=044e6d5c580f4bd6a3dd08a990e5bc59)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:34.383310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2d0d1-f803-403a-8dd0-d83d47e4a04d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:34.384953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 582/1172] 10.222.0.52 () {56 vars in 1183 bytes} [Tue Mar 8 11:43:34 2022] GET /identity/v3/domains/044e6d5c580f4bd6a3dd08a990e5bc59 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:34.390889 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4dc7-3468-479c-a6f6-11e532209b57 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:34.485036 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4dc7-3468-479c-a6f6-11e532209b57 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:34.525877 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22d8fa-f191-4508-b643-c3c970a382c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:34.526550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22d8fa-f191-4508-b643-c3c970a382c0 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:34.527386 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22d8fa-f191-4508-b643-c3c970a382c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:34.527701 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22d8fa-f191-4508-b643-c3c970a382c0 None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:34.528609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22d8fa-f191-4508-b643-c3c970a382c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:34.530052 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22d8fa-f191-4508-b643-c3c970a382c0 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:34.633958 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 591/1173] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 11:43:34 2022] POST /identity/v3/projects => generated 361 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 11:43:36.996485 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5c585-3ea4-4490-a574-9f809b8c4e5f None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:36.997040 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5c585-3ea4-4490-a574-9f809b8c4e5f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:36.997040 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5c585-3ea4-4490-a574-9f809b8c4e5f None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:36.998793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 583/1174] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:43:37.003899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdac022-f83b-47dd-9844-73b792abe652 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:37.004320 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdac022-f83b-47dd-9844-73b792abe652 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:37.004461 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdac022-f83b-47dd-9844-73b792abe652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:37.021676 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-6bdac022-f83b-47dd-9844-73b792abe652 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:37.022862 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-6bdac022-f83b-47dd-9844-73b792abe652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:37.094630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 592/1175] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:43:37.119779 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5c585-3ea4-4490-a574-9f809b8c4e5f None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:37.343464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5c585-3ea4-4490-a574-9f809b8c4e5f None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:37.375006 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a984002-d99c-47a2-a10d-680c387f008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:37.375879 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a984002-d99c-47a2-a10d-680c387f008a None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:37.376158 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a984002-d99c-47a2-a10d-680c387f008a None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:37.376431 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a984002-d99c-47a2-a10d-680c387f008a None admin] PATH_INFO: `/v3/domains/044e6d5c580f4bd6a3dd08a990e5bc59` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:37.377595 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a984002-d99c-47a2-a10d-680c387f008a None admin] RBAC: Authorizing `identity:get_domain(domain_id=044e6d5c580f4bd6a3dd08a990e5bc59)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:37.378991 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a984002-d99c-47a2-a10d-680c387f008a None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:37.380869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 584/1176] 10.222.0.52 () {56 vars in 1183 bytes} [Tue Mar 8 11:43:37 2022] GET /identity/v3/domains/044e6d5c580f4bd6a3dd08a990e5bc59 => generated 267 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:37.386960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdac022-f83b-47dd-9844-73b792abe652 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:37.478289 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdac022-f83b-47dd-9844-73b792abe652 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:37.509819 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9213f-77cd-4f9d-a342-42f8f1ba4b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:37.510468 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9213f-77cd-4f9d-a342-42f8f1ba4b71 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:37.510806 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9213f-77cd-4f9d-a342-42f8f1ba4b71 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:37.511596 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9213f-77cd-4f9d-a342-42f8f1ba4b71 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:37.512307 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9213f-77cd-4f9d-a342-42f8f1ba4b71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:37.513743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9213f-77cd-4f9d-a342-42f8f1ba4b71 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:37.609044 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 593/1177] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:43:37 2022] POST /identity/v3/users => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:43:39.902955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deeb721-5936-45fe-8865-42cac6b82605 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:39.903482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deeb721-5936-45fe-8865-42cac6b82605 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:39.903482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deeb721-5936-45fe-8865-42cac6b82605 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:39.905273 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 585/1178] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:43:39.910490 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa65fbb-ba36-458c-b73e-d5ce7a398eea None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:39.910862 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa65fbb-ba36-458c-b73e-d5ce7a398eea None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:39.911043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa65fbb-ba36-458c-b73e-d5ce7a398eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:39.927785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-efa65fbb-ba36-458c-b73e-d5ce7a398eea None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:39.928954 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-efa65fbb-ba36-458c-b73e-d5ce7a398eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:39.990105 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 594/1179] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:43:40.013482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deeb721-5936-45fe-8865-42cac6b82605 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:40.107852 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deeb721-5936-45fe-8865-42cac6b82605 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:40.139799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a826647-b96c-4793-a9c3-c142c2ff68ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:40.140586 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a826647-b96c-4793-a9c3-c142c2ff68ac None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:40.140865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a826647-b96c-4793-a9c3-c142c2ff68ac None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:40.141138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a826647-b96c-4793-a9c3-c142c2ff68ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:40.151001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a826647-b96c-4793-a9c3-c142c2ff68ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:43:40.158443 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-3a826647-b96c-4793-a9c3-c142c2ff68ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:43:40.159571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 586/1180] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:43:40.165845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa65fbb-ba36-458c-b73e-d5ce7a398eea None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:40.281083 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa65fbb-ba36-458c-b73e-d5ce7a398eea None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:40.312739 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda43019-e948-4edb-903b-5bb6408d1c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:40.313397 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda43019-e948-4edb-903b-5bb6408d1c2a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:40.313680 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda43019-e948-4edb-903b-5bb6408d1c2a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:40.313956 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda43019-e948-4edb-903b-5bb6408d1c2a None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:40.314695 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda43019-e948-4edb-903b-5bb6408d1c2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:43:40.315005 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda43019-e948-4edb-903b-5bb6408d1c2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:40.316477 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda43019-e948-4edb-903b-5bb6408d1c2a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:40.324841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 595/1181] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:43:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:40.330593 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a826647-b96c-4793-a9c3-c142c2ff68ac None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:40.424242 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a826647-b96c-4793-a9c3-c142c2ff68ac None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:40.456192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29306fd-a8e7-49c7-85d8-ef4c76c7f476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:40.457043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29306fd-a8e7-49c7-85d8-ef4c76c7f476 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:40.457321 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29306fd-a8e7-49c7-85d8-ef4c76c7f476 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:40.457594 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29306fd-a8e7-49c7-85d8-ef4c76c7f476 None admin] PATH_INFO: `/v3/users/696b86bad4354b3fb6c5969fd061946b` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:40.469694 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29306fd-a8e7-49c7-85d8-ef4c76c7f476 None admin] RBAC: Authorizing `identity:get_user(user_id=696b86bad4354b3fb6c5969fd061946b)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:40.471130 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29306fd-a8e7-49c7-85d8-ef4c76c7f476 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:40.472766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 587/1182] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:43:40 2022] GET /identity/v3/users/696b86bad4354b3fb6c5969fd061946b => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:40.478419 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda43019-e948-4edb-903b-5bb6408d1c2a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:40.571276 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda43019-e948-4edb-903b-5bb6408d1c2a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:40.602468 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70965b5-6b5f-42e6-8e2c-3473cda049d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:40.603101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70965b5-6b5f-42e6-8e2c-3473cda049d3 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:40.603385 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70965b5-6b5f-42e6-8e2c-3473cda049d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:40.603690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70965b5-6b5f-42e6-8e2c-3473cda049d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:40.665897 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70965b5-6b5f-42e6-8e2c-3473cda049d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:40.667457 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70965b5-6b5f-42e6-8e2c-3473cda049d3 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:40.758628 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 596/1183] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:43:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:43:40.764686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29306fd-a8e7-49c7-85d8-ef4c76c7f476 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:40.856440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29306fd-a8e7-49c7-85d8-ef4c76c7f476 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:40.887608 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ed6ec-73bb-4d6c-bb71-2f2c896d8118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:40.888451 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ed6ec-73bb-4d6c-bb71-2f2c896d8118 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:40.888727 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ed6ec-73bb-4d6c-bb71-2f2c896d8118 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:40.888992 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ed6ec-73bb-4d6c-bb71-2f2c896d8118 None admin] PATH_INFO: `/v3/projects/df7bf8e19c93494999ca25dd9940e688` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:40.890150 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ed6ec-73bb-4d6c-bb71-2f2c896d8118 None admin] RBAC: Authorizing `identity:get_project(project_id=df7bf8e19c93494999ca25dd9940e688)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:40.891587 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ed6ec-73bb-4d6c-bb71-2f2c896d8118 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:40.893483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 588/1184] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:43:40 2022] GET /identity/v3/projects/df7bf8e19c93494999ca25dd9940e688 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:40.899298 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70965b5-6b5f-42e6-8e2c-3473cda049d3 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:40.989818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70965b5-6b5f-42e6-8e2c-3473cda049d3 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:41.021127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6a66f-2f8a-498c-bb10-5a03ec367615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:41.021694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6a66f-2f8a-498c-bb10-5a03ec367615 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:41.021969 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6a66f-2f8a-498c-bb10-5a03ec367615 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:41.022240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6a66f-2f8a-498c-bb10-5a03ec367615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:41.023043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6a66f-2f8a-498c-bb10-5a03ec367615 None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=df7bf8e19c93494999ca25dd9940e688, user.id=696b86bad4354b3fb6c5969fd061946b) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:43:41.023352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6a66f-2f8a-498c-bb10-5a03ec367615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:41.024795 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6a66f-2f8a-498c-bb10-5a03ec367615 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:41.029863 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 597/1185] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:43:40 2022] GET /identity/v3/role_assignments?user.id=696b86bad4354b3fb6c5969fd061946b&scope.project.id=df7bf8e19c93494999ca25dd9940e688&role.id=c2642d38bc964424a5edc330e0d4471d => generated 259 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:43.293257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c40b0-75b4-4d51-a490-2904458d91f9 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:43.293777 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c40b0-75b4-4d51-a490-2904458d91f9 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:43.293862 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c40b0-75b4-4d51-a490-2904458d91f9 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:43.295597 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 589/1186] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:43:43.300642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188d7a6-1659-43ca-a3dc-5f854193b59c None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:43.301056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188d7a6-1659-43ca-a3dc-5f854193b59c None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:43.301205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188d7a6-1659-43ca-a3dc-5f854193b59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:43.317280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-b188d7a6-1659-43ca-a3dc-5f854193b59c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:43.318443 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-b188d7a6-1659-43ca-a3dc-5f854193b59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:43.381313 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 598/1187] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:43:43.404524 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c40b0-75b4-4d51-a490-2904458d91f9 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:43.498384 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c40b0-75b4-4d51-a490-2904458d91f9 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:43.530452 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e636b-a0c6-4087-b3e2-3841d9036a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:43.531220 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e636b-a0c6-4087-b3e2-3841d9036a7b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:43.531495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e636b-a0c6-4087-b3e2-3841d9036a7b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:43.531796 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e636b-a0c6-4087-b3e2-3841d9036a7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:43.541106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e636b-a0c6-4087-b3e2-3841d9036a7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:43:43.547797 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-0d8e636b-a0c6-4087-b3e2-3841d9036a7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:43:43.548910 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 590/1188] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:43:43.554760 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188d7a6-1659-43ca-a3dc-5f854193b59c None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:43.647430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188d7a6-1659-43ca-a3dc-5f854193b59c None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:43.679367 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7f171-da7e-41ef-a003-537f119396b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:43.680051 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7f171-da7e-41ef-a003-537f119396b9 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:43.680334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7f171-da7e-41ef-a003-537f119396b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:43.680614 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7f171-da7e-41ef-a003-537f119396b9 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:43.681348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7f171-da7e-41ef-a003-537f119396b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:43:43.681658 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7f171-da7e-41ef-a003-537f119396b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:43.683578 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7f171-da7e-41ef-a003-537f119396b9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:43.691378 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 599/1189] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:43.696897 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e636b-a0c6-4087-b3e2-3841d9036a7b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:43.789235 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e636b-a0c6-4087-b3e2-3841d9036a7b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:43.820619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cb76d-170d-48cd-ac4c-ba6a58062834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:43.821467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cb76d-170d-48cd-ac4c-ba6a58062834 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:43.821742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cb76d-170d-48cd-ac4c-ba6a58062834 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:43.822012 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cb76d-170d-48cd-ac4c-ba6a58062834 None admin] PATH_INFO: `/v3/users/696b86bad4354b3fb6c5969fd061946b` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:43.823330 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1cb76d-170d-48cd-ac4c-ba6a58062834 None admin] RBAC: Authorizing `identity:get_user(user_id=696b86bad4354b3fb6c5969fd061946b)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:43.824772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1cb76d-170d-48cd-ac4c-ba6a58062834 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:43.826333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 591/1190] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:43:43 2022] GET /identity/v3/users/696b86bad4354b3fb6c5969fd061946b => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:43.831899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7f171-da7e-41ef-a003-537f119396b9 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:43.925445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7f171-da7e-41ef-a003-537f119396b9 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:43.956350 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14268767-e10d-4d01-b955-bcac6149a6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:43.957264 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14268767-e10d-4d01-b955-bcac6149a6a6 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:43.957551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14268767-e10d-4d01-b955-bcac6149a6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:43.957826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14268767-e10d-4d01-b955-bcac6149a6a6 None admin] PATH_INFO: `/v3/projects/df7bf8e19c93494999ca25dd9940e688` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:43.958979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14268767-e10d-4d01-b955-bcac6149a6a6 None admin] RBAC: Authorizing `identity:get_project(project_id=df7bf8e19c93494999ca25dd9940e688)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:43.960426 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14268767-e10d-4d01-b955-bcac6149a6a6 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:43.962078 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 600/1191] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:43:43 2022] GET /identity/v3/projects/df7bf8e19c93494999ca25dd9940e688 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:43.968216 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cb76d-170d-48cd-ac4c-ba6a58062834 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:44.062351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cb76d-170d-48cd-ac4c-ba6a58062834 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:44.093282 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17262760-a16f-414f-ad3e-e07ef1b7631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:44.094151 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17262760-a16f-414f-ad3e-e07ef1b7631e None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:44.094431 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17262760-a16f-414f-ad3e-e07ef1b7631e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:44.094704 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17262760-a16f-414f-ad3e-e07ef1b7631e None admin] PATH_INFO: `/v3/projects/df7bf8e19c93494999ca25dd9940e688/users/696b86bad4354b3fb6c5969fd061946b/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:44.096668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17262760-a16f-414f-ad3e-e07ef1b7631e None admin] RBAC: Authorizing `identity:create_grant(project_id=df7bf8e19c93494999ca25dd9940e688, user_id=696b86bad4354b3fb6c5969fd061946b, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:44.098084 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17262760-a16f-414f-ad3e-e07ef1b7631e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:44.203005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 592/1192] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:43:43 2022] PUT /identity/v3/projects/df7bf8e19c93494999ca25dd9940e688/users/696b86bad4354b3fb6c5969fd061946b/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:43:46.501824 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0f245-5f34-45bb-814f-caa9f77cda01 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:46.502326 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0f245-5f34-45bb-814f-caa9f77cda01 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:46.502326 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0f245-5f34-45bb-814f-caa9f77cda01 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:46.504131 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 601/1193] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:43:46.509271 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9989a5b-a018-4f14-bcdc-2c0d35261b5c None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:46.509667 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9989a5b-a018-4f14-bcdc-2c0d35261b5c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:46.509818 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9989a5b-a018-4f14-bcdc-2c0d35261b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:46.527078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-d9989a5b-a018-4f14-bcdc-2c0d35261b5c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:43:46.528275 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d9989a5b-a018-4f14-bcdc-2c0d35261b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:43:46.589555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 593/1194] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:43:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:43:46.612663 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0f245-5f34-45bb-814f-caa9f77cda01 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:46.708098 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0f245-5f34-45bb-814f-caa9f77cda01 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:46.739479 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5936b4-e7d3-4ba9-a372-c77ad4201bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:46.740339 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5936b4-e7d3-4ba9-a372-c77ad4201bdd None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:46.740616 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5936b4-e7d3-4ba9-a372-c77ad4201bdd None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:46.740889 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5936b4-e7d3-4ba9-a372-c77ad4201bdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:46.751393 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5936b4-e7d3-4ba9-a372-c77ad4201bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:43:46.758296 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-9e5936b4-e7d3-4ba9-a372-c77ad4201bdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:43:46.759393 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 602/1195] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:43:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:43:46.765684 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9989a5b-a018-4f14-bcdc-2c0d35261b5c None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:46.856866 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9989a5b-a018-4f14-bcdc-2c0d35261b5c None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:46.889141 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf58b2a-d58e-47af-bfee-7941f4ccb804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:46.890093 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf58b2a-d58e-47af-bfee-7941f4ccb804 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:46.890431 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf58b2a-d58e-47af-bfee-7941f4ccb804 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:46.890708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf58b2a-d58e-47af-bfee-7941f4ccb804 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:46.891561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf58b2a-d58e-47af-bfee-7941f4ccb804 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:43:46.892136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf58b2a-d58e-47af-bfee-7941f4ccb804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:46.893527 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf58b2a-d58e-47af-bfee-7941f4ccb804 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:46.903022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 594/1196] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:43:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 11:43:46.908662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5936b4-e7d3-4ba9-a372-c77ad4201bdd None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:47.001322 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5936b4-e7d3-4ba9-a372-c77ad4201bdd None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:47.032016 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ad576-e08e-4ac6-bbd4-6c13d5f8c326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:47.032798 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ad576-e08e-4ac6-bbd4-6c13d5f8c326 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:47.033075 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ad576-e08e-4ac6-bbd4-6c13d5f8c326 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:47.033346 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ad576-e08e-4ac6-bbd4-6c13d5f8c326 None admin] PATH_INFO: `/v3/users/696b86bad4354b3fb6c5969fd061946b` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:47.034501 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ad576-e08e-4ac6-bbd4-6c13d5f8c326 None admin] RBAC: Authorizing `identity:get_user(user_id=696b86bad4354b3fb6c5969fd061946b)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:47.035950 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ad576-e08e-4ac6-bbd4-6c13d5f8c326 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:47.037535 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 603/1197] 10.222.0.52 () {56 vars in 1177 bytes} [Tue Mar 8 11:43:46 2022] GET /identity/v3/users/696b86bad4354b3fb6c5969fd061946b => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:47.043816 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf58b2a-d58e-47af-bfee-7941f4ccb804 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:47.136689 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf58b2a-d58e-47af-bfee-7941f4ccb804 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:47.168533 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298432e2-ca92-44aa-9259-22f6bceb2334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:47.169165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298432e2-ca92-44aa-9259-22f6bceb2334 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:47.169447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298432e2-ca92-44aa-9259-22f6bceb2334 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:47.169722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298432e2-ca92-44aa-9259-22f6bceb2334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:47.233730 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298432e2-ca92-44aa-9259-22f6bceb2334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:47.235165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298432e2-ca92-44aa-9259-22f6bceb2334 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:47.327010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 595/1198] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:43:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:43:47.332924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ad576-e08e-4ac6-bbd4-6c13d5f8c326 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:47.427701 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ad576-e08e-4ac6-bbd4-6c13d5f8c326 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:47.458353 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a718a5-2f2c-4ebe-980d-ef945b3cf30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:47.459194 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a718a5-2f2c-4ebe-980d-ef945b3cf30e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:47.459472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a718a5-2f2c-4ebe-980d-ef945b3cf30e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:47.459772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a718a5-2f2c-4ebe-980d-ef945b3cf30e None admin] PATH_INFO: `/v3/projects/df7bf8e19c93494999ca25dd9940e688` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:47.460919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a718a5-2f2c-4ebe-980d-ef945b3cf30e None admin] RBAC: Authorizing `identity:get_project(project_id=df7bf8e19c93494999ca25dd9940e688)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:47.462335 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a718a5-2f2c-4ebe-980d-ef945b3cf30e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:47.464653 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 604/1199] 10.222.0.52 () {56 vars in 1186 bytes} [Tue Mar 8 11:43:47 2022] GET /identity/v3/projects/df7bf8e19c93494999ca25dd9940e688 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:43:47.470600 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298432e2-ca92-44aa-9259-22f6bceb2334 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:43:47.561646 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298432e2-ca92-44aa-9259-22f6bceb2334 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:43:47.593704 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6a7ea-1cbd-4262-8b7f-381078817267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:43:47.594284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6a7ea-1cbd-4262-8b7f-381078817267 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:43:47.594561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6a7ea-1cbd-4262-8b7f-381078817267 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:43:47.594832 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6a7ea-1cbd-4262-8b7f-381078817267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:43:47.595669 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6a7ea-1cbd-4262-8b7f-381078817267 None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=df7bf8e19c93494999ca25dd9940e688, user.id=696b86bad4354b3fb6c5969fd061946b) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:43:47.595980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6a7ea-1cbd-4262-8b7f-381078817267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:43:47.597388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6a7ea-1cbd-4262-8b7f-381078817267 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:43:47.602817 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 596/1200] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:43:47 2022] GET /identity/v3/role_assignments?user.id=696b86bad4354b3fb6c5969fd061946b&scope.project.id=df7bf8e19c93494999ca25dd9940e688&role.id=c2642d38bc964424a5edc330e0d4471d => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:04.897088 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eef35-f282-480f-a65d-c243bf2ee2c6 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:04.897740 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eef35-f282-480f-a65d-c243bf2ee2c6 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:04.897740 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eef35-f282-480f-a65d-c243bf2ee2c6 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:04.899493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 605/1201] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:45:04.904493 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d717f8-0a0f-41b5-812c-4a8b0f713944 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:04.906259 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d717f8-0a0f-41b5-812c-4a8b0f713944 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:04.906259 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d717f8-0a0f-41b5-812c-4a8b0f713944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:04.921552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-b1d717f8-0a0f-41b5-812c-4a8b0f713944 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:45:04.922737 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b1d717f8-0a0f-41b5-812c-4a8b0f713944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:45:04.986800 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 597/1202] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:45:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:45:05.012797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899eef35-f282-480f-a65d-c243bf2ee2c6 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:05.110486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899eef35-f282-480f-a65d-c243bf2ee2c6 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:05.143988 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047991f6-875d-4d3b-8bff-93e4ce5c106f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:05.144763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047991f6-875d-4d3b-8bff-93e4ce5c106f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:05.145041 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047991f6-875d-4d3b-8bff-93e4ce5c106f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:05.145312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047991f6-875d-4d3b-8bff-93e4ce5c106f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:05.155310 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047991f6-875d-4d3b-8bff-93e4ce5c106f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:05.156733 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047991f6-875d-4d3b-8bff-93e4ce5c106f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:05.173562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-047991f6-875d-4d3b-8bff-93e4ce5c106f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:45:05.174705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 606/1203] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:05.181355 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d717f8-0a0f-41b5-812c-4a8b0f713944 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:05.277493 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d717f8-0a0f-41b5-812c-4a8b0f713944 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:05.309381 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db8e24-9753-4903-8ab0-364cf23ebd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:05.310028 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db8e24-9753-4903-8ab0-364cf23ebd80 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:05.310308 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db8e24-9753-4903-8ab0-364cf23ebd80 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:05.310578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db8e24-9753-4903-8ab0-364cf23ebd80 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:05.311287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db8e24-9753-4903-8ab0-364cf23ebd80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:05.311618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db8e24-9753-4903-8ab0-364cf23ebd80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:05.313026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db8e24-9753-4903-8ab0-364cf23ebd80 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:05.324566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 598/1204] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:05.330149 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047991f6-875d-4d3b-8bff-93e4ce5c106f None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:05.425027 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047991f6-875d-4d3b-8bff-93e4ce5c106f None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:05.458722 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a63eb2-f27e-4f91-9828-2eaabc3fe7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:05.459425 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a63eb2-f27e-4f91-9828-2eaabc3fe7c0 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:05.460436 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a63eb2-f27e-4f91-9828-2eaabc3fe7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:05.460720 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a63eb2-f27e-4f91-9828-2eaabc3fe7c0 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:05.461430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a63eb2-f27e-4f91-9828-2eaabc3fe7c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:05.462909 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a63eb2-f27e-4f91-9828-2eaabc3fe7c0 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:05.520870 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 607/1205] 10.222.0.52 () {60 vars in 1132 bytes} [Tue Mar 8 11:45:05 2022] POST /identity/v3/users => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 11:45:07.921025 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6274a24-694c-4f1b-a689-dc5ce9e1649c None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:07.921578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6274a24-694c-4f1b-a689-dc5ce9e1649c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:07.921578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6274a24-694c-4f1b-a689-dc5ce9e1649c None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:07.923307 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 599/1206] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:45:07.929214 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da072-1b5d-4c1c-b9a0-680c7bfc626c None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:07.929704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da072-1b5d-4c1c-b9a0-680c7bfc626c None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:07.929704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da072-1b5d-4c1c-b9a0-680c7bfc626c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:07.946823 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-1e1da072-1b5d-4c1c-b9a0-680c7bfc626c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:45:07.948057 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-1e1da072-1b5d-4c1c-b9a0-680c7bfc626c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:45:08.011076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 608/1207] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:45:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:45:08.033908 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6274a24-694c-4f1b-a689-dc5ce9e1649c None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:08.136727 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6274a24-694c-4f1b-a689-dc5ce9e1649c None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:08.167732 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b04aa-6ff5-4e09-bec9-7f24699c66ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:08.168527 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b04aa-6ff5-4e09-bec9-7f24699c66ed None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:08.168803 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b04aa-6ff5-4e09-bec9-7f24699c66ed None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:08.169073 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b04aa-6ff5-4e09-bec9-7f24699c66ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:08.179741 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b04aa-6ff5-4e09-bec9-7f24699c66ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:45:08.186528 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-fc0b04aa-6ff5-4e09-bec9-7f24699c66ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:45:08.187742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 600/1208] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:45:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:08.193979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1da072-1b5d-4c1c-b9a0-680c7bfc626c None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:08.287299 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1da072-1b5d-4c1c-b9a0-680c7bfc626c None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:08.319918 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b25d31-aceb-4621-92df-39e5dc6827b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:08.320582 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b25d31-aceb-4621-92df-39e5dc6827b3 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:08.320864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b25d31-aceb-4621-92df-39e5dc6827b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:08.321139 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b25d31-aceb-4621-92df-39e5dc6827b3 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:08.321871 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b25d31-aceb-4621-92df-39e5dc6827b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:08.322177 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b25d31-aceb-4621-92df-39e5dc6827b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:08.323597 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b25d31-aceb-4621-92df-39e5dc6827b3 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:08.331240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 609/1209] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:45:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:08.337378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b04aa-6ff5-4e09-bec9-7f24699c66ed None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:08.438326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b04aa-6ff5-4e09-bec9-7f24699c66ed None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:08.472349 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f9cd1-5aee-4d3a-a171-3dac7568506e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:08.473131 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f9cd1-5aee-4d3a-a171-3dac7568506e None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:08.473411 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f9cd1-5aee-4d3a-a171-3dac7568506e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:08.473683 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f9cd1-5aee-4d3a-a171-3dac7568506e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:08.483926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f9cd1-5aee-4d3a-a171-3dac7568506e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:08.485401 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f9cd1-5aee-4d3a-a171-3dac7568506e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:08.501665 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-129f9cd1-5aee-4d3a-a171-3dac7568506e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:45:08.502826 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 601/1210] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:08.509497 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b25d31-aceb-4621-92df-39e5dc6827b3 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:08.605301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b25d31-aceb-4621-92df-39e5dc6827b3 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:08.636975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf24f4d-cf74-4dcc-bb84-1c98cda78977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:08.637628 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf24f4d-cf74-4dcc-bb84-1c98cda78977 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:08.637912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf24f4d-cf74-4dcc-bb84-1c98cda78977 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:08.638190 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf24f4d-cf74-4dcc-bb84-1c98cda78977 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:08.638917 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf24f4d-cf74-4dcc-bb84-1c98cda78977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:08.639222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf24f4d-cf74-4dcc-bb84-1c98cda78977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:08.640625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf24f4d-cf74-4dcc-bb84-1c98cda78977 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:08.652388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 610/1211] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:08.658037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f9cd1-5aee-4d3a-a171-3dac7568506e None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:08.762214 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f9cd1-5aee-4d3a-a171-3dac7568506e None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:08.795169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712e8ca-36a8-4a12-947b-1b54f598c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:08.795977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712e8ca-36a8-4a12-947b-1b54f598c6cc None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:08.796259 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712e8ca-36a8-4a12-947b-1b54f598c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:08.796530 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712e8ca-36a8-4a12-947b-1b54f598c6cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:08.803300 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712e8ca-36a8-4a12-947b-1b54f598c6cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:08.804956 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712e8ca-36a8-4a12-947b-1b54f598c6cc None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:08.818275 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-0712e8ca-36a8-4a12-947b-1b54f598c6cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 11:45:08.822567 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 602/1212] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:08.826044 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf24f4d-cf74-4dcc-bb84-1c98cda78977 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:08.920046 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf24f4d-cf74-4dcc-bb84-1c98cda78977 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:08.952790 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dd8ac-3133-4e9d-8a4b-2756a5d067d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:08.953451 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dd8ac-3133-4e9d-8a4b-2756a5d067d9 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:08.953730 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dd8ac-3133-4e9d-8a4b-2756a5d067d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:08.954004 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dd8ac-3133-4e9d-8a4b-2756a5d067d9 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:08.954877 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768dd8ac-3133-4e9d-8a4b-2756a5d067d9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:08.955189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768dd8ac-3133-4e9d-8a4b-2756a5d067d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:08.956648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768dd8ac-3133-4e9d-8a4b-2756a5d067d9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:08.973768 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 611/1213] 10.222.0.52 () {56 vars in 1143 bytes} [Tue Mar 8 11:45:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:08.979559 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712e8ca-36a8-4a12-947b-1b54f598c6cc None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:09.072506 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712e8ca-36a8-4a12-947b-1b54f598c6cc None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:09.105411 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda58c5d-4f4a-4d95-9cd5-c165909ef4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:09.106052 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda58c5d-4f4a-4d95-9cd5-c165909ef4e2 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:09.106333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda58c5d-4f4a-4d95-9cd5-c165909ef4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:09.106655 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda58c5d-4f4a-4d95-9cd5-c165909ef4e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:09.170503 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda58c5d-4f4a-4d95-9cd5-c165909ef4e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:09.171978 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda58c5d-4f4a-4d95-9cd5-c165909ef4e2 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:09.266628 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 603/1214] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:45:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:45:09.272391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dd8ac-3133-4e9d-8a4b-2756a5d067d9 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:09.366290 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dd8ac-3133-4e9d-8a4b-2756a5d067d9 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:09.398949 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88327c1b-48ed-4c03-8580-932abe36d432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:09.399752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88327c1b-48ed-4c03-8580-932abe36d432 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:09.400032 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88327c1b-48ed-4c03-8580-932abe36d432 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:09.400304 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88327c1b-48ed-4c03-8580-932abe36d432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:09.409762 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88327c1b-48ed-4c03-8580-932abe36d432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:09.411359 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88327c1b-48ed-4c03-8580-932abe36d432 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:09.427158 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-88327c1b-48ed-4c03-8580-932abe36d432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:45:09.428876 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 612/1215] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:09.434595 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda58c5d-4f4a-4d95-9cd5-c165909ef4e2 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:09.528472 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda58c5d-4f4a-4d95-9cd5-c165909ef4e2 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:09.560935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624555d-e4c3-4c83-a25c-85fae7bc49ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:09.561600 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624555d-e4c3-4c83-a25c-85fae7bc49ed None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:09.561879 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624555d-e4c3-4c83-a25c-85fae7bc49ed None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:09.562146 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624555d-e4c3-4c83-a25c-85fae7bc49ed None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:09.562866 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624555d-e4c3-4c83-a25c-85fae7bc49ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:09.563166 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624555d-e4c3-4c83-a25c-85fae7bc49ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:09.564562 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624555d-e4c3-4c83-a25c-85fae7bc49ed None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:09.575770 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 604/1216] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:09.581381 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88327c1b-48ed-4c03-8580-932abe36d432 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:09.678568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88327c1b-48ed-4c03-8580-932abe36d432 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:09.709918 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb92853-743c-4c54-a99b-6f9b92804485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:09.710683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb92853-743c-4c54-a99b-6f9b92804485 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:09.710960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb92853-743c-4c54-a99b-6f9b92804485 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:09.711232 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb92853-743c-4c54-a99b-6f9b92804485 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:09.717612 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb92853-743c-4c54-a99b-6f9b92804485 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:09.719067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb92853-743c-4c54-a99b-6f9b92804485 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:09.732108 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-5bb92853-743c-4c54-a99b-6f9b92804485 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:45:09.733325 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 613/1217] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:09.739048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624555d-e4c3-4c83-a25c-85fae7bc49ed None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:09.842884 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624555d-e4c3-4c83-a25c-85fae7bc49ed None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:09.874562 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938c4a9-860f-443b-aa71-0f0bdcdae415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:09.875210 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938c4a9-860f-443b-aa71-0f0bdcdae415 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:09.875486 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938c4a9-860f-443b-aa71-0f0bdcdae415 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:09.875782 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938c4a9-860f-443b-aa71-0f0bdcdae415 None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:09.876548 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938c4a9-860f-443b-aa71-0f0bdcdae415 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:09.876851 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938c4a9-860f-443b-aa71-0f0bdcdae415 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:09.878262 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938c4a9-860f-443b-aa71-0f0bdcdae415 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:09.889821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 605/1218] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:09.895901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb92853-743c-4c54-a99b-6f9b92804485 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:09.993128 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb92853-743c-4c54-a99b-6f9b92804485 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:10.025311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2285c5d-b3ac-4b54-96a1-6fae20fd85ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:10.025951 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2285c5d-b3ac-4b54-96a1-6fae20fd85ea None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:10.026229 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2285c5d-b3ac-4b54-96a1-6fae20fd85ea None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:10.026499 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2285c5d-b3ac-4b54-96a1-6fae20fd85ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:10.027308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2285c5d-b3ac-4b54-96a1-6fae20fd85ea None admin] RBAC: Adding query filter params (role.id=b34db25ec52b41a7bb7691d839e68c53, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=8855284b10c64b8ca367e3c30b5f66fd) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:10.027648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2285c5d-b3ac-4b54-96a1-6fae20fd85ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:10.029104 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2285c5d-b3ac-4b54-96a1-6fae20fd85ea None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:10.034266 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 614/1219] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:45:09 2022] GET /identity/v3/role_assignments?user.id=8855284b10c64b8ca367e3c30b5f66fd&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=b34db25ec52b41a7bb7691d839e68c53 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:12.284079 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce6082-6ac0-4e74-b9de-042254bedb31 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:12.284621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce6082-6ac0-4e74-b9de-042254bedb31 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:12.284621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce6082-6ac0-4e74-b9de-042254bedb31 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:12.286390 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 606/1220] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:45:12.292229 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8369-52f2-4afd-a020-2f8af4f28ed0 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:12.293414 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8369-52f2-4afd-a020-2f8af4f28ed0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:12.293414 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8369-52f2-4afd-a020-2f8af4f28ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:12.309395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-6afb8369-52f2-4afd-a020-2f8af4f28ed0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:45:12.310575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-6afb8369-52f2-4afd-a020-2f8af4f28ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:45:12.374609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 615/1221] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:45:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:45:12.398156 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce6082-6ac0-4e74-b9de-042254bedb31 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:12.494262 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce6082-6ac0-4e74-b9de-042254bedb31 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:12.527906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1769e54-44e7-4782-89cb-59cd8350ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:12.529061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769e54-44e7-4782-89cb-59cd8350ec9b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:12.529061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769e54-44e7-4782-89cb-59cd8350ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:12.529391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769e54-44e7-4782-89cb-59cd8350ec9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:12.539484 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1769e54-44e7-4782-89cb-59cd8350ec9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:45:12.546430 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-c1769e54-44e7-4782-89cb-59cd8350ec9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:45:12.547618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 607/1222] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:45:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:45:12.553866 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb8369-52f2-4afd-a020-2f8af4f28ed0 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:12.647725 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb8369-52f2-4afd-a020-2f8af4f28ed0 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:12.680234 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4ebc9-d6ac-4933-b157-430057838817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:12.680890 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4ebc9-d6ac-4933-b157-430057838817 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:12.681166 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4ebc9-d6ac-4933-b157-430057838817 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:12.681437 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4ebc9-d6ac-4933-b157-430057838817 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:12.682168 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4ebc9-d6ac-4933-b157-430057838817 None admin] RBAC: Adding query filter params (name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:12.682469 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4ebc9-d6ac-4933-b157-430057838817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:12.683892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4ebc9-d6ac-4933-b157-430057838817 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:12.691747 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 616/1223] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:45:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:12.698104 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1769e54-44e7-4782-89cb-59cd8350ec9b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:12.795764 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1769e54-44e7-4782-89cb-59cd8350ec9b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:12.828258 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f35d8-4532-4651-9ee1-49f7ebf89b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:12.829118 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f35d8-4532-4651-9ee1-49f7ebf89b3b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:12.829396 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f35d8-4532-4651-9ee1-49f7ebf89b3b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:12.829662 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f35d8-4532-4651-9ee1-49f7ebf89b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:12.839813 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f35d8-4532-4651-9ee1-49f7ebf89b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:12.841280 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f35d8-4532-4651-9ee1-49f7ebf89b3b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:12.857877 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-3a2f35d8-4532-4651-9ee1-49f7ebf89b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:45:12.859077 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 608/1224] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:12.864970 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4ebc9-d6ac-4933-b157-430057838817 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:12.961801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4ebc9-d6ac-4933-b157-430057838817 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:12.994270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47a230-19b9-469d-a1c4-30db953821b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:12.994948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47a230-19b9-469d-a1c4-30db953821b8 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:12.995230 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47a230-19b9-469d-a1c4-30db953821b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:12.995508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47a230-19b9-469d-a1c4-30db953821b8 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:12.996248 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47a230-19b9-469d-a1c4-30db953821b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:12.996552 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47a230-19b9-469d-a1c4-30db953821b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:12.997925 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47a230-19b9-469d-a1c4-30db953821b8 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:13.009209 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 617/1225] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:13.015228 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f35d8-4532-4651-9ee1-49f7ebf89b3b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:13.110878 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f35d8-4532-4651-9ee1-49f7ebf89b3b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:13.143207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a2d83-dd57-4af7-99fe-b5226b61b574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:13.144048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a2d83-dd57-4af7-99fe-b5226b61b574 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:13.144330 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a2d83-dd57-4af7-99fe-b5226b61b574 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:13.144601 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a2d83-dd57-4af7-99fe-b5226b61b574 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:13.152509 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a2d83-dd57-4af7-99fe-b5226b61b574 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:13.154763 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a2d83-dd57-4af7-99fe-b5226b61b574 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:13.167910 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-2d4a2d83-dd57-4af7-99fe-b5226b61b574 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 11:45:13.169053 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 609/1226] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:13.174860 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47a230-19b9-469d-a1c4-30db953821b8 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:13.272636 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47a230-19b9-469d-a1c4-30db953821b8 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:13.305148 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d78b7-d9bf-4ff4-b0e6-9530c4d92f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:13.305811 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d78b7-d9bf-4ff4-b0e6-9530c4d92f75 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:13.306098 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d78b7-d9bf-4ff4-b0e6-9530c4d92f75 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:13.306377 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d78b7-d9bf-4ff4-b0e6-9530c4d92f75 None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:13.307223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d78b7-d9bf-4ff4-b0e6-9530c4d92f75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:13.307515 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d78b7-d9bf-4ff4-b0e6-9530c4d92f75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:13.308970 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d78b7-d9bf-4ff4-b0e6-9530c4d92f75 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:13.325995 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 618/1227] 10.222.0.52 () {56 vars in 1143 bytes} [Tue Mar 8 11:45:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:13.331652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a2d83-dd57-4af7-99fe-b5226b61b574 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:13.427248 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a2d83-dd57-4af7-99fe-b5226b61b574 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:13.458608 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47759c52-af21-4aa5-8e15-cccc81b51e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:13.460023 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47759c52-af21-4aa5-8e15-cccc81b51e44 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:13.460295 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47759c52-af21-4aa5-8e15-cccc81b51e44 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:13.460565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47759c52-af21-4aa5-8e15-cccc81b51e44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:13.470532 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47759c52-af21-4aa5-8e15-cccc81b51e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:13.471992 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47759c52-af21-4aa5-8e15-cccc81b51e44 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:13.487724 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-47759c52-af21-4aa5-8e15-cccc81b51e44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:45:13.488869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 610/1228] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:13.494803 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d78b7-d9bf-4ff4-b0e6-9530c4d92f75 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:13.590297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d78b7-d9bf-4ff4-b0e6-9530c4d92f75 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:13.622402 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce38c3-3f9a-472a-9a1a-4a42b2dabe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:13.623051 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce38c3-3f9a-472a-9a1a-4a42b2dabe37 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:13.623444 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce38c3-3f9a-472a-9a1a-4a42b2dabe37 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:13.623759 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce38c3-3f9a-472a-9a1a-4a42b2dabe37 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:13.624471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce38c3-3f9a-472a-9a1a-4a42b2dabe37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:13.624778 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce38c3-3f9a-472a-9a1a-4a42b2dabe37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:13.626227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce38c3-3f9a-472a-9a1a-4a42b2dabe37 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:13.637903 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 619/1229] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:13.643610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47759c52-af21-4aa5-8e15-cccc81b51e44 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:13.738960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47759c52-af21-4aa5-8e15-cccc81b51e44 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:13.771998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a526d70-9262-4ce9-acd1-5a5f3701a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:13.773887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a526d70-9262-4ce9-acd1-5a5f3701a7c6 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:13.773887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a526d70-9262-4ce9-acd1-5a5f3701a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:13.773887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a526d70-9262-4ce9-acd1-5a5f3701a7c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:13.780155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a526d70-9262-4ce9-acd1-5a5f3701a7c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:13.781648 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a526d70-9262-4ce9-acd1-5a5f3701a7c6 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:13.794918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-5a526d70-9262-4ce9-acd1-5a5f3701a7c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:45:13.810855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 611/1230] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:45:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:13.810977 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce38c3-3f9a-472a-9a1a-4a42b2dabe37 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:13.898364 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce38c3-3f9a-472a-9a1a-4a42b2dabe37 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:13.930219 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ea9a4-d1e7-486a-bfc2-fcf584b1a740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:13.930870 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ea9a4-d1e7-486a-bfc2-fcf584b1a740 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:13.931156 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ea9a4-d1e7-486a-bfc2-fcf584b1a740 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:13.931434 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ea9a4-d1e7-486a-bfc2-fcf584b1a740 None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:13.932239 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ea9a4-d1e7-486a-bfc2-fcf584b1a740 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:13.932550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ea9a4-d1e7-486a-bfc2-fcf584b1a740 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:13.933997 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ea9a4-d1e7-486a-bfc2-fcf584b1a740 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:13.946036 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 620/1231] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:45:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:13.952175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a526d70-9262-4ce9-acd1-5a5f3701a7c6 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:14.047146 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a526d70-9262-4ce9-acd1-5a5f3701a7c6 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:14.078993 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38cd37-786c-4ec9-85e2-27c7b2e72551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:14.079894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38cd37-786c-4ec9-85e2-27c7b2e72551 None admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:14.080170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38cd37-786c-4ec9-85e2-27c7b2e72551 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:14.080437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38cd37-786c-4ec9-85e2-27c7b2e72551 None admin] PATH_INFO: `/v3/projects/7c390663688b466f98ff480c31ba21bc/users/8855284b10c64b8ca367e3c30b5f66fd/roles/b34db25ec52b41a7bb7691d839e68c53` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:14.093644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38cd37-786c-4ec9-85e2-27c7b2e72551 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c390663688b466f98ff480c31ba21bc, user_id=8855284b10c64b8ca367e3c30b5f66fd, role_id=b34db25ec52b41a7bb7691d839e68c53)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:14.095067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38cd37-786c-4ec9-85e2-27c7b2e72551 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:14.160837 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 612/1232] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:45:13 2022] PUT /identity/v3/projects/7c390663688b466f98ff480c31ba21bc/users/8855284b10c64b8ca367e3c30b5f66fd/roles/b34db25ec52b41a7bb7691d839e68c53 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:45:16.420437 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252436f-18e1-4062-a498-0be6271b4ff7 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:16.420961 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252436f-18e1-4062-a498-0be6271b4ff7 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:16.421076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252436f-18e1-4062-a498-0be6271b4ff7 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:16.423027 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 621/1233] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:45:16.428231 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1589c-0d73-458d-819b-e15845263da4 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:16.428627 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1589c-0d73-458d-819b-e15845263da4 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:16.428774 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1589c-0d73-458d-819b-e15845263da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:16.444664 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-b7c1589c-0d73-458d-819b-e15845263da4 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:45:16.446417 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b7c1589c-0d73-458d-819b-e15845263da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:45:16.510291 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 613/1234] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:45:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:45:16.533629 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252436f-18e1-4062-a498-0be6271b4ff7 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:16.631499 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252436f-18e1-4062-a498-0be6271b4ff7 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:16.663784 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18107feb-3142-4dff-b25e-e212b3d22f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:16.664756 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18107feb-3142-4dff-b25e-e212b3d22f9b None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:16.665085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18107feb-3142-4dff-b25e-e212b3d22f9b None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:16.665361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18107feb-3142-4dff-b25e-e212b3d22f9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:16.674821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18107feb-3142-4dff-b25e-e212b3d22f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:45:16.682350 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-18107feb-3142-4dff-b25e-e212b3d22f9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 11:45:16.683565 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 622/1235] 10.222.0.52 () {56 vars in 1102 bytes} [Tue Mar 8 11:45:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:16.689593 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1589c-0d73-458d-819b-e15845263da4 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:16.783130 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1589c-0d73-458d-819b-e15845263da4 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:16.815149 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55287c86-cba0-4cf0-907b-77dd35732c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:16.815852 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55287c86-cba0-4cf0-907b-77dd35732c13 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:16.816132 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55287c86-cba0-4cf0-907b-77dd35732c13 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:16.816405 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55287c86-cba0-4cf0-907b-77dd35732c13 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:16.817131 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55287c86-cba0-4cf0-907b-77dd35732c13 None admin] RBAC: Adding query filter params (name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:16.817434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55287c86-cba0-4cf0-907b-77dd35732c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:16.818816 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55287c86-cba0-4cf0-907b-77dd35732c13 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:16.827349 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 614/1236] 10.222.0.52 () {56 vars in 1103 bytes} [Tue Mar 8 11:45:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:16.832971 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18107feb-3142-4dff-b25e-e212b3d22f9b None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:16.928997 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18107feb-3142-4dff-b25e-e212b3d22f9b None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:16.962981 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469abc7-eb3d-420e-bd8b-7895f10648a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:16.963797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469abc7-eb3d-420e-bd8b-7895f10648a9 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:16.964079 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469abc7-eb3d-420e-bd8b-7895f10648a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:16.964351 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469abc7-eb3d-420e-bd8b-7895f10648a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:16.974339 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469abc7-eb3d-420e-bd8b-7895f10648a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:16.975797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469abc7-eb3d-420e-bd8b-7895f10648a9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:16.992885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-d469abc7-eb3d-420e-bd8b-7895f10648a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:45:16.994084 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 623/1237] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:16.999991 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55287c86-cba0-4cf0-907b-77dd35732c13 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:17.094525 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55287c86-cba0-4cf0-907b-77dd35732c13 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:17.127110 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a478a3a-9e63-4493-a8d3-43c455e4d7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:17.127818 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a478a3a-9e63-4493-a8d3-43c455e4d7ce None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:17.128128 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a478a3a-9e63-4493-a8d3-43c455e4d7ce None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:17.128398 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a478a3a-9e63-4493-a8d3-43c455e4d7ce None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:17.129099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a478a3a-9e63-4493-a8d3-43c455e4d7ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:17.129401 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a478a3a-9e63-4493-a8d3-43c455e4d7ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:17.130748 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a478a3a-9e63-4493-a8d3-43c455e4d7ce None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:17.142053 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 615/1238] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:17.149431 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469abc7-eb3d-420e-bd8b-7895f10648a9 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:17.247352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469abc7-eb3d-420e-bd8b-7895f10648a9 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:17.280130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6551a-bbc1-4f99-b5ec-5f9cdc05dd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:17.280956 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6551a-bbc1-4f99-b5ec-5f9cdc05dd4c None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:17.281232 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6551a-bbc1-4f99-b5ec-5f9cdc05dd4c None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:17.281504 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6551a-bbc1-4f99-b5ec-5f9cdc05dd4c None admin] PATH_INFO: `/v3/users/placement` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:17.288767 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6551a-bbc1-4f99-b5ec-5f9cdc05dd4c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:17.290703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6551a-bbc1-4f99-b5ec-5f9cdc05dd4c None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:17.303864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-0fe6551a-bbc1-4f99-b5ec-5f9cdc05dd4c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 11:45:17.305712 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 624/1239] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:17.311660 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a478a3a-9e63-4493-a8d3-43c455e4d7ce None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:17.406884 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a478a3a-9e63-4493-a8d3-43c455e4d7ce None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:17.442826 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e16e9-7541-404d-92a1-50b88ab3b41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:17.443708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e16e9-7541-404d-92a1-50b88ab3b41f None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:17.443806 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e16e9-7541-404d-92a1-50b88ab3b41f None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:17.444069 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e16e9-7541-404d-92a1-50b88ab3b41f None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:17.444908 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e16e9-7541-404d-92a1-50b88ab3b41f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:17.445224 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e16e9-7541-404d-92a1-50b88ab3b41f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:17.446954 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e16e9-7541-404d-92a1-50b88ab3b41f None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:17.464605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 616/1240] 10.222.0.52 () {56 vars in 1143 bytes} [Tue Mar 8 11:45:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:17.470535 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6551a-bbc1-4f99-b5ec-5f9cdc05dd4c None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:17.567499 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6551a-bbc1-4f99-b5ec-5f9cdc05dd4c None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:17.598941 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5709d91-252e-416d-8db7-858545227aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:17.599608 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5709d91-252e-416d-8db7-858545227aae None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:17.599906 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5709d91-252e-416d-8db7-858545227aae None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:17.600167 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5709d91-252e-416d-8db7-858545227aae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:17.663362 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5709d91-252e-416d-8db7-858545227aae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:17.665448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5709d91-252e-416d-8db7-858545227aae None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:17.764110 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 625/1241] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:45:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:45:17.769971 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e16e9-7541-404d-92a1-50b88ab3b41f None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:17.881424 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e16e9-7541-404d-92a1-50b88ab3b41f None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:17.913059 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc5cb5-18d3-48f0-a8bb-a74a9c9c1a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:17.913917 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc5cb5-18d3-48f0-a8bb-a74a9c9c1a3e None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:17.914128 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc5cb5-18d3-48f0-a8bb-a74a9c9c1a3e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:17.914975 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc5cb5-18d3-48f0-a8bb-a74a9c9c1a3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:17.924914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc5cb5-18d3-48f0-a8bb-a74a9c9c1a3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:17.926493 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc5cb5-18d3-48f0-a8bb-a74a9c9c1a3e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:17.943477 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-79dc5cb5-18d3-48f0-a8bb-a74a9c9c1a3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:45:17.944663 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 617/1242] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:17.950725 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5709d91-252e-416d-8db7-858545227aae None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:18.045269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5709d91-252e-416d-8db7-858545227aae None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:18.077767 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141c60a-6eaf-4190-ad59-a4e43a6230e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:18.078435 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141c60a-6eaf-4190-ad59-a4e43a6230e9 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:18.078696 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141c60a-6eaf-4190-ad59-a4e43a6230e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:18.079001 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141c60a-6eaf-4190-ad59-a4e43a6230e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:18.079791 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141c60a-6eaf-4190-ad59-a4e43a6230e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:18.080095 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141c60a-6eaf-4190-ad59-a4e43a6230e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:18.081487 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141c60a-6eaf-4190-ad59-a4e43a6230e9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:18.092741 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 626/1243] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:18.098371 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc5cb5-18d3-48f0-a8bb-a74a9c9c1a3e None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:18.207877 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc5cb5-18d3-48f0-a8bb-a74a9c9c1a3e None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:18.240986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a3040-c1ae-4e50-90ee-513589c7c41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:18.241777 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a3040-c1ae-4e50-90ee-513589c7c41b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:18.242059 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a3040-c1ae-4e50-90ee-513589c7c41b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:18.242334 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a3040-c1ae-4e50-90ee-513589c7c41b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:18.250306 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a3040-c1ae-4e50-90ee-513589c7c41b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:18.251810 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a3040-c1ae-4e50-90ee-513589c7c41b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:18.265777 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-ac7a3040-c1ae-4e50-90ee-513589c7c41b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:45:18.267193 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 618/1244] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:18.273018 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141c60a-6eaf-4190-ad59-a4e43a6230e9 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:18.368825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141c60a-6eaf-4190-ad59-a4e43a6230e9 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:18.401823 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477f25c-8773-4879-a87e-d955a21e895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:18.402461 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477f25c-8773-4879-a87e-d955a21e895a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:18.402742 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477f25c-8773-4879-a87e-d955a21e895a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:18.403023 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477f25c-8773-4879-a87e-d955a21e895a None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:18.403821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477f25c-8773-4879-a87e-d955a21e895a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:18.404133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477f25c-8773-4879-a87e-d955a21e895a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:18.405565 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477f25c-8773-4879-a87e-d955a21e895a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:18.416901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 627/1245] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:45:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:18.423114 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a3040-c1ae-4e50-90ee-513589c7c41b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:18.522395 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a3040-c1ae-4e50-90ee-513589c7c41b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:18.556511 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4681a3d-9175-411b-aefc-86237673e7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:18.557168 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4681a3d-9175-411b-aefc-86237673e7d1 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:18.557450 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4681a3d-9175-411b-aefc-86237673e7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:18.557725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4681a3d-9175-411b-aefc-86237673e7d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:18.558541 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4681a3d-9175-411b-aefc-86237673e7d1 None admin] RBAC: Adding query filter params (role.id=b34db25ec52b41a7bb7691d839e68c53, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=8855284b10c64b8ca367e3c30b5f66fd) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:18.558911 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4681a3d-9175-411b-aefc-86237673e7d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:18.560365 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4681a3d-9175-411b-aefc-86237673e7d1 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:18.565989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 619/1246] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:45:18 2022] GET /identity/v3/role_assignments?user.id=8855284b10c64b8ca367e3c30b5f66fd&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=b34db25ec52b41a7bb7691d839e68c53 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:20.919174 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71f37e-53af-4da1-88f8-2b8173dc3362 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:20.919803 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71f37e-53af-4da1-88f8-2b8173dc3362 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:20.919803 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71f37e-53af-4da1-88f8-2b8173dc3362 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:20.921562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 628/1247] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:45:20.926773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd89536-1db5-4a4e-8a55-6ab5c33ec90b None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:20.927165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd89536-1db5-4a4e-8a55-6ab5c33ec90b None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:20.927321 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd89536-1db5-4a4e-8a55-6ab5c33ec90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:20.945087 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-6bd89536-1db5-4a4e-8a55-6ab5c33ec90b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:45:20.947642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-6bd89536-1db5-4a4e-8a55-6ab5c33ec90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:45:21.008237 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 620/1248] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:45:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:45:21.031503 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71f37e-53af-4da1-88f8-2b8173dc3362 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:21.128676 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71f37e-53af-4da1-88f8-2b8173dc3362 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:21.160527 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a099e-b297-45a3-ba26-534384c6ce2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:21.161331 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a099e-b297-45a3-ba26-534384c6ce2a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:21.161608 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a099e-b297-45a3-ba26-534384c6ce2a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:21.161883 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a099e-b297-45a3-ba26-534384c6ce2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:21.172323 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a099e-b297-45a3-ba26-534384c6ce2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:45:21.178709 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-494a099e-b297-45a3-ba26-534384c6ce2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:45:21.179919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 629/1249] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:45:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:45:21.186470 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd89536-1db5-4a4e-8a55-6ab5c33ec90b None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:21.280614 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd89536-1db5-4a4e-8a55-6ab5c33ec90b None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:21.312471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c71b30-317f-45ed-89a5-2ce584c7b066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:21.313713 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c71b30-317f-45ed-89a5-2ce584c7b066 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:21.313713 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c71b30-317f-45ed-89a5-2ce584c7b066 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:21.313713 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c71b30-317f-45ed-89a5-2ce584c7b066 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:21.314394 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c71b30-317f-45ed-89a5-2ce584c7b066 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:21.314704 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c71b30-317f-45ed-89a5-2ce584c7b066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:21.316105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c71b30-317f-45ed-89a5-2ce584c7b066 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:21.324126 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 621/1250] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:45:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:21.329845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a099e-b297-45a3-ba26-534384c6ce2a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:21.424457 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a099e-b297-45a3-ba26-534384c6ce2a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:21.461031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc850d-b97b-4f9e-9bee-88a8bf688658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:21.462842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc850d-b97b-4f9e-9bee-88a8bf688658 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:21.463270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc850d-b97b-4f9e-9bee-88a8bf688658 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:21.463724 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc850d-b97b-4f9e-9bee-88a8bf688658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:21.478302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc850d-b97b-4f9e-9bee-88a8bf688658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:21.480618 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc850d-b97b-4f9e-9bee-88a8bf688658 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:21.500546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-67cc850d-b97b-4f9e-9bee-88a8bf688658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:45:21.502276 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 630/1251] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:45:21.508064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c71b30-317f-45ed-89a5-2ce584c7b066 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:21.604950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c71b30-317f-45ed-89a5-2ce584c7b066 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:21.638131 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab053f-c3bb-4305-914b-d0a536cf49bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:21.638795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab053f-c3bb-4305-914b-d0a536cf49bc None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:21.639100 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab053f-c3bb-4305-914b-d0a536cf49bc None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:21.639385 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab053f-c3bb-4305-914b-d0a536cf49bc None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:21.640133 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab053f-c3bb-4305-914b-d0a536cf49bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:21.640440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab053f-c3bb-4305-914b-d0a536cf49bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:21.641802 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab053f-c3bb-4305-914b-d0a536cf49bc None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:21.653932 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 622/1252] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:21.659728 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc850d-b97b-4f9e-9bee-88a8bf688658 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:21.759071 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc850d-b97b-4f9e-9bee-88a8bf688658 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:21.792567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a5dca-2617-417d-82c4-75f5d3562a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:21.793370 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5dca-2617-417d-82c4-75f5d3562a78 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:21.793715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5dca-2617-417d-82c4-75f5d3562a78 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:21.793995 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5dca-2617-417d-82c4-75f5d3562a78 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:21.801695 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a5dca-2617-417d-82c4-75f5d3562a78 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:21.803182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a5dca-2617-417d-82c4-75f5d3562a78 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:21.820280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-202a5dca-2617-417d-82c4-75f5d3562a78 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 11:45:21.822777 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 631/1253] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:21.828754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab053f-c3bb-4305-914b-d0a536cf49bc None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:21.928430 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab053f-c3bb-4305-914b-d0a536cf49bc None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:21.961489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f0bac-cbb5-4418-9407-dfc94ca7f218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:21.962180 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f0bac-cbb5-4418-9407-dfc94ca7f218 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:21.962462 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f0bac-cbb5-4418-9407-dfc94ca7f218 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:21.962737 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f0bac-cbb5-4418-9407-dfc94ca7f218 None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:21.963588 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f0bac-cbb5-4418-9407-dfc94ca7f218 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:21.963899 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f0bac-cbb5-4418-9407-dfc94ca7f218 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:21.965491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f0bac-cbb5-4418-9407-dfc94ca7f218 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:21.981998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 623/1254] 10.222.0.52 () {56 vars in 1143 bytes} [Tue Mar 8 11:45:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:21.987782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a5dca-2617-417d-82c4-75f5d3562a78 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:22.082689 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a5dca-2617-417d-82c4-75f5d3562a78 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:22.113269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c49b9-715f-4d60-8b54-8ed8037840db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:22.113927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c49b9-715f-4d60-8b54-8ed8037840db None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:22.114183 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c49b9-715f-4d60-8b54-8ed8037840db None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:22.114513 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c49b9-715f-4d60-8b54-8ed8037840db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:22.176705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c49b9-715f-4d60-8b54-8ed8037840db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:22.178134 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c49b9-715f-4d60-8b54-8ed8037840db None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:22.270115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 632/1255] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:45:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:45:22.276167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f0bac-cbb5-4418-9407-dfc94ca7f218 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:22.372319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f0bac-cbb5-4418-9407-dfc94ca7f218 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:22.404429 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3442c-b090-4a58-9f27-635f3ead8c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:22.405212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3442c-b090-4a58-9f27-635f3ead8c3c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:22.405493 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3442c-b090-4a58-9f27-635f3ead8c3c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:22.405766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3442c-b090-4a58-9f27-635f3ead8c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:22.416086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3442c-b090-4a58-9f27-635f3ead8c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:22.418491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3442c-b090-4a58-9f27-635f3ead8c3c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:22.435131 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-56c3442c-b090-4a58-9f27-635f3ead8c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:45:22.436314 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 624/1256] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:22.441968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c49b9-715f-4d60-8b54-8ed8037840db None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:22.536614 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c49b9-715f-4d60-8b54-8ed8037840db None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:22.568639 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e98ca-1d27-46b8-8541-ae5d51114988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:22.569287 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e98ca-1d27-46b8-8541-ae5d51114988 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:22.569564 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e98ca-1d27-46b8-8541-ae5d51114988 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:22.569846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e98ca-1d27-46b8-8541-ae5d51114988 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:22.570557 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e98ca-1d27-46b8-8541-ae5d51114988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:22.570867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e98ca-1d27-46b8-8541-ae5d51114988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:22.572977 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e98ca-1d27-46b8-8541-ae5d51114988 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:22.583866 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 633/1257] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:22.590219 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3442c-b090-4a58-9f27-635f3ead8c3c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:22.687750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3442c-b090-4a58-9f27-635f3ead8c3c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:22.721440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b68b1-e1ee-4138-a4ed-15e8031aba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:22.722321 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b68b1-e1ee-4138-a4ed-15e8031aba00 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:22.722600 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b68b1-e1ee-4138-a4ed-15e8031aba00 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:22.722877 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b68b1-e1ee-4138-a4ed-15e8031aba00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:22.729617 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b68b1-e1ee-4138-a4ed-15e8031aba00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:22.735813 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b68b1-e1ee-4138-a4ed-15e8031aba00 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:22.744357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-b23b68b1-e1ee-4138-a4ed-15e8031aba00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:45:22.745501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 625/1258] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:22.751480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e98ca-1d27-46b8-8541-ae5d51114988 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:22.857135 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e98ca-1d27-46b8-8541-ae5d51114988 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:22.891248 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9afad5-6569-4019-a8bf-e3972e30e649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:22.891934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9afad5-6569-4019-a8bf-e3972e30e649 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:22.892218 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9afad5-6569-4019-a8bf-e3972e30e649 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:22.892492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9afad5-6569-4019-a8bf-e3972e30e649 None admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:22.893265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9afad5-6569-4019-a8bf-e3972e30e649 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:22.893574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9afad5-6569-4019-a8bf-e3972e30e649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:22.895002 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9afad5-6569-4019-a8bf-e3972e30e649 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:22.906611 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 634/1259] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:22.912668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b68b1-e1ee-4138-a4ed-15e8031aba00 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:23.008980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b68b1-e1ee-4138-a4ed-15e8031aba00 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:23.040912 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f37e0-8c70-48dd-bdad-24d539e453ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:23.041569 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f37e0-8c70-48dd-bdad-24d539e453ec None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:23.041845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f37e0-8c70-48dd-bdad-24d539e453ec None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:23.042119 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f37e0-8c70-48dd-bdad-24d539e453ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:23.042927 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f37e0-8c70-48dd-bdad-24d539e453ec None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=8855284b10c64b8ca367e3c30b5f66fd) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:23.043304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f37e0-8c70-48dd-bdad-24d539e453ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:23.044829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f37e0-8c70-48dd-bdad-24d539e453ec None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:23.050098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 626/1260] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:45:22 2022] GET /identity/v3/role_assignments?user.id=8855284b10c64b8ca367e3c30b5f66fd&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=c2642d38bc964424a5edc330e0d4471d => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:25.349807 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644aabb-8194-49d4-8a6c-394e078f4e72 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:25.350361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644aabb-8194-49d4-8a6c-394e078f4e72 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:25.350361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644aabb-8194-49d4-8a6c-394e078f4e72 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:25.352258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 635/1261] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:45:25.357489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1849f2d-3c3d-425f-a2de-5b20ab3a62e3 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:25.357902 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1849f2d-3c3d-425f-a2de-5b20ab3a62e3 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:25.358066 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1849f2d-3c3d-425f-a2de-5b20ab3a62e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:25.374840 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-b1849f2d-3c3d-425f-a2de-5b20ab3a62e3 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:45:25.376084 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b1849f2d-3c3d-425f-a2de-5b20ab3a62e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:45:25.440301 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 627/1262] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:45:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:45:25.464194 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644aabb-8194-49d4-8a6c-394e078f4e72 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:25.562420 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644aabb-8194-49d4-8a6c-394e078f4e72 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:25.595710 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675895b3-f5c6-4576-a8b9-72d263e12e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:25.596492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675895b3-f5c6-4576-a8b9-72d263e12e61 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:25.596773 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675895b3-f5c6-4576-a8b9-72d263e12e61 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:25.597045 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675895b3-f5c6-4576-a8b9-72d263e12e61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:25.606695 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675895b3-f5c6-4576-a8b9-72d263e12e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:45:25.613410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-675895b3-f5c6-4576-a8b9-72d263e12e61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:45:25.614580 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 636/1263] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:45:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:45:25.621068 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1849f2d-3c3d-425f-a2de-5b20ab3a62e3 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:25.714143 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1849f2d-3c3d-425f-a2de-5b20ab3a62e3 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:25.746933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89a0ad-6ecb-496d-9d01-8d0b87af81e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:25.747552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89a0ad-6ecb-496d-9d01-8d0b87af81e1 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:25.747836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89a0ad-6ecb-496d-9d01-8d0b87af81e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:25.748108 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89a0ad-6ecb-496d-9d01-8d0b87af81e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:25.748896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89a0ad-6ecb-496d-9d01-8d0b87af81e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:25.749203 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89a0ad-6ecb-496d-9d01-8d0b87af81e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:25.750638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89a0ad-6ecb-496d-9d01-8d0b87af81e1 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:25.758429 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 628/1264] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:45:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:25.764885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675895b3-f5c6-4576-a8b9-72d263e12e61 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:25.859760 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675895b3-f5c6-4576-a8b9-72d263e12e61 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:25.892492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab1f13-ff21-44d9-9305-d6a0efd560c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:25.893277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab1f13-ff21-44d9-9305-d6a0efd560c4 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:25.893557 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab1f13-ff21-44d9-9305-d6a0efd560c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:25.893834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab1f13-ff21-44d9-9305-d6a0efd560c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:25.903912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab1f13-ff21-44d9-9305-d6a0efd560c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:25.905377 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab1f13-ff21-44d9-9305-d6a0efd560c4 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:25.921731 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-85ab1f13-ff21-44d9-9305-d6a0efd560c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:45:25.922946 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 637/1265] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:25.928898 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89a0ad-6ecb-496d-9d01-8d0b87af81e1 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:26.025342 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89a0ad-6ecb-496d-9d01-8d0b87af81e1 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:26.058560 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82852934-30d1-4251-8583-adc3acf1ab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:26.059215 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82852934-30d1-4251-8583-adc3acf1ab9d None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:26.059490 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82852934-30d1-4251-8583-adc3acf1ab9d None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:26.059792 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82852934-30d1-4251-8583-adc3acf1ab9d None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:26.060512 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82852934-30d1-4251-8583-adc3acf1ab9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:26.060813 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82852934-30d1-4251-8583-adc3acf1ab9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:26.062173 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82852934-30d1-4251-8583-adc3acf1ab9d None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:26.074076 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 629/1266] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:26.079661 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab1f13-ff21-44d9-9305-d6a0efd560c4 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:26.175261 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab1f13-ff21-44d9-9305-d6a0efd560c4 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:26.208556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d165c85-3390-40e1-892e-894404a47ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:26.209350 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d165c85-3390-40e1-892e-894404a47ed5 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:26.209631 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d165c85-3390-40e1-892e-894404a47ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:26.209908 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d165c85-3390-40e1-892e-894404a47ed5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:26.217242 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d165c85-3390-40e1-892e-894404a47ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:26.218743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d165c85-3390-40e1-892e-894404a47ed5 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:26.232338 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-5d165c85-3390-40e1-892e-894404a47ed5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 11:45:26.233541 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 638/1267] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:26.239461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82852934-30d1-4251-8583-adc3acf1ab9d None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:26.334930 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82852934-30d1-4251-8583-adc3acf1ab9d None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:26.367951 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf61f19-17c0-49d1-874b-a8d94e4a4f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:26.368635 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf61f19-17c0-49d1-874b-a8d94e4a4f0a None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:26.369034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf61f19-17c0-49d1-874b-a8d94e4a4f0a None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:26.369327 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf61f19-17c0-49d1-874b-a8d94e4a4f0a None admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:26.370147 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf61f19-17c0-49d1-874b-a8d94e4a4f0a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:26.370493 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf61f19-17c0-49d1-874b-a8d94e4a4f0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:26.371996 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf61f19-17c0-49d1-874b-a8d94e4a4f0a None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:26.388329 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 630/1268] 10.222.0.52 () {56 vars in 1143 bytes} [Tue Mar 8 11:45:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:26.394116 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d165c85-3390-40e1-892e-894404a47ed5 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:26.488698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d165c85-3390-40e1-892e-894404a47ed5 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:26.521224 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0fd08-bfab-494c-b5db-f102d1a7e2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:26.522009 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0fd08-bfab-494c-b5db-f102d1a7e2e0 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:26.522290 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0fd08-bfab-494c-b5db-f102d1a7e2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:26.522566 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0fd08-bfab-494c-b5db-f102d1a7e2e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:26.533171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0fd08-bfab-494c-b5db-f102d1a7e2e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:26.534619 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0fd08-bfab-494c-b5db-f102d1a7e2e0 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:26.551028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-09f0fd08-bfab-494c-b5db-f102d1a7e2e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:45:26.552255 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 639/1269] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:26.558924 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf61f19-17c0-49d1-874b-a8d94e4a4f0a None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:26.653330 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf61f19-17c0-49d1-874b-a8d94e4a4f0a None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:26.685549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fd04d-4be3-480d-9615-3bb10c4c9e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:26.686202 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fd04d-4be3-480d-9615-3bb10c4c9e50 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:26.686483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fd04d-4be3-480d-9615-3bb10c4c9e50 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:26.686753 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fd04d-4be3-480d-9615-3bb10c4c9e50 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:26.687462 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fd04d-4be3-480d-9615-3bb10c4c9e50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:26.687792 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fd04d-4be3-480d-9615-3bb10c4c9e50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:26.689149 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fd04d-4be3-480d-9615-3bb10c4c9e50 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:26.700417 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 631/1270] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:26.706139 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0fd08-bfab-494c-b5db-f102d1a7e2e0 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:26.802397 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0fd08-bfab-494c-b5db-f102d1a7e2e0 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:26.833766 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbad75-767a-4666-a43a-6b4d658ae31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:26.834549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbad75-767a-4666-a43a-6b4d658ae31f None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:26.834831 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbad75-767a-4666-a43a-6b4d658ae31f None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:26.835104 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbad75-767a-4666-a43a-6b4d658ae31f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:26.841990 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbad75-767a-4666-a43a-6b4d658ae31f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:26.845835 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbad75-767a-4666-a43a-6b4d658ae31f None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:26.856423 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-3dfbad75-767a-4666-a43a-6b4d658ae31f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:45:26.857589 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 640/1271] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:45:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:26.863542 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fd04d-4be3-480d-9615-3bb10c4c9e50 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:26.959467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fd04d-4be3-480d-9615-3bb10c4c9e50 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:26.992805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb861e-d176-4810-8b5d-06e05d5c2edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:26.993464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb861e-d176-4810-8b5d-06e05d5c2edb None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:26.993840 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb861e-d176-4810-8b5d-06e05d5c2edb None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:26.994257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb861e-d176-4810-8b5d-06e05d5c2edb None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:26.995029 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb861e-d176-4810-8b5d-06e05d5c2edb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:26.995338 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb861e-d176-4810-8b5d-06e05d5c2edb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:26.996793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb861e-d176-4810-8b5d-06e05d5c2edb None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:27.008696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 632/1272] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:27.015352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbad75-767a-4666-a43a-6b4d658ae31f None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:27.110984 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbad75-767a-4666-a43a-6b4d658ae31f None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:27.144179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6abee-d740-4920-bf5a-e1c15609ab89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:27.145058 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6abee-d740-4920-bf5a-e1c15609ab89 None admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:27.145337 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6abee-d740-4920-bf5a-e1c15609ab89 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:27.145613 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6abee-d740-4920-bf5a-e1c15609ab89 None admin] PATH_INFO: `/v3/projects/7c390663688b466f98ff480c31ba21bc/users/8855284b10c64b8ca367e3c30b5f66fd/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:27.147637 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6abee-d740-4920-bf5a-e1c15609ab89 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c390663688b466f98ff480c31ba21bc, user_id=8855284b10c64b8ca367e3c30b5f66fd, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:27.149070 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6abee-d740-4920-bf5a-e1c15609ab89 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:27.248292 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 641/1273] 10.222.0.52 () {58 vars in 1439 bytes} [Tue Mar 8 11:45:27 2022] PUT /identity/v3/projects/7c390663688b466f98ff480c31ba21bc/users/8855284b10c64b8ca367e3c30b5f66fd/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:45:29.510408 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b74072-b6c1-493d-aaeb-087b1d122877 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:29.511207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b74072-b6c1-493d-aaeb-087b1d122877 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:29.511207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b74072-b6c1-493d-aaeb-087b1d122877 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:29.512943 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 633/1274] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:45:29.518140 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af1dc1-6ebe-499b-b990-a4e126af6fbd None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:29.518558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af1dc1-6ebe-499b-b990-a4e126af6fbd None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:29.518689 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af1dc1-6ebe-499b-b990-a4e126af6fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:29.535722 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-04af1dc1-6ebe-499b-b990-a4e126af6fbd None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:45:29.536913 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-04af1dc1-6ebe-499b-b990-a4e126af6fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:45:29.599542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 642/1275] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:45:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:45:29.623490 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b74072-b6c1-493d-aaeb-087b1d122877 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:29.720630 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b74072-b6c1-493d-aaeb-087b1d122877 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:29.752014 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fe765-0153-4a54-b3b2-97b942ef0a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:29.752804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe765-0153-4a54-b3b2-97b942ef0a2b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:29.753090 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe765-0153-4a54-b3b2-97b942ef0a2b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:29.753369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe765-0153-4a54-b3b2-97b942ef0a2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:29.763888 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fe765-0153-4a54-b3b2-97b942ef0a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 11:45:29.770653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-055fe765-0153-4a54-b3b2-97b942ef0a2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 11:45:29.771848 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 634/1276] 10.222.0.52 () {56 vars in 1096 bytes} [Tue Mar 8 11:45:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:29.778698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af1dc1-6ebe-499b-b990-a4e126af6fbd None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:29.872508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af1dc1-6ebe-499b-b990-a4e126af6fbd None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:29.906074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a68b8-7620-4244-8646-6ad0b52332f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:29.906736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a68b8-7620-4244-8646-6ad0b52332f6 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:29.907015 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a68b8-7620-4244-8646-6ad0b52332f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:29.907290 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a68b8-7620-4244-8646-6ad0b52332f6 None admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:29.908059 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a68b8-7620-4244-8646-6ad0b52332f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:29.908364 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a68b8-7620-4244-8646-6ad0b52332f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:29.909728 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a68b8-7620-4244-8646-6ad0b52332f6 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:29.917567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 643/1277] 10.222.0.52 () {56 vars in 1099 bytes} [Tue Mar 8 11:45:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:29.923388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fe765-0153-4a54-b3b2-97b942ef0a2b None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:30.021837 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fe765-0153-4a54-b3b2-97b942ef0a2b None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:30.053566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76b1a7-189f-4621-8946-2b3caf7fd10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:30.054347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76b1a7-189f-4621-8946-2b3caf7fd10a None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:30.054627 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76b1a7-189f-4621-8946-2b3caf7fd10a None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:30.054896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76b1a7-189f-4621-8946-2b3caf7fd10a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:30.066435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76b1a7-189f-4621-8946-2b3caf7fd10a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:30.067895 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76b1a7-189f-4621-8946-2b3caf7fd10a None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:30.084280 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-0b76b1a7-189f-4621-8946-2b3caf7fd10a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:45:30.085419 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 635/1278] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:30.091179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a68b8-7620-4244-8646-6ad0b52332f6 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:30.189602 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a68b8-7620-4244-8646-6ad0b52332f6 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:30.222339 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57232573-7d36-4b3d-bfe1-10026ceb32f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:30.228118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57232573-7d36-4b3d-bfe1-10026ceb32f3 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:30.228118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57232573-7d36-4b3d-bfe1-10026ceb32f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:30.228118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57232573-7d36-4b3d-bfe1-10026ceb32f3 None admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:30.228118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57232573-7d36-4b3d-bfe1-10026ceb32f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:30.228118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57232573-7d36-4b3d-bfe1-10026ceb32f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:30.228118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57232573-7d36-4b3d-bfe1-10026ceb32f3 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:30.237483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 644/1279] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:30.243070 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76b1a7-189f-4621-8946-2b3caf7fd10a None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:30.340576 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76b1a7-189f-4621-8946-2b3caf7fd10a None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:30.372083 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e114f0-2c17-46ed-aa09-eb281e1fe1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:30.372873 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e114f0-2c17-46ed-aa09-eb281e1fe1bf None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:30.373155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e114f0-2c17-46ed-aa09-eb281e1fe1bf None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:30.373429 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e114f0-2c17-46ed-aa09-eb281e1fe1bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:30.380552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e114f0-2c17-46ed-aa09-eb281e1fe1bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:30.381971 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e114f0-2c17-46ed-aa09-eb281e1fe1bf None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:30.396125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-c9e114f0-2c17-46ed-aa09-eb281e1fe1bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 11:45:30.397275 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 636/1280] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:30.403360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57232573-7d36-4b3d-bfe1-10026ceb32f3 None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:30.498493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57232573-7d36-4b3d-bfe1-10026ceb32f3 None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:30.531420 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb82825-1a6d-44de-8403-c3e4db21e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:30.532188 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb82825-1a6d-44de-8403-c3e4db21e9ad None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:30.532441 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb82825-1a6d-44de-8403-c3e4db21e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:30.532713 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb82825-1a6d-44de-8403-c3e4db21e9ad None admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:30.533562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb82825-1a6d-44de-8403-c3e4db21e9ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:30.533869 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb82825-1a6d-44de-8403-c3e4db21e9ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:30.535301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb82825-1a6d-44de-8403-c3e4db21e9ad None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:30.554621 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 645/1281] 10.222.0.52 () {56 vars in 1143 bytes} [Tue Mar 8 11:45:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:30.561507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e114f0-2c17-46ed-aa09-eb281e1fe1bf None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:30.670500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e114f0-2c17-46ed-aa09-eb281e1fe1bf None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:30.706497 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60866aa8-7cbc-4882-8f80-9353c91489cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:30.707162 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60866aa8-7cbc-4882-8f80-9353c91489cb None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:30.707442 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60866aa8-7cbc-4882-8f80-9353c91489cb None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:30.707740 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60866aa8-7cbc-4882-8f80-9353c91489cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:30.777719 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60866aa8-7cbc-4882-8f80-9353c91489cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:30.779189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60866aa8-7cbc-4882-8f80-9353c91489cb None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:30.882208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 637/1282] 10.222.0.52 () {58 vars in 1282 bytes} [Tue Mar 8 11:45:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 11:45:30.888463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb82825-1a6d-44de-8403-c3e4db21e9ad None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:30.987274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb82825-1a6d-44de-8403-c3e4db21e9ad None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:31.022311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6340f-d540-4890-9c6c-2ac163fd359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:31.023097 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6340f-d540-4890-9c6c-2ac163fd359a None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:31.023376 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6340f-d540-4890-9c6c-2ac163fd359a None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:31.023710 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6340f-d540-4890-9c6c-2ac163fd359a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:31.034412 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6340f-d540-4890-9c6c-2ac163fd359a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:31.035903 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6340f-d540-4890-9c6c-2ac163fd359a None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:31.052949 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-a9b6340f-d540-4890-9c6c-2ac163fd359a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 11:45:31.054352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 646/1283] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:45:31.060065 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60866aa8-7cbc-4882-8f80-9353c91489cb None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:31.153565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60866aa8-7cbc-4882-8f80-9353c91489cb None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:31.188618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24688ae6-d948-4dbc-8e41-64f1ad1bce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:31.189387 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24688ae6-d948-4dbc-8e41-64f1ad1bce05 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:31.189668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24688ae6-d948-4dbc-8e41-64f1ad1bce05 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:31.189938 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24688ae6-d948-4dbc-8e41-64f1ad1bce05 None admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:31.192145 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24688ae6-d948-4dbc-8e41-64f1ad1bce05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:31.192145 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24688ae6-d948-4dbc-8e41-64f1ad1bce05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:31.192485 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24688ae6-d948-4dbc-8e41-64f1ad1bce05 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:31.205720 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 638/1284] 10.222.0.52 () {56 vars in 1109 bytes} [Tue Mar 8 11:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:31.211356 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6340f-d540-4890-9c6c-2ac163fd359a None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:31.320238 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6340f-d540-4890-9c6c-2ac163fd359a None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:31.357989 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8121fa-3129-40d2-a63e-c07831c50b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:31.358772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8121fa-3129-40d2-a63e-c07831c50b0d None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:31.359054 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8121fa-3129-40d2-a63e-c07831c50b0d None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:31.359442 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8121fa-3129-40d2-a63e-c07831c50b0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:31.368204 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8121fa-3129-40d2-a63e-c07831c50b0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:31.369736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8121fa-3129-40d2-a63e-c07831c50b0d None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:31.384263 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING keystone.server.flask.application [None req-7d8121fa-3129-40d2-a63e-c07831c50b0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 11:45:31.386600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 647/1285] 10.222.0.52 () {56 vars in 1111 bytes} [Tue Mar 8 11:45:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 11:45:31.392576 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24688ae6-d948-4dbc-8e41-64f1ad1bce05 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:31.496373 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24688ae6-d948-4dbc-8e41-64f1ad1bce05 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:31.530678 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a8376-9181-4a68-9369-667c3dc5c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:31.531347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a8376-9181-4a68-9369-667c3dc5c16b None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:31.531662 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a8376-9181-4a68-9369-667c3dc5c16b None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:31.532043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a8376-9181-4a68-9369-667c3dc5c16b None admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:31.533135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a8376-9181-4a68-9369-667c3dc5c16b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:31.533450 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a8376-9181-4a68-9369-667c3dc5c16b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:31.535018 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a8376-9181-4a68-9369-667c3dc5c16b None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:31.547542 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 639/1286] 10.222.0.52 () {56 vars in 1148 bytes} [Tue Mar 8 11:45:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:31.555797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8121fa-3129-40d2-a63e-c07831c50b0d None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:31.678895 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8121fa-3129-40d2-a63e-c07831c50b0d None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:31.716838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59727619-dcc2-4dc8-865f-99cdf1be2376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:31.719405 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59727619-dcc2-4dc8-865f-99cdf1be2376 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:31.719727 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59727619-dcc2-4dc8-865f-99cdf1be2376 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:31.720012 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59727619-dcc2-4dc8-865f-99cdf1be2376 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:31.721871 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59727619-dcc2-4dc8-865f-99cdf1be2376 None admin] RBAC: Adding query filter params (role.id=c2642d38bc964424a5edc330e0d4471d, scope.project.id=7c390663688b466f98ff480c31ba21bc, user.id=8855284b10c64b8ca367e3c30b5f66fd) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:31.722191 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59727619-dcc2-4dc8-865f-99cdf1be2376 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:31.723825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59727619-dcc2-4dc8-865f-99cdf1be2376 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:31.730345 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 648/1287] 10.222.0.52 () {56 vars in 1374 bytes} [Tue Mar 8 11:45:31 2022] GET /identity/v3/role_assignments?user.id=8855284b10c64b8ca367e3c30b5f66fd&scope.project.id=7c390663688b466f98ff480c31ba21bc&role.id=c2642d38bc964424a5edc330e0d4471d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:34.120240 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a1630-af76-4783-b2ae-c56b29386fe9 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:34.120770 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a1630-af76-4783-b2ae-c56b29386fe9 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:34.120858 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a1630-af76-4783-b2ae-c56b29386fe9 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:34.122564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 640/1288] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:45:34.127935 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290bcaa-3aac-4586-9087-0cbb34ee4fa0 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:34.135764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290bcaa-3aac-4586-9087-0cbb34ee4fa0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:34.135764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290bcaa-3aac-4586-9087-0cbb34ee4fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:34.146525 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-e290bcaa-3aac-4586-9087-0cbb34ee4fa0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:45:34.147750 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-e290bcaa-3aac-4586-9087-0cbb34ee4fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:45:34.212397 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 649/1289] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:45:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 11:45:34.234940 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a1630-af76-4783-b2ae-c56b29386fe9 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:34.332074 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a1630-af76-4783-b2ae-c56b29386fe9 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:34.364372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d11d4b-5dbf-4b01-a8f1-4a38217ecb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:34.365622 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d11d4b-5dbf-4b01-a8f1-4a38217ecb8c None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:34.365622 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d11d4b-5dbf-4b01-a8f1-4a38217ecb8c None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:34.365898 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d11d4b-5dbf-4b01-a8f1-4a38217ecb8c None admin] PATH_INFO: `/v3/services/placement` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:34.366455 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d11d4b-5dbf-4b01-a8f1-4a38217ecb8c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:34.367840 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d11d4b-5dbf-4b01-a8f1-4a38217ecb8c None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:34.379357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-53d11d4b-5dbf-4b01-a8f1-4a38217ecb8c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 08 11:45:34.380487 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 641/1290] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 11:45:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:34.387083 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290bcaa-3aac-4586-9087-0cbb34ee4fa0 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:34.481012 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290bcaa-3aac-4586-9087-0cbb34ee4fa0 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:34.513839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07edb4-3a0b-4783-ad1c-52031bcd494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:34.514489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07edb4-3a0b-4783-ad1c-52031bcd494e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:34.514773 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07edb4-3a0b-4783-ad1c-52031bcd494e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:34.515081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07edb4-3a0b-4783-ad1c-52031bcd494e None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:34.515816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07edb4-3a0b-4783-ad1c-52031bcd494e None admin] RBAC: Adding query filter params (name=placement) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:34.516126 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07edb4-3a0b-4783-ad1c-52031bcd494e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:34.517497 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07edb4-3a0b-4783-ad1c-52031bcd494e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:34.522102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 650/1291] 10.222.0.52 () {56 vars in 1116 bytes} [Tue Mar 8 11:45:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:34.528733 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d11d4b-5dbf-4b01-a8f1-4a38217ecb8c None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:34.625055 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d11d4b-5dbf-4b01-a8f1-4a38217ecb8c None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:34.657503 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f000ae-9094-4c8e-a422-9807e960e3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:34.658092 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f000ae-9094-4c8e-a422-9807e960e3b2 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:34.658370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f000ae-9094-4c8e-a422-9807e960e3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:34.658763 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f000ae-9094-4c8e-a422-9807e960e3b2 None admin] PATH_INFO: `/v3/services` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:34.659395 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f000ae-9094-4c8e-a422-9807e960e3b2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:34.659724 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f000ae-9094-4c8e-a422-9807e960e3b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:34.663284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f000ae-9094-4c8e-a422-9807e960e3b2 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:34.665412 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 642/1292] 10.222.0.52 () {56 vars in 1116 bytes} [Tue Mar 8 11:45:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:36.933671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7a880-2bb6-492c-ae87-0bf69ae89513 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:36.934199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7a880-2bb6-492c-ae87-0bf69ae89513 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:36.934199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7a880-2bb6-492c-ae87-0bf69ae89513 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:36.936049 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 651/1293] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:45:36.941326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ff41e-0a2b-4b61-a6f3-52f9a80cddc8 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:36.941735 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ff41e-0a2b-4b61-a6f3-52f9a80cddc8 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:36.941993 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ff41e-0a2b-4b61-a6f3-52f9a80cddc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:36.958463 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-c53ff41e-0a2b-4b61-a6f3-52f9a80cddc8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:45:36.959709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c53ff41e-0a2b-4b61-a6f3-52f9a80cddc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:45:37.024769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 643/1294] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:45:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:45:37.048418 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7a880-2bb6-492c-ae87-0bf69ae89513 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:37.145882 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7a880-2bb6-492c-ae87-0bf69ae89513 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:37.178415 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567d23a-1033-4c90-8bcc-af2661cc1b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:37.179075 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567d23a-1033-4c90-8bcc-af2661cc1b03 None admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:37.179355 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567d23a-1033-4c90-8bcc-af2661cc1b03 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:37.179656 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567d23a-1033-4c90-8bcc-af2661cc1b03 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:37.180377 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567d23a-1033-4c90-8bcc-af2661cc1b03 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:37.181743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567d23a-1033-4c90-8bcc-af2661cc1b03 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:37.253911 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 652/1295] 10.222.0.52 () {60 vars in 1141 bytes} [Tue Mar 8 11:45:37 2022] POST /identity/v3/services => generated 246 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:45:39.588272 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29654545-a0fe-4140-a3ab-45bcf3a307fa None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:39.588895 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29654545-a0fe-4140-a3ab-45bcf3a307fa None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:39.589026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29654545-a0fe-4140-a3ab-45bcf3a307fa None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:39.590733 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 644/1296] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:45:39.596103 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b606906-d385-414b-bf93-fc955055feb8 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:39.596538 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b606906-d385-414b-bf93-fc955055feb8 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:39.596646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b606906-d385-414b-bf93-fc955055feb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:39.614246 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-6b606906-d385-414b-bf93-fc955055feb8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:45:39.615423 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-6b606906-d385-414b-bf93-fc955055feb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:45:39.684489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 653/1297] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:45:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:45:39.706874 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29654545-a0fe-4140-a3ab-45bcf3a307fa None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:39.801718 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29654545-a0fe-4140-a3ab-45bcf3a307fa None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:39.833886 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2719c8-9048-444f-a537-30a1bbb27a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:39.834690 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2719c8-9048-444f-a537-30a1bbb27a22 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:39.834968 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2719c8-9048-444f-a537-30a1bbb27a22 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:39.835238 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2719c8-9048-444f-a537-30a1bbb27a22 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:39.835914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2719c8-9048-444f-a537-30a1bbb27a22 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:39.837276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2719c8-9048-444f-a537-30a1bbb27a22 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:39.848854 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-4b2719c8-9048-444f-a537-30a1bbb27a22 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 08 11:45:39.849992 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 645/1298] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 11:45:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:39.856714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b606906-d385-414b-bf93-fc955055feb8 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:39.950846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b606906-d385-414b-bf93-fc955055feb8 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:39.983896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b570e8-7194-419b-929d-923c0df4cd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:39.984566 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b570e8-7194-419b-929d-923c0df4cd5e None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:39.984845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b570e8-7194-419b-929d-923c0df4cd5e None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:39.985117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b570e8-7194-419b-929d-923c0df4cd5e None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:39.985808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b570e8-7194-419b-929d-923c0df4cd5e None admin] RBAC: Adding query filter params (name=placement) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:39.986113 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b570e8-7194-419b-929d-923c0df4cd5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:39.987480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b570e8-7194-419b-929d-923c0df4cd5e None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:39.992472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 654/1299] 10.222.0.52 () {56 vars in 1116 bytes} [Tue Mar 8 11:45:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:39.998573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2719c8-9048-444f-a537-30a1bbb27a22 None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:40.093300 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2719c8-9048-444f-a537-30a1bbb27a22 None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:40.125213 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545032b-250f-4224-a5f4-f00844751216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:40.125847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545032b-250f-4224-a5f4-f00844751216 None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:40.126136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545032b-250f-4224-a5f4-f00844751216 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:40.126410 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545032b-250f-4224-a5f4-f00844751216 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:40.127188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545032b-250f-4224-a5f4-f00844751216 None admin] RBAC: Adding query filter params (interface=public, service_id=f094240079dc454484a4d02eb3442b04, region_id=RegionOne) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:40.127502 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545032b-250f-4224-a5f4-f00844751216 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:40.128901 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545032b-250f-4224-a5f4-f00844751216 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:40.133699 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 646/1300] 10.222.0.52 () {56 vars in 1251 bytes} [Tue Mar 8 11:45:39 2022] GET /identity/v3/endpoints?service_id=f094240079dc454484a4d02eb3442b04&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:40.145812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b570e8-7194-419b-929d-923c0df4cd5e None admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:40.234135 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b570e8-7194-419b-929d-923c0df4cd5e None admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:40.266736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0b6dd-110e-45d4-912d-36eb1841ee95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:40.267388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0b6dd-110e-45d4-912d-36eb1841ee95 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:40.267702 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0b6dd-110e-45d4-912d-36eb1841ee95 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:40.267978 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0b6dd-110e-45d4-912d-36eb1841ee95 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:40.268649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0b6dd-110e-45d4-912d-36eb1841ee95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:40.270022 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0b6dd-110e-45d4-912d-36eb1841ee95 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:40.276618 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 655/1301] 10.222.0.52 () {56 vars in 1087 bytes} [Tue Mar 8 11:45:40 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 11:45:42.558841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fc8ae-b7b5-48b2-bfdb-50e7a441961e None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:42.559353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fc8ae-b7b5-48b2-bfdb-50e7a441961e None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:42.559353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fc8ae-b7b5-48b2-bfdb-50e7a441961e None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:42.561107 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 647/1302] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:45:42.566390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638da4c-7178-445f-a843-80f4699e9ac6 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:42.566850 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638da4c-7178-445f-a843-80f4699e9ac6 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:42.567054 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638da4c-7178-445f-a843-80f4699e9ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:42.583559 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-5638da4c-7178-445f-a843-80f4699e9ac6 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:45:42.584729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-5638da4c-7178-445f-a843-80f4699e9ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:45:42.648612 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 656/1303] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:45:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 11:45:42.673050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fc8ae-b7b5-48b2-bfdb-50e7a441961e None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:42.771388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fc8ae-b7b5-48b2-bfdb-50e7a441961e None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:42.802671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2fe65-de3d-4255-baef-a7f8d232e60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:42.808773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2fe65-de3d-4255-baef-a7f8d232e60e None admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:42.808773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2fe65-de3d-4255-baef-a7f8d232e60e None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:42.808773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2fe65-de3d-4255-baef-a7f8d232e60e None admin] PATH_INFO: `/v3/services/placement` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:42.808773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2fe65-de3d-4255-baef-a7f8d232e60e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:42.808773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2fe65-de3d-4255-baef-a7f8d232e60e None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:42.817345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING keystone.server.flask.application [None req-8ca2fe65-de3d-4255-baef-a7f8d232e60e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 08 11:45:42.818436 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 648/1304] 10.222.0.52 () {56 vars in 1117 bytes} [Tue Mar 8 11:45:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 11:45:42.824841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638da4c-7178-445f-a843-80f4699e9ac6 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:42.918361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638da4c-7178-445f-a843-80f4699e9ac6 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:42.950662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cecf1-f1f2-4e2d-b415-d0928d52e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:42.951314 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cecf1-f1f2-4e2d-b415-d0928d52e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:42.951621 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cecf1-f1f2-4e2d-b415-d0928d52e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:42.951896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cecf1-f1f2-4e2d-b415-d0928d52e4e9 None admin] PATH_INFO: `/v3/services` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:42.952586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cecf1-f1f2-4e2d-b415-d0928d52e4e9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:45:42.952891 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cecf1-f1f2-4e2d-b415-d0928d52e4e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:42.954256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cecf1-f1f2-4e2d-b415-d0928d52e4e9 None admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:42.959331 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 657/1305] 10.222.0.52 () {56 vars in 1116 bytes} [Tue Mar 8 11:45:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:45:42.965578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2fe65-de3d-4255-baef-a7f8d232e60e None admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:45:43.059783 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2fe65-de3d-4255-baef-a7f8d232e60e None admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:45:43.091367 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146341ea-63c2-4a24-9990-b57a192c4620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:45:43.091998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146341ea-63c2-4a24-9990-b57a192c4620 None admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:45:43.092279 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146341ea-63c2-4a24-9990-b57a192c4620 None admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:45:43.092554 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146341ea-63c2-4a24-9990-b57a192c4620 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:45:43.093290 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146341ea-63c2-4a24-9990-b57a192c4620 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:45:43.094658 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146341ea-63c2-4a24-9990-b57a192c4620 None admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:45:43.161025 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 649/1306] 10.222.0.52 () {60 vars in 1144 bytes} [Tue Mar 8 11:45:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:51:42.765834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa734bf-3999-4847-9154-afe618e6b4a5 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:42.765834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa734bf-3999-4847-9154-afe618e6b4a5 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:42.765834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa734bf-3999-4847-9154-afe618e6b4a5 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:42.767029 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396ba73-ceaf-4044-964b-fbe2ac800ec6 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:42.767029 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396ba73-ceaf-4044-964b-fbe2ac800ec6 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:42.767029 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396ba73-ceaf-4044-964b-fbe2ac800ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:42.768669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 658/1307] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:51:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:51:42.858212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-c396ba73-ceaf-4044-964b-fbe2ac800ec6 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:51:42.859570 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c396ba73-ceaf-4044-964b-fbe2ac800ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:42.984939 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 650/1308] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:51:43.009464 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa734bf-3999-4847-9154-afe618e6b4a5 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:51:43.011321 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-afa734bf-3999-4847-9154-afe618e6b4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:43.153986 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa734bf-3999-4847-9154-afe618e6b4a5 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:51:43.262729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e99bc-5a26-49c0-8337-a165b4ac6c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:51:43.263743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e99bc-5a26-49c0-8337-a165b4ac6c1b admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:43.264032 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e99bc-5a26-49c0-8337-a165b4ac6c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:43.264307 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e99bc-5a26-49c0-8337-a165b4ac6c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:43.265039 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e99bc-5a26-49c0-8337-a165b4ac6c1b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:51:43.266843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING py.warnings [None req-fe9e99bc-5a26-49c0-8337-a165b4ac6c1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 11:51:43.266843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: warnings.warn(msg) Mar 08 11:51:43.266843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: Mar 08 11:51:43.268024 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e99bc-5a26-49c0-8337-a165b4ac6c1b admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:51:43.289254 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 659/1309] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:51:43 2022] GET /identity/v3/projects => generated 2553 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 11:51:45.670349 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89110742-6b07-49bd-a1c2-c0a7a4195ec8 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:45.670868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89110742-6b07-49bd-a1c2-c0a7a4195ec8 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:45.670868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89110742-6b07-49bd-a1c2-c0a7a4195ec8 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:45.672889 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 651/1310] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:51:45.678610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac37b3-9481-4f25-85bd-b25536343437 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:45.679039 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac37b3-9481-4f25-85bd-b25536343437 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:45.679165 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac37b3-9481-4f25-85bd-b25536343437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:45.753281 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-beac37b3-9481-4f25-85bd-b25536343437 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:51:45.754796 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-beac37b3-9481-4f25-85bd-b25536343437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:45.859926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 660/1311] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:51:45.925326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e0418-ae77-47b6-90b0-a6df5906958c None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:45.925873 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e0418-ae77-47b6-90b0-a6df5906958c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:45.926401 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e0418-ae77-47b6-90b0-a6df5906958c None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:45.928889 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 652/1312] 10.222.0.52 () {54 vars in 964 bytes} [Tue Mar 8 11:51:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:51:45.938397 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2bef6-c195-46fb-89bd-72775d24b483 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:45.941455 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2bef6-c195-46fb-89bd-72775d24b483 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:45.941455 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2bef6-c195-46fb-89bd-72775d24b483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:46.026264 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-34f2bef6-c195-46fb-89bd-72775d24b483 None None] MFA Rules not processed for user `a5f8507c0ae342f7a3e97b48363ad606`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:51:46.027685 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-34f2bef6-c195-46fb-89bd-72775d24b483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:46.110192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 661/1313] 10.222.0.52 () {58 vars in 1061 bytes} [Tue Mar 8 11:51:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:51:46.119469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e0418-ae77-47b6-90b0-a6df5906958c None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:51:46.121029 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ec4e0418-ae77-47b6-90b0-a6df5906958c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:46.230533 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e0418-ae77-47b6-90b0-a6df5906958c None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:51:46.303950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fc2d3-8824-492e-97e7-026bfeb5c864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:51:46.304717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fc2d3-8824-492e-97e7-026bfeb5c864 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:46.305074 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fc2d3-8824-492e-97e7-026bfeb5c864 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:46.305417 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fc2d3-8824-492e-97e7-026bfeb5c864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:46.307126 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a02fc2d3-8824-492e-97e7-026bfeb5c864 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:46.415404 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fc2d3-8824-492e-97e7-026bfeb5c864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:51:46.417041 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fc2d3-8824-492e-97e7-026bfeb5c864 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:51:46.435031 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 653/1314] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:51:49.086194 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c969e3-2931-4349-a188-ffb730c9efa8 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:49.086727 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c969e3-2931-4349-a188-ffb730c9efa8 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:49.086727 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c969e3-2931-4349-a188-ffb730c9efa8 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:49.088589 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 662/1315] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:51:49.093786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177d20a-8b7c-46aa-95da-c60cb01b8045 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:49.094175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177d20a-8b7c-46aa-95da-c60cb01b8045 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:49.094335 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177d20a-8b7c-46aa-95da-c60cb01b8045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:49.157935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-8177d20a-8b7c-46aa-95da-c60cb01b8045 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:51:49.159566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-8177d20a-8b7c-46aa-95da-c60cb01b8045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:49.266187 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 654/1316] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:51:49.304064 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c969e3-2931-4349-a188-ffb730c9efa8 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:51:49.305616 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-07c969e3-2931-4349-a188-ffb730c9efa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:49.404291 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c969e3-2931-4349-a188-ffb730c9efa8 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:51:49.473042 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e193e31-89dc-4a59-965f-f4b6e4a7733e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:51:49.473673 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e193e31-89dc-4a59-965f-f4b6e4a7733e service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:49.473956 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e193e31-89dc-4a59-965f-f4b6e4a7733e service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:49.474224 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e193e31-89dc-4a59-965f-f4b6e4a7733e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:49.475865 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-7e193e31-89dc-4a59-965f-f4b6e4a7733e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:49.583636 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e193e31-89dc-4a59-965f-f4b6e4a7733e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:51:49.585115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e193e31-89dc-4a59-965f-f4b6e4a7733e service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:51:49.603238 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 663/1317] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:51:52.374779 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff633e-e64f-49c6-bc52-5aef01527e8c None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:52.375330 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff633e-e64f-49c6-bc52-5aef01527e8c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:52.375574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff633e-e64f-49c6-bc52-5aef01527e8c None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:52.378942 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 655/1318] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:51:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:51:52.385079 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9c489-afd1-49d5-b764-b66fb290f1eb None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:52.385515 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9c489-afd1-49d5-b764-b66fb290f1eb None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:52.385626 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9c489-afd1-49d5-b764-b66fb290f1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:52.447400 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-82d9c489-afd1-49d5-b764-b66fb290f1eb None None] MFA Rules not processed for user `c4ec2b31f8a2478ca85a8e4a0973fdc6`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:51:52.448546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-82d9c489-afd1-49d5-b764-b66fb290f1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:52.540364 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 664/1319] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:51:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:51:52.597093 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16100d64-e51f-4c51-8f12-ba53c77ead5f None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:52.597433 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16100d64-e51f-4c51-8f12-ba53c77ead5f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:52.597717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16100d64-e51f-4c51-8f12-ba53c77ead5f None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:52.599505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 656/1320] 10.222.0.52 () {54 vars in 964 bytes} [Tue Mar 8 11:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:51:52.605633 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bacbc2-7071-4040-b939-fcad6724d250 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:52.605917 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bacbc2-7071-4040-b939-fcad6724d250 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:52.606197 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bacbc2-7071-4040-b939-fcad6724d250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:52.678811 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-b0bacbc2-7071-4040-b939-fcad6724d250 None None] MFA Rules not processed for user `a5f8507c0ae342f7a3e97b48363ad606`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:51:52.680097 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-b0bacbc2-7071-4040-b939-fcad6724d250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:52.751118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 665/1321] 10.222.0.52 () {58 vars in 1061 bytes} [Tue Mar 8 11:51:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:51:52.760710 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16100d64-e51f-4c51-8f12-ba53c77ead5f None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:51:52.762220 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-16100d64-e51f-4c51-8f12-ba53c77ead5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:52.859446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16100d64-e51f-4c51-8f12-ba53c77ead5f None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:51:52.930736 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a009b4-788d-4c7d-a2f6-ed1f2e392da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:51:52.931377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a009b4-788d-4c7d-a2f6-ed1f2e392da2 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:52.931694 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a009b4-788d-4c7d-a2f6-ed1f2e392da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:52.931966 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a009b4-788d-4c7d-a2f6-ed1f2e392da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:52.933582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-17a009b4-788d-4c7d-a2f6-ed1f2e392da2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:53.035152 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a009b4-788d-4c7d-a2f6-ed1f2e392da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:51:53.036541 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a009b4-788d-4c7d-a2f6-ed1f2e392da2 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:51:53.054805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 657/1322] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:51:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:51:56.491367 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a32d07-7541-4388-ba34-1d85f154abf0 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:56.491950 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a32d07-7541-4388-ba34-1d85f154abf0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:56.491950 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a32d07-7541-4388-ba34-1d85f154abf0 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:56.493655 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 666/1323] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:51:56.498721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd886235-5bd2-4c10-90de-6c9663035ae2 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:56.499115 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd886235-5bd2-4c10-90de-6c9663035ae2 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:56.499266 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd886235-5bd2-4c10-90de-6c9663035ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:56.560819 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-dd886235-5bd2-4c10-90de-6c9663035ae2 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:51:56.568308 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-dd886235-5bd2-4c10-90de-6c9663035ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:56.654338 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 658/1324] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:51:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:51:56.693777 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a32d07-7541-4388-ba34-1d85f154abf0 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:51:56.695293 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-40a32d07-7541-4388-ba34-1d85f154abf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:56.794751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a32d07-7541-4388-ba34-1d85f154abf0 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:51:56.864360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc373f36-c273-428e-833d-ae1778d1fe77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:51:56.865000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc373f36-c273-428e-833d-ae1778d1fe77 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:51:56.865279 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc373f36-c273-428e-833d-ae1778d1fe77 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:51:56.865551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc373f36-c273-428e-833d-ae1778d1fe77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:51:56.867181 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-dc373f36-c273-428e-833d-ae1778d1fe77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:51:56.970524 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc373f36-c273-428e-833d-ae1778d1fe77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:51:56.972040 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc373f36-c273-428e-833d-ae1778d1fe77 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:51:56.989179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 667/1325] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:51:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:52:00.224795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7814ed-9577-4ff0-b7f1-cc04cdfa860d None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:00.225331 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7814ed-9577-4ff0-b7f1-cc04cdfa860d None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:00.225331 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7814ed-9577-4ff0-b7f1-cc04cdfa860d None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:00.227130 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 659/1326] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:00.232619 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8cc0-67e9-47a3-bc02-4ee804d5ff13 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:00.233058 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8cc0-67e9-47a3-bc02-4ee804d5ff13 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:00.233182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8cc0-67e9-47a3-bc02-4ee804d5ff13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:00.297619 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-79cc8cc0-67e9-47a3-bc02-4ee804d5ff13 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:00.298921 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-79cc8cc0-67e9-47a3-bc02-4ee804d5ff13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:00.392193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 668/1327] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:00.428841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7814ed-9577-4ff0-b7f1-cc04cdfa860d None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:00.430371 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ba7814ed-9577-4ff0-b7f1-cc04cdfa860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:00.531005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7814ed-9577-4ff0-b7f1-cc04cdfa860d None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:00.601409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f580a-8180-44c0-addd-7f6af6880e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:00.602060 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f580a-8180-44c0-addd-7f6af6880e15 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:00.602342 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f580a-8180-44c0-addd-7f6af6880e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:00.602618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f580a-8180-44c0-addd-7f6af6880e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:00.604297 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d44f580a-8180-44c0-addd-7f6af6880e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:00.715623 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f580a-8180-44c0-addd-7f6af6880e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:00.717077 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f580a-8180-44c0-addd-7f6af6880e15 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:00.738099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 660/1328] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:52:03.115216 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfe3ae-552b-4db3-9c5c-42d56e09202a None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:03.115812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfe3ae-552b-4db3-9c5c-42d56e09202a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:03.115812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfe3ae-552b-4db3-9c5c-42d56e09202a None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:03.117641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 669/1329] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:03.122917 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81dff6-f99f-469e-af19-55f3b1684ebb None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:03.123326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81dff6-f99f-469e-af19-55f3b1684ebb None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:03.123472 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81dff6-f99f-469e-af19-55f3b1684ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:03.187722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-7d81dff6-f99f-469e-af19-55f3b1684ebb None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:03.189179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-7d81dff6-f99f-469e-af19-55f3b1684ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:03.290722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 661/1330] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:03.326323 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfe3ae-552b-4db3-9c5c-42d56e09202a None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:03.327978 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-6ebfe3ae-552b-4db3-9c5c-42d56e09202a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:03.427829 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfe3ae-552b-4db3-9c5c-42d56e09202a None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:03.496904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6b1b7-1739-4148-ac3f-60a4a522c7ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:03.497545 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6b1b7-1739-4148-ac3f-60a4a522c7ca service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:03.497825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6b1b7-1739-4148-ac3f-60a4a522c7ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:03.498097 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6b1b7-1739-4148-ac3f-60a4a522c7ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:03.499749 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-10f6b1b7-1739-4148-ac3f-60a4a522c7ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:03.603250 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6b1b7-1739-4148-ac3f-60a4a522c7ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:03.604726 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6b1b7-1739-4148-ac3f-60a4a522c7ca service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:03.622369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 670/1331] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:52:06.102723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969396af-650c-46b5-945e-0c1f82e24882 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:06.103285 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969396af-650c-46b5-945e-0c1f82e24882 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:06.103285 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969396af-650c-46b5-945e-0c1f82e24882 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:06.105059 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 662/1332] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:06.110440 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ba42b-73d3-4860-90bb-8ff2e880780e None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:06.110857 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ba42b-73d3-4860-90bb-8ff2e880780e None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:06.110982 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ba42b-73d3-4860-90bb-8ff2e880780e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:06.174870 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-400ba42b-73d3-4860-90bb-8ff2e880780e None None] MFA Rules not processed for user `c4ec2b31f8a2478ca85a8e4a0973fdc6`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:06.176105 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-400ba42b-73d3-4860-90bb-8ff2e880780e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:06.269858 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 671/1333] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:06.305828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969396af-650c-46b5-945e-0c1f82e24882 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:06.307357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-969396af-650c-46b5-945e-0c1f82e24882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:06.411688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969396af-650c-46b5-945e-0c1f82e24882 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:06.482838 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ab4d8-d88a-4db7-8785-db553c435038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:06.483505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ab4d8-d88a-4db7-8785-db553c435038 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:06.483809 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ab4d8-d88a-4db7-8785-db553c435038 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:06.484085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ab4d8-d88a-4db7-8785-db553c435038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:06.486220 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-995ab4d8-d88a-4db7-8785-db553c435038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:06.590909 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ab4d8-d88a-4db7-8785-db553c435038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:06.592387 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ab4d8-d88a-4db7-8785-db553c435038 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:06.609688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 663/1334] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 11:52:09.336911 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77627c8a-734f-4ee6-a239-3505d5e079d1 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:09.337472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77627c8a-734f-4ee6-a239-3505d5e079d1 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:09.337569 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77627c8a-734f-4ee6-a239-3505d5e079d1 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:09.339480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 672/1335] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:09.345520 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b18332-5305-41ae-a0e6-9cbe72643922 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:09.345976 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b18332-5305-41ae-a0e6-9cbe72643922 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:09.346073 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b18332-5305-41ae-a0e6-9cbe72643922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:09.407892 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-e0b18332-5305-41ae-a0e6-9cbe72643922 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:09.409088 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e0b18332-5305-41ae-a0e6-9cbe72643922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:09.499983 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 664/1336] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:09.536507 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77627c8a-734f-4ee6-a239-3505d5e079d1 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:09.538152 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-77627c8a-734f-4ee6-a239-3505d5e079d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:09.645622 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77627c8a-734f-4ee6-a239-3505d5e079d1 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:09.718074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c3a92-ec0c-48d9-bccf-af169de781ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:09.718729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c3a92-ec0c-48d9-bccf-af169de781ac service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:09.719007 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c3a92-ec0c-48d9-bccf-af169de781ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:09.719279 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c3a92-ec0c-48d9-bccf-af169de781ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:09.721310 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c41c3a92-ec0c-48d9-bccf-af169de781ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:09.831432 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c3a92-ec0c-48d9-bccf-af169de781ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:09.832857 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c3a92-ec0c-48d9-bccf-af169de781ac service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:09.850495 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 673/1337] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:52:12.201154 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ed78d-753b-4b53-bad3-2c959f47f9c9 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:12.201602 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ed78d-753b-4b53-bad3-2c959f47f9c9 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:12.201742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ed78d-753b-4b53-bad3-2c959f47f9c9 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:12.203584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 665/1338] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:12.209067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7449e-d1c0-4dae-9b2b-c3aa952588d7 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:12.209563 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7449e-d1c0-4dae-9b2b-c3aa952588d7 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:12.209668 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7449e-d1c0-4dae-9b2b-c3aa952588d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:12.272697 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-2ec7449e-d1c0-4dae-9b2b-c3aa952588d7 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:12.273884 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-2ec7449e-d1c0-4dae-9b2b-c3aa952588d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:12.365284 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 674/1339] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:12.404960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ed78d-753b-4b53-bad3-2c959f47f9c9 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:12.406483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-243ed78d-753b-4b53-bad3-2c959f47f9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:12.506271 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ed78d-753b-4b53-bad3-2c959f47f9c9 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:12.575757 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eef185-b74a-4f0c-9899-c96d84390a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:12.576400 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eef185-b74a-4f0c-9899-c96d84390a9b service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:12.576686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eef185-b74a-4f0c-9899-c96d84390a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:12.576959 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eef185-b74a-4f0c-9899-c96d84390a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:12.578591 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-79eef185-b74a-4f0c-9899-c96d84390a9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:12.685375 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eef185-b74a-4f0c-9899-c96d84390a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:12.686822 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eef185-b74a-4f0c-9899-c96d84390a9b service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:12.705895 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 666/1340] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:52:15.573171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c494a2-21cd-4ca0-b651-38bb498d9d34 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:15.573845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c494a2-21cd-4ca0-b651-38bb498d9d34 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:15.573845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c494a2-21cd-4ca0-b651-38bb498d9d34 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:15.575453 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 675/1341] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:15.581458 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f2437-ee43-4a4e-bb71-d27f36d3e9fb None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:15.581866 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f2437-ee43-4a4e-bb71-d27f36d3e9fb None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:15.582012 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f2437-ee43-4a4e-bb71-d27f36d3e9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:15.651886 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-ee0f2437-ee43-4a4e-bb71-d27f36d3e9fb None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:15.653093 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ee0f2437-ee43-4a4e-bb71-d27f36d3e9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:15.754022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 667/1342] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 11:52:15.790477 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c494a2-21cd-4ca0-b651-38bb498d9d34 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:15.792644 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f1c494a2-21cd-4ca0-b651-38bb498d9d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:15.883223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c494a2-21cd-4ca0-b651-38bb498d9d34 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:15.886625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58785dca-156e-439a-b68d-274e21e0059d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:15.887540 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58785dca-156e-439a-b68d-274e21e0059d service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:15.887824 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58785dca-156e-439a-b68d-274e21e0059d service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:15.888097 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58785dca-156e-439a-b68d-274e21e0059d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:15.897204 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58785dca-156e-439a-b68d-274e21e0059d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:15.898628 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58785dca-156e-439a-b68d-274e21e0059d service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:15.907700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 676/1343] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:52:20.388735 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162612c5-5562-4106-b789-a50c70b05256 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:20.389242 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162612c5-5562-4106-b789-a50c70b05256 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:20.389242 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162612c5-5562-4106-b789-a50c70b05256 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:20.390953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 668/1344] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:20.396855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0b68-4210-47a2-b31a-400a1a58fcd8 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:20.397265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0b68-4210-47a2-b31a-400a1a58fcd8 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:20.397418 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0b68-4210-47a2-b31a-400a1a58fcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:20.427105 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-8e3d0b68-4210-47a2-b31a-400a1a58fcd8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:20.428317 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-8e3d0b68-4210-47a2-b31a-400a1a58fcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:20.503174 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 677/1345] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:20.541650 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162612c5-5562-4106-b789-a50c70b05256 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:20.553609 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162612c5-5562-4106-b789-a50c70b05256 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:20.557218 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f4c52-140d-499a-8d28-8c2b19a0597c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:20.557989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f4c52-140d-499a-8d28-8c2b19a0597c service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:20.558280 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f4c52-140d-499a-8d28-8c2b19a0597c service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:20.558560 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f4c52-140d-499a-8d28-8c2b19a0597c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:20.570623 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f4c52-140d-499a-8d28-8c2b19a0597c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:20.572156 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f4c52-140d-499a-8d28-8c2b19a0597c service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:20.585598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 669/1346] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:52:23.837717 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b2f87-acee-4671-b8a6-7f8ef85d05a1 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:23.838283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b2f87-acee-4671-b8a6-7f8ef85d05a1 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:23.838283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b2f87-acee-4671-b8a6-7f8ef85d05a1 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:23.840185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 678/1347] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:23.846035 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fd391-4f32-42c9-b0bc-b29bd1213e6b None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:23.846459 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fd391-4f32-42c9-b0bc-b29bd1213e6b None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:23.846592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fd391-4f32-42c9-b0bc-b29bd1213e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:23.864723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-912fd391-4f32-42c9-b0bc-b29bd1213e6b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:23.865927 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-912fd391-4f32-42c9-b0bc-b29bd1213e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:23.873839 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 670/1348] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:23.911988 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b2f87-acee-4671-b8a6-7f8ef85d05a1 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:23.913691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-647b2f87-acee-4671-b8a6-7f8ef85d05a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:23.926498 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b2f87-acee-4671-b8a6-7f8ef85d05a1 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:23.929990 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ece84b-88ec-445d-8101-7c1f43cce4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:23.930628 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece84b-88ec-445d-8101-7c1f43cce4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:23.930914 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece84b-88ec-445d-8101-7c1f43cce4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:23.931198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece84b-88ec-445d-8101-7c1f43cce4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:23.941300 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ece84b-88ec-445d-8101-7c1f43cce4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:23.942776 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ece84b-88ec-445d-8101-7c1f43cce4a8 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:23.952593 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 679/1349] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:52:28.899190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a5e8-1558-46ac-aa34-3dc3b2aed9fb None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:28.899736 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a5e8-1558-46ac-aa34-3dc3b2aed9fb None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:28.899856 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a5e8-1558-46ac-aa34-3dc3b2aed9fb None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:28.901660 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 671/1350] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:28.907455 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6102c-6b7b-4e22-94bd-a8bf7eef4178 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:28.907922 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6102c-6b7b-4e22-94bd-a8bf7eef4178 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:28.908011 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6102c-6b7b-4e22-94bd-a8bf7eef4178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:28.926052 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-69d6102c-6b7b-4e22-94bd-a8bf7eef4178 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:28.927251 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-69d6102c-6b7b-4e22-94bd-a8bf7eef4178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:28.934985 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 680/1351] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:28.972675 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85a5e8-1558-46ac-aa34-3dc3b2aed9fb None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:28.983082 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85a5e8-1558-46ac-aa34-3dc3b2aed9fb None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:28.987305 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b7370-3f0c-41c0-8c2e-28c4a30b2c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:28.987981 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7370-3f0c-41c0-8c2e-28c4a30b2c6f service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:28.988259 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7370-3f0c-41c0-8c2e-28c4a30b2c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:28.988531 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7370-3f0c-41c0-8c2e-28c4a30b2c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:28.997287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b7370-3f0c-41c0-8c2e-28c4a30b2c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:28.998725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b7370-3f0c-41c0-8c2e-28c4a30b2c6f service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:29.008799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 672/1352] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:52:34.372255 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e782315-10c0-4358-8c05-0bffe3378dbb None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:34.373182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e782315-10c0-4358-8c05-0bffe3378dbb None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:34.373665 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e782315-10c0-4358-8c05-0bffe3378dbb None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:34.376124 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 681/1353] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 11:52:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:34.380949 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d443e-1b48-4fe0-948c-47e39e19bfbb None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:34.381385 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d443e-1b48-4fe0-948c-47e39e19bfbb None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:34.381497 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d443e-1b48-4fe0-948c-47e39e19bfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:34.461121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-b45d443e-1b48-4fe0-948c-47e39e19bfbb None None] MFA Rules not processed for user `8855284b10c64b8ca367e3c30b5f66fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:34.462783 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b45d443e-1b48-4fe0-948c-47e39e19bfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:34.550034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 673/1354] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 11:52:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:38.993081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c9ca-883e-4015-a34c-37b4ec8dadca None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:38.993641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c9ca-883e-4015-a34c-37b4ec8dadca None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:38.993641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c9ca-883e-4015-a34c-37b4ec8dadca None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:38.995387 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 682/1355] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 11:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:39.000556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed8840-c85d-4f08-b530-1b05035a51f9 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:39.001009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed8840-c85d-4f08-b530-1b05035a51f9 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:39.001106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed8840-c85d-4f08-b530-1b05035a51f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:39.020341 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-85ed8840-c85d-4f08-b530-1b05035a51f9 None None] MFA Rules not processed for user `8855284b10c64b8ca367e3c30b5f66fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:39.021631 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-85ed8840-c85d-4f08-b530-1b05035a51f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:39.031899 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 674/1356] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 11:52:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:40.746902 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca4934-69e4-4fdd-9e12-6703d7a22ef0 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:40.747486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca4934-69e4-4fdd-9e12-6703d7a22ef0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:40.747486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca4934-69e4-4fdd-9e12-6703d7a22ef0 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:40.749244 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 683/1357] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 11:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:40.754460 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d941225-fe5d-4816-88e5-0cf262841305 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:40.754895 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d941225-fe5d-4816-88e5-0cf262841305 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:40.755042 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d941225-fe5d-4816-88e5-0cf262841305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:40.774624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-1d941225-fe5d-4816-88e5-0cf262841305 None None] MFA Rules not processed for user `8855284b10c64b8ca367e3c30b5f66fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:40.775849 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1d941225-fe5d-4816-88e5-0cf262841305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:40.784855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 675/1358] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 11:52:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:44.442408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038936-c130-47b3-9144-e0ad50a768e2 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:44.442937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038936-c130-47b3-9144-e0ad50a768e2 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:44.442937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038936-c130-47b3-9144-e0ad50a768e2 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:44.446977 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 684/1359] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:44.449952 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef0dbd-d9b5-41f8-9e62-e4e18b5c2772 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:44.450366 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef0dbd-d9b5-41f8-9e62-e4e18b5c2772 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:44.450499 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef0dbd-d9b5-41f8-9e62-e4e18b5c2772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:44.469601 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-f9ef0dbd-d9b5-41f8-9e62-e4e18b5c2772 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:44.470778 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f9ef0dbd-d9b5-41f8-9e62-e4e18b5c2772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:44.479054 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 676/1360] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:44.526729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1ee7-a147-41a9-b2c1-ac3deea8a2b8 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:44.527103 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1ee7-a147-41a9-b2c1-ac3deea8a2b8 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:44.527463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1ee7-a147-41a9-b2c1-ac3deea8a2b8 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:44.529544 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 685/1361] 10.222.0.52 () {54 vars in 961 bytes} [Tue Mar 8 11:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:44.535776 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b856e50-500e-47a2-91e5-510f7b3eb3dd None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:44.536068 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b856e50-500e-47a2-91e5-510f7b3eb3dd None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:44.536348 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b856e50-500e-47a2-91e5-510f7b3eb3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:44.584298 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-1b856e50-500e-47a2-91e5-510f7b3eb3dd None None] MFA Rules not processed for user `534fd902f96043068e99ca0537cf57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:44.585518 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1b856e50-500e-47a2-91e5-510f7b3eb3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:44.671169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 677/1362] 10.222.0.52 () {58 vars in 1058 bytes} [Tue Mar 8 11:52:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:44.679362 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a1ee7-a147-41a9-b2c1-ac3deea8a2b8 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:44.697810 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a1ee7-a147-41a9-b2c1-ac3deea8a2b8 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:44.707198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8dffb0-1b40-43f5-900e-892fe23bb42d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:44.708087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dffb0-1b40-43f5-900e-892fe23bb42d service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:44.708371 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dffb0-1b40-43f5-900e-892fe23bb42d service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:44.708639 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dffb0-1b40-43f5-900e-892fe23bb42d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:44.717766 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8dffb0-1b40-43f5-900e-892fe23bb42d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:44.720308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8dffb0-1b40-43f5-900e-892fe23bb42d service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:44.730691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 686/1363] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:52:47.352576 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934cc5c-f921-47db-8efa-c1a239a05e8c None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:47.353128 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934cc5c-f921-47db-8efa-c1a239a05e8c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:47.353128 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934cc5c-f921-47db-8efa-c1a239a05e8c None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:47.354927 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 678/1364] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:47.360594 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8c209-9ab8-4cc1-b09e-8204c2630dbc None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:47.361030 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8c209-9ab8-4cc1-b09e-8204c2630dbc None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:47.361158 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8c209-9ab8-4cc1-b09e-8204c2630dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:47.379302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-25b8c209-9ab8-4cc1-b09e-8204c2630dbc None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:47.380542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-25b8c209-9ab8-4cc1-b09e-8204c2630dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:47.389066 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 687/1365] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:47.433812 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934cc5c-f921-47db-8efa-c1a239a05e8c None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:47.449071 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934cc5c-f921-47db-8efa-c1a239a05e8c None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:47.455306 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af25c4f-a60c-4e9b-b45f-1daa989b1f94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:47.455987 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af25c4f-a60c-4e9b-b45f-1daa989b1f94 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:47.456394 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af25c4f-a60c-4e9b-b45f-1daa989b1f94 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:47.456676 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af25c4f-a60c-4e9b-b45f-1daa989b1f94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:47.465049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af25c4f-a60c-4e9b-b45f-1daa989b1f94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:47.466652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af25c4f-a60c-4e9b-b45f-1daa989b1f94 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:47.476878 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 679/1366] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:52:50.294697 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e60a8f-5faf-4e02-bf4d-37c4de5e18e6 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:50.295222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e60a8f-5faf-4e02-bf4d-37c4de5e18e6 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:50.295222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e60a8f-5faf-4e02-bf4d-37c4de5e18e6 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:50.297227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 688/1367] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:50.302827 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2fee9-6a01-4682-b0a7-d4e51d915490 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:50.303392 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2fee9-6a01-4682-b0a7-d4e51d915490 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:50.303392 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2fee9-6a01-4682-b0a7-d4e51d915490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:50.323904 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-73b2fee9-6a01-4682-b0a7-d4e51d915490 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:50.325128 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-73b2fee9-6a01-4682-b0a7-d4e51d915490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:50.334960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 680/1368] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:50.382556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f98c1-30f3-451d-8790-94a08c7d7571 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:50.383090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f98c1-30f3-451d-8790-94a08c7d7571 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:50.383416 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f98c1-30f3-451d-8790-94a08c7d7571 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:50.385319 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 689/1369] 10.222.0.52 () {54 vars in 961 bytes} [Tue Mar 8 11:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:50.393541 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c337d3-7305-4420-be96-bf62937c0e45 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:50.394066 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c337d3-7305-4420-be96-bf62937c0e45 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:50.394343 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c337d3-7305-4420-be96-bf62937c0e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:50.418391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-20c337d3-7305-4420-be96-bf62937c0e45 None None] MFA Rules not processed for user `534fd902f96043068e99ca0537cf57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:50.419797 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-20c337d3-7305-4420-be96-bf62937c0e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:50.430035 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 681/1370] 10.222.0.52 () {58 vars in 1058 bytes} [Tue Mar 8 11:52:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:50.438297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f98c1-30f3-451d-8790-94a08c7d7571 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:50.453960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f98c1-30f3-451d-8790-94a08c7d7571 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:50.459661 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7761b65-2571-4309-a387-1f23c67e8ba5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:50.460338 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7761b65-2571-4309-a387-1f23c67e8ba5 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:50.460626 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7761b65-2571-4309-a387-1f23c67e8ba5 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:50.460900 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7761b65-2571-4309-a387-1f23c67e8ba5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:50.470389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7761b65-2571-4309-a387-1f23c67e8ba5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:50.472062 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7761b65-2571-4309-a387-1f23c67e8ba5 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:50.482689 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 690/1371] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:52:52.737906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fa9b7-eb92-4ff9-b6db-0659b23f525a None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:52.738461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fa9b7-eb92-4ff9-b6db-0659b23f525a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:52.738461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fa9b7-eb92-4ff9-b6db-0659b23f525a None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:52.740255 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 682/1372] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:52.745669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d80d04-08bb-42a6-91c9-7bb9dc5aa25c None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:52.746081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d80d04-08bb-42a6-91c9-7bb9dc5aa25c None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:52.746222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d80d04-08bb-42a6-91c9-7bb9dc5aa25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:52.767200 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-f4d80d04-08bb-42a6-91c9-7bb9dc5aa25c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:52.768493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f4d80d04-08bb-42a6-91c9-7bb9dc5aa25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:52.776923 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 691/1373] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:53.069186 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9776c64-8217-41c3-b765-12919e7bcc77 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:53.069980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9776c64-8217-41c3-b765-12919e7bcc77 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:53.069980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9776c64-8217-41c3-b765-12919e7bcc77 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:53.071670 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 683/1374] 10.222.0.52 () {54 vars in 963 bytes} [Tue Mar 8 11:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:53.076631 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8d759-18f7-412b-885d-1e2a56d1ab20 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:53.076915 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8d759-18f7-412b-885d-1e2a56d1ab20 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:53.077191 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8d759-18f7-412b-885d-1e2a56d1ab20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:53.131209 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-96c8d759-18f7-412b-885d-1e2a56d1ab20 None None] MFA Rules not processed for user `1c5631271ed54eacbbbbbb5c8d14d764`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:53.132580 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-96c8d759-18f7-412b-885d-1e2a56d1ab20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:53.136218 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc546f-4dac-4eba-a531-67e3165247cd None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:53.136501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc546f-4dac-4eba-a531-67e3165247cd None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:53.136773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc546f-4dac-4eba-a531-67e3165247cd None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:53.139587 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 684/1375] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:53.144731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36112b8-6c3f-4220-ade1-dc56039ea59f None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:53.145016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36112b8-6c3f-4220-ade1-dc56039ea59f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:53.145454 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36112b8-6c3f-4220-ade1-dc56039ea59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:53.164809 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-e36112b8-6c3f-4220-ade1-dc56039ea59f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:53.166256 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e36112b8-6c3f-4220-ade1-dc56039ea59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:53.176210 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 685/1376] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 11:52:53.198384 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 692/1377] 10.222.0.52 () {58 vars in 1060 bytes} [Tue Mar 8 11:52:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:53.208353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36112b8-6c3f-4220-ade1-dc56039ea59f None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:53.219791 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36112b8-6c3f-4220-ade1-dc56039ea59f None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:53.221208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8d759-18f7-412b-885d-1e2a56d1ab20 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:53.223881 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b4304-0961-4426-bf48-1f172dc0b439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:53.224773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b4304-0961-4426-bf48-1f172dc0b439 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:53.225115 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b4304-0961-4426-bf48-1f172dc0b439 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:53.225452 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b4304-0961-4426-bf48-1f172dc0b439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:53.234222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8d759-18f7-412b-885d-1e2a56d1ab20 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:53.235261 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b4304-0961-4426-bf48-1f172dc0b439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:53.236726 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b4304-0961-4426-bf48-1f172dc0b439 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:53.240117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39de94-3c3b-4897-9bba-320508d634be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:53.240827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39de94-3c3b-4897-9bba-320508d634be service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:53.241182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39de94-3c3b-4897-9bba-320508d634be service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:53.241530 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39de94-3c3b-4897-9bba-320508d634be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:53.247072 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 686/1378] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:52:53.250080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39de94-3c3b-4897-9bba-320508d634be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:53.251719 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39de94-3c3b-4897-9bba-320508d634be service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:53.261490 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 693/1379] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 11:52:55.742131 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e793ea9-c551-47b5-bcff-b339d3ff119d None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:55.742549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e793ea9-c551-47b5-bcff-b339d3ff119d None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:55.742549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e793ea9-c551-47b5-bcff-b339d3ff119d None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:55.744319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 687/1380] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:55.750534 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bad24-933b-466a-95d7-403899b1b63d None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:55.750971 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bad24-933b-466a-95d7-403899b1b63d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:55.751069 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bad24-933b-466a-95d7-403899b1b63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:55.769461 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-a97bad24-933b-466a-95d7-403899b1b63d None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:55.770398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a97bad24-933b-466a-95d7-403899b1b63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:55.778333 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 694/1381] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:55.822939 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e793ea9-c551-47b5-bcff-b339d3ff119d None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:55.837894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e793ea9-c551-47b5-bcff-b339d3ff119d None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:55.844142 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88b1d7-bcdd-4fad-b4d0-b4f81b5fbbe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:55.844801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88b1d7-bcdd-4fad-b4d0-b4f81b5fbbe2 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:55.845091 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88b1d7-bcdd-4fad-b4d0-b4f81b5fbbe2 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:55.845371 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88b1d7-bcdd-4fad-b4d0-b4f81b5fbbe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:55.854464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88b1d7-bcdd-4fad-b4d0-b4f81b5fbbe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:55.856165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88b1d7-bcdd-4fad-b4d0-b4f81b5fbbe2 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:55.866501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 688/1382] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:52:58.350917 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae422a-d98e-49cf-8138-58670b2dd466 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:58.351835 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae422a-d98e-49cf-8138-58670b2dd466 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:58.352115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae422a-d98e-49cf-8138-58670b2dd466 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:58.354074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 695/1383] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:52:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:52:58.359425 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034d30e-1c77-4e5c-a912-e45c5fb51d05 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:58.359847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034d30e-1c77-4e5c-a912-e45c5fb51d05 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:58.360089 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034d30e-1c77-4e5c-a912-e45c5fb51d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:58.379151 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-a034d30e-1c77-4e5c-a912-e45c5fb51d05 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:52:58.380368 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a034d30e-1c77-4e5c-a912-e45c5fb51d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:52:58.388799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 689/1384] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:52:58.433430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae422a-d98e-49cf-8138-58670b2dd466 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:52:58.448446 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae422a-d98e-49cf-8138-58670b2dd466 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:52:58.454499 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1c78b-6026-4ef3-8f7d-9dc1e8724a92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:52:58.455221 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1c78b-6026-4ef3-8f7d-9dc1e8724a92 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:52:58.455598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1c78b-6026-4ef3-8f7d-9dc1e8724a92 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:52:58.455941 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1c78b-6026-4ef3-8f7d-9dc1e8724a92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:52:58.464245 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1c78b-6026-4ef3-8f7d-9dc1e8724a92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:52:58.465911 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1c78b-6026-4ef3-8f7d-9dc1e8724a92 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:52:58.475581 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 696/1385] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:01.103084 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602eb199-42e2-451b-b085-5c33e266d786 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:01.103821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602eb199-42e2-451b-b085-5c33e266d786 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:01.103821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602eb199-42e2-451b-b085-5c33e266d786 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:01.105403 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 690/1386] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:01.110803 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed515d10-f218-4c6d-b5dd-b1028e0074dd None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:01.111208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed515d10-f218-4c6d-b5dd-b1028e0074dd None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:01.111362 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed515d10-f218-4c6d-b5dd-b1028e0074dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:01.129715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-ed515d10-f218-4c6d-b5dd-b1028e0074dd None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:01.131436 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-ed515d10-f218-4c6d-b5dd-b1028e0074dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:01.140946 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 697/1387] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:01.182854 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602eb199-42e2-451b-b085-5c33e266d786 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:01.205767 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602eb199-42e2-451b-b085-5c33e266d786 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:01.212568 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc31b0-3907-40aa-9899-64aa3b9dd661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:01.213324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc31b0-3907-40aa-9899-64aa3b9dd661 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:01.213734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc31b0-3907-40aa-9899-64aa3b9dd661 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:01.214100 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc31b0-3907-40aa-9899-64aa3b9dd661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:01.222848 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc31b0-3907-40aa-9899-64aa3b9dd661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:01.224880 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc31b0-3907-40aa-9899-64aa3b9dd661 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:01.234186 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 691/1388] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:03.527267 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e4676-2a28-4df0-b635-6befd8af97ae None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:03.528091 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e4676-2a28-4df0-b635-6befd8af97ae None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:03.528091 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e4676-2a28-4df0-b635-6befd8af97ae None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:03.529911 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 698/1389] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:53:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:53:03.535877 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab980f0f-2f10-475e-9ef6-1fad5bad8e59 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:03.536320 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab980f0f-2f10-475e-9ef6-1fad5bad8e59 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:03.536433 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab980f0f-2f10-475e-9ef6-1fad5bad8e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:03.555447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-ab980f0f-2f10-475e-9ef6-1fad5bad8e59 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:03.556802 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ab980f0f-2f10-475e-9ef6-1fad5bad8e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:03.566992 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 692/1390] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:03.611070 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e4676-2a28-4df0-b635-6befd8af97ae None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:03.629601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e4676-2a28-4df0-b635-6befd8af97ae None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:03.636899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013419af-eabb-4dee-8478-55a7705062c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:03.637682 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013419af-eabb-4dee-8478-55a7705062c6 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:03.638035 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013419af-eabb-4dee-8478-55a7705062c6 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:03.638446 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013419af-eabb-4dee-8478-55a7705062c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:03.649529 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013419af-eabb-4dee-8478-55a7705062c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:03.651689 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013419af-eabb-4dee-8478-55a7705062c6 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:03.663899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 699/1391] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:06.429372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d90441-95f5-4bf7-a768-3c4c9b37c870 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:06.430062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d90441-95f5-4bf7-a768-3c4c9b37c870 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:06.430062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d90441-95f5-4bf7-a768-3c4c9b37c870 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:06.431752 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 693/1392] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:53:06.437558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0521790-57f2-4b7d-8806-44570cca5359 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:06.438069 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0521790-57f2-4b7d-8806-44570cca5359 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:06.438227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0521790-57f2-4b7d-8806-44570cca5359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:06.457535 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c0521790-57f2-4b7d-8806-44570cca5359 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:06.458675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c0521790-57f2-4b7d-8806-44570cca5359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:06.466542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 700/1393] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:06.517582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d90441-95f5-4bf7-a768-3c4c9b37c870 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:06.531953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d90441-95f5-4bf7-a768-3c4c9b37c870 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:06.537426 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd65366-ec85-4fca-a00c-8e8646883895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:06.538069 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd65366-ec85-4fca-a00c-8e8646883895 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:06.538354 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd65366-ec85-4fca-a00c-8e8646883895 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:06.538635 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd65366-ec85-4fca-a00c-8e8646883895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:06.547490 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd65366-ec85-4fca-a00c-8e8646883895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:06.549115 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd65366-ec85-4fca-a00c-8e8646883895 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:06.566674 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 694/1394] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:09.080141 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78469dda-a5e8-4f87-a7ae-96ebf6cf991d None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:09.080725 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78469dda-a5e8-4f87-a7ae-96ebf6cf991d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:09.080725 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78469dda-a5e8-4f87-a7ae-96ebf6cf991d None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:09.082515 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 701/1395] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:53:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:09.087847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb0c64-07b3-4bdb-be6e-0c9559d5936f None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:09.088314 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb0c64-07b3-4bdb-be6e-0c9559d5936f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:09.088531 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb0c64-07b3-4bdb-be6e-0c9559d5936f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:09.106898 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-0aeb0c64-07b3-4bdb-be6e-0c9559d5936f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:09.108179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0aeb0c64-07b3-4bdb-be6e-0c9559d5936f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:09.115967 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 695/1396] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:09.160904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78469dda-a5e8-4f87-a7ae-96ebf6cf991d None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:09.175139 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78469dda-a5e8-4f87-a7ae-96ebf6cf991d None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:09.180732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc14fa-331d-41e5-8f0d-241f8ae7f08c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:09.181404 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc14fa-331d-41e5-8f0d-241f8ae7f08c service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:09.181690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc14fa-331d-41e5-8f0d-241f8ae7f08c service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:09.181967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc14fa-331d-41e5-8f0d-241f8ae7f08c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:09.191633 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc14fa-331d-41e5-8f0d-241f8ae7f08c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:09.193304 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc14fa-331d-41e5-8f0d-241f8ae7f08c service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:09.204751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 702/1397] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:09.555809 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d491c60-6fe5-4469-9a96-568988e83dcb None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:09.556098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d491c60-6fe5-4469-9a96-568988e83dcb None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:09.556409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d491c60-6fe5-4469-9a96-568988e83dcb None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:09.558235 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 696/1398] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:53:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:09.564482 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406d3fd-fe66-40b2-94af-9da069a9e1c8 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:09.564765 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406d3fd-fe66-40b2-94af-9da069a9e1c8 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:09.565042 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406d3fd-fe66-40b2-94af-9da069a9e1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:09.583555 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c406d3fd-fe66-40b2-94af-9da069a9e1c8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:09.584739 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c406d3fd-fe66-40b2-94af-9da069a9e1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:09.593001 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 703/1399] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:09.651022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87944c38-9966-4aed-851a-c7d5c40f5372 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:09.651233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87944c38-9966-4aed-851a-c7d5c40f5372 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:09.651504 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87944c38-9966-4aed-851a-c7d5c40f5372 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:09.653336 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 697/1400] 10.222.0.52 () {54 vars in 961 bytes} [Tue Mar 8 11:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:09.658808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c5c00-820d-4d4a-9c4c-184a17f4ae4d None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:09.660308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c5c00-820d-4d4a-9c4c-184a17f4ae4d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:09.660308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c5c00-820d-4d4a-9c4c-184a17f4ae4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:09.710492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-a11c5c00-820d-4d4a-9c4c-184a17f4ae4d None None] MFA Rules not processed for user `b65583446d2e40a69dff534b73e8fa7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:09.711733 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a11c5c00-820d-4d4a-9c4c-184a17f4ae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:09.770773 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 704/1401] 10.222.0.52 () {58 vars in 1058 bytes} [Tue Mar 8 11:53:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:09.778236 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87944c38-9966-4aed-851a-c7d5c40f5372 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:09.789042 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87944c38-9966-4aed-851a-c7d5c40f5372 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:09.793066 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb87f8-c188-4882-9edb-0a5c775a7ec9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65583446d2e40a69dff534b73e8fa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:09.793427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb87f8-c188-4882-9edb-0a5c775a7ec9 service glance] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:09.793725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb87f8-c188-4882-9edb-0a5c775a7ec9 service glance] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:09.793993 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb87f8-c188-4882-9edb-0a5c775a7ec9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:09.803845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb87f8-c188-4882-9edb-0a5c775a7ec9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:09.805333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb87f8-c188-4882-9edb-0a5c775a7ec9 service glance] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:09.815733 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 698/1402] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:10.367160 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021b2fe-42ce-4a8e-9531-88814ce186cf None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:10.367690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021b2fe-42ce-4a8e-9531-88814ce186cf None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:10.367787 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021b2fe-42ce-4a8e-9531-88814ce186cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:10.415895 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-7021b2fe-42ce-4a8e-9531-88814ce186cf None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:10.417096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-7021b2fe-42ce-4a8e-9531-88814ce186cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:10.479135 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 705/1403] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 11:53:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:10.525416 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d12e49-d3d0-43d6-a630-f834cb692821 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:10.525861 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d12e49-d3d0-43d6-a630-f834cb692821 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:10.525996 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d12e49-d3d0-43d6-a630-f834cb692821 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:10.528241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 699/1404] 10.222.0.52 () {54 vars in 942 bytes} [Tue Mar 8 11:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:10.536499 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7080d-fa21-43fd-9357-8cbf42bdc4f2 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:10.536857 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7080d-fa21-43fd-9357-8cbf42bdc4f2 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:10.537143 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7080d-fa21-43fd-9357-8cbf42bdc4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:10.583305 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-eec7080d-fa21-43fd-9357-8cbf42bdc4f2 None None] MFA Rules not processed for user `869feb4577be48a683997eab827b1062`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:10.584568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-eec7080d-fa21-43fd-9357-8cbf42bdc4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:10.652214 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 706/1405] 10.222.0.52 () {58 vars in 1039 bytes} [Tue Mar 8 11:53:10 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:10.662064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d12e49-d3d0-43d6-a630-f834cb692821 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:10.675958 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d12e49-d3d0-43d6-a630-f834cb692821 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:10.680943 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00dda6-cc95-40aa-9653-a9c778e9a79a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:10.681582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00dda6-cc95-40aa-9653-a9c778e9a79a service swift] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:10.681868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00dda6-cc95-40aa-9653-a9c778e9a79a service swift] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:10.682148 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00dda6-cc95-40aa-9653-a9c778e9a79a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:10.695654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00dda6-cc95-40aa-9653-a9c778e9a79a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:10.697284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00dda6-cc95-40aa-9653-a9c778e9a79a service swift] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:10.706333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 700/1406] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 11:53:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 11:53:11.679790 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0199904-c3d4-41e4-9618-969f37eb7812 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:11.680387 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0199904-c3d4-41e4-9618-969f37eb7812 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:11.680387 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0199904-c3d4-41e4-9618-969f37eb7812 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:11.682147 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 707/1407] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:11.687898 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c24b2a-592e-450a-b053-a0c4795a7ccd None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:11.688366 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c24b2a-592e-450a-b053-a0c4795a7ccd None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:11.688492 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c24b2a-592e-450a-b053-a0c4795a7ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:11.711540 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-a8c24b2a-592e-450a-b053-a0c4795a7ccd None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:11.712874 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a8c24b2a-592e-450a-b053-a0c4795a7ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:11.723561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 701/1408] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:11.770592 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0199904-c3d4-41e4-9618-969f37eb7812 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:11.786880 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0199904-c3d4-41e4-9618-969f37eb7812 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:11.793347 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90938c5-8076-42f0-90ea-b0186d147ae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:11.793994 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90938c5-8076-42f0-90ea-b0186d147ae8 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:11.794282 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90938c5-8076-42f0-90ea-b0186d147ae8 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:11.794554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90938c5-8076-42f0-90ea-b0186d147ae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:11.804038 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90938c5-8076-42f0-90ea-b0186d147ae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:11.805635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90938c5-8076-42f0-90ea-b0186d147ae8 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:11.827700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 708/1409] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:14.332579 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35adda-dbfc-4354-9f90-c8f1786deb25 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:14.333127 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35adda-dbfc-4354-9f90-c8f1786deb25 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:14.333127 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35adda-dbfc-4354-9f90-c8f1786deb25 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:14.334941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 702/1410] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:14.340385 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e26d0-a6b6-4053-82c4-054ad060693d None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:14.341209 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e26d0-a6b6-4053-82c4-054ad060693d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:14.342387 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e26d0-a6b6-4053-82c4-054ad060693d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:14.360378 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-4a2e26d0-a6b6-4053-82c4-054ad060693d None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:14.361590 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-4a2e26d0-a6b6-4053-82c4-054ad060693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:14.369562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 709/1411] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:14.414450 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35adda-dbfc-4354-9f90-c8f1786deb25 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:14.429324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35adda-dbfc-4354-9f90-c8f1786deb25 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:14.434995 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5637e80-4484-4542-a676-6caf8a4b2a14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:14.435775 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5637e80-4484-4542-a676-6caf8a4b2a14 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:14.436116 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5637e80-4484-4542-a676-6caf8a4b2a14 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:14.436459 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5637e80-4484-4542-a676-6caf8a4b2a14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:14.444802 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5637e80-4484-4542-a676-6caf8a4b2a14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:14.446404 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5637e80-4484-4542-a676-6caf8a4b2a14 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:14.458212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 703/1412] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:35.565213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2b2f5-5e1c-46d3-8708-ee17f55e04b7 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:35.565825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2b2f5-5e1c-46d3-8708-ee17f55e04b7 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:35.565825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2b2f5-5e1c-46d3-8708-ee17f55e04b7 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:35.567463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 710/1413] 10.222.0.52 () {54 vars in 918 bytes} [Tue Mar 8 11:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:35.572766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4936b7-7e42-4bce-9ddb-968942d5df87 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:35.578007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4936b7-7e42-4bce-9ddb-968942d5df87 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:35.578007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4936b7-7e42-4bce-9ddb-968942d5df87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:35.591652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-3b4936b7-7e42-4bce-9ddb-968942d5df87 None None] MFA Rules not processed for user `8855284b10c64b8ca367e3c30b5f66fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:35.592846 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-3b4936b7-7e42-4bce-9ddb-968942d5df87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:35.601261 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 704/1414] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Mar 8 11:53:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:35.615381 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c411f-7479-498e-8f3a-e90700b9fbb9 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:35.615700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c411f-7479-498e-8f3a-e90700b9fbb9 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:35.616043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c411f-7479-498e-8f3a-e90700b9fbb9 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:35.617925 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 711/1415] 10.222.0.52 () {54 vars in 918 bytes} [Tue Mar 8 11:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:35.622464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8fdea-f404-47fe-b812-7c332e195d1d None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:35.622755 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8fdea-f404-47fe-b812-7c332e195d1d None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:35.623065 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8fdea-f404-47fe-b812-7c332e195d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:35.641931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-ade8fdea-f404-47fe-b812-7c332e195d1d None None] MFA Rules not processed for user `534fd902f96043068e99ca0537cf57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:35.643110 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ade8fdea-f404-47fe-b812-7c332e195d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:35.652058 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 705/1416] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Mar 8 11:53:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:38.421129 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb314f2a-11db-4b26-85ff-300f6918f5d0 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:38.421688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb314f2a-11db-4b26-85ff-300f6918f5d0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:38.421688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb314f2a-11db-4b26-85ff-300f6918f5d0 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:38.423578 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 11:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:38.428687 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb0f5c-4b20-412d-b188-bfdcc507647a None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:38.429156 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb0f5c-4b20-412d-b188-bfdcc507647a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:38.429262 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb0f5c-4b20-412d-b188-bfdcc507647a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:38.446977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-15cb0f5c-4b20-412d-b188-bfdcc507647a None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:38.448158 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-15cb0f5c-4b20-412d-b188-bfdcc507647a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:38.456514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 11:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:38.499786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb314f2a-11db-4b26-85ff-300f6918f5d0 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:38.514552 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb314f2a-11db-4b26-85ff-300f6918f5d0 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:38.520729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e455e1-9224-420b-9735-a49dfc1e9c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:38.521360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e455e1-9224-420b-9735-a49dfc1e9c12 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:38.521643 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e455e1-9224-420b-9735-a49dfc1e9c12 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:38.521927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e455e1-9224-420b-9735-a49dfc1e9c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:38.529758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e455e1-9224-420b-9735-a49dfc1e9c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:38.531404 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e455e1-9224-420b-9735-a49dfc1e9c12 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:38.540857 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 713/1419] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:39.903344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8f169-6ffb-40f0-8037-62540b275625 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:39.903928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8f169-6ffb-40f0-8037-62540b275625 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:39.903928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8f169-6ffb-40f0-8037-62540b275625 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:39.905753 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 11:53:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:39.916481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5eb05-d596-4fc1-882e-990aa82de8e9 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:39.917546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5eb05-d596-4fc1-882e-990aa82de8e9 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:39.917546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5eb05-d596-4fc1-882e-990aa82de8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:39.937002 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-57e5eb05-d596-4fc1-882e-990aa82de8e9 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:39.938268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-57e5eb05-d596-4fc1-882e-990aa82de8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:39.946018 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 11:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 11:53:40.119051 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8f169-6ffb-40f0-8037-62540b275625 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:40.133791 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8f169-6ffb-40f0-8037-62540b275625 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:40.139022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ca239-9b10-4674-a1da-bb41682d73ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:40.139682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ca239-9b10-4674-a1da-bb41682d73ba service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:40.139965 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ca239-9b10-4674-a1da-bb41682d73ba service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:40.140238 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ca239-9b10-4674-a1da-bb41682d73ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:40.148862 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ca239-9b10-4674-a1da-bb41682d73ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:40.150426 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ca239-9b10-4674-a1da-bb41682d73ba service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:40.159849 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 708/1422] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:41.517399 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45b0a7-8493-4cff-bbea-c72c18756263 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:41.517989 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45b0a7-8493-4cff-bbea-c72c18756263 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:41.517989 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45b0a7-8493-4cff-bbea-c72c18756263 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:41.519788 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 11:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:41.525341 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494bc23-1ab9-4e84-b22e-ea801ed71579 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:41.525825 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494bc23-1ab9-4e84-b22e-ea801ed71579 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:41.525930 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494bc23-1ab9-4e84-b22e-ea801ed71579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:41.546445 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-e494bc23-1ab9-4e84-b22e-ea801ed71579 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:41.547848 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e494bc23-1ab9-4e84-b22e-ea801ed71579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:41.556257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 11:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:41.720346 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45b0a7-8493-4cff-bbea-c72c18756263 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:41.735554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45b0a7-8493-4cff-bbea-c72c18756263 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:41.747365 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176a519-5bbc-42d3-8821-c1aea4c6fe45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:41.748043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176a519-5bbc-42d3-8821-c1aea4c6fe45 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:41.748326 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176a519-5bbc-42d3-8821-c1aea4c6fe45 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:41.748600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176a519-5bbc-42d3-8821-c1aea4c6fe45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:41.758318 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176a519-5bbc-42d3-8821-c1aea4c6fe45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:41.759921 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176a519-5bbc-42d3-8821-c1aea4c6fe45 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:41.770810 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 716/1425] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:43.142090 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635177a0-3519-4523-a15c-b06b89449a4d None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:43.142496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635177a0-3519-4523-a15c-b06b89449a4d None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:43.142642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635177a0-3519-4523-a15c-b06b89449a4d None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:43.144468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 11:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 11:53:43.149541 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236255-612e-4823-a5ec-89de86ef8e7f None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:43.152005 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236255-612e-4823-a5ec-89de86ef8e7f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:43.152005 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236255-612e-4823-a5ec-89de86ef8e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:43.168140 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-2e236255-612e-4823-a5ec-89de86ef8e7f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:43.169345 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-2e236255-612e-4823-a5ec-89de86ef8e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:43.177399 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 11:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:43.326970 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635177a0-3519-4523-a15c-b06b89449a4d None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:43.341871 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635177a0-3519-4523-a15c-b06b89449a4d None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:43.347164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4764ede-1613-48bb-b73a-940665b2881c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:43.347854 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4764ede-1613-48bb-b73a-940665b2881c service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:43.348135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4764ede-1613-48bb-b73a-940665b2881c service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:43.348408 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4764ede-1613-48bb-b73a-940665b2881c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:43.356186 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4764ede-1613-48bb-b73a-940665b2881c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:43.357757 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4764ede-1613-48bb-b73a-940665b2881c service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:43.367481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 711/1428] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:44.664274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7e53b-550c-49fe-8b16-34cb32293934 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:44.664879 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7e53b-550c-49fe-8b16-34cb32293934 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:44.664879 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7e53b-550c-49fe-8b16-34cb32293934 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:44.666687 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 11:53:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:44.671923 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f93d7-39e4-42ac-8298-dad5084b0dd0 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:44.672409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f93d7-39e4-42ac-8298-dad5084b0dd0 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:44.672502 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f93d7-39e4-42ac-8298-dad5084b0dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:44.691397 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-f67f93d7-39e4-42ac-8298-dad5084b0dd0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:44.692601 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f67f93d7-39e4-42ac-8298-dad5084b0dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:44.700372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 11:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:44.856169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7e53b-550c-49fe-8b16-34cb32293934 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:44.870649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7e53b-550c-49fe-8b16-34cb32293934 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:44.876622 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c8959-d543-4220-8760-07364a1ea1d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:44.877249 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c8959-d543-4220-8760-07364a1ea1d6 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:44.877531 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c8959-d543-4220-8760-07364a1ea1d6 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:44.877808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c8959-d543-4220-8760-07364a1ea1d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:44.885939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c8959-d543-4220-8760-07364a1ea1d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:44.887591 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c8959-d543-4220-8760-07364a1ea1d6 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:44.896961 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 719/1431] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:46.217106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815ba0-64fb-4e06-b01f-8a57e1eb2280 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:46.217608 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815ba0-64fb-4e06-b01f-8a57e1eb2280 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:46.217773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815ba0-64fb-4e06-b01f-8a57e1eb2280 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:46.219778 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 11:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:46.225523 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d09e-2283-4e93-a4ca-0c74e3a0d998 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:46.225954 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d09e-2283-4e93-a4ca-0c74e3a0d998 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:46.226313 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d09e-2283-4e93-a4ca-0c74e3a0d998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:46.251831 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c842d09e-2283-4e93-a4ca-0c74e3a0d998 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:46.253788 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c842d09e-2283-4e93-a4ca-0c74e3a0d998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:46.262356 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 11:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:46.410809 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03815ba0-64fb-4e06-b01f-8a57e1eb2280 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:46.425592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03815ba0-64fb-4e06-b01f-8a57e1eb2280 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:46.431010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5511a-0820-4135-972b-cd0fc28d8751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:46.431682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5511a-0820-4135-972b-cd0fc28d8751 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:46.431965 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5511a-0820-4135-972b-cd0fc28d8751 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:46.432239 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5511a-0820-4135-972b-cd0fc28d8751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:46.440786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5511a-0820-4135-972b-cd0fc28d8751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:46.442362 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5511a-0820-4135-972b-cd0fc28d8751 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:46.451475 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 714/1434] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:47.772828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3271-a5bf-445c-812f-50b37e04cb66 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:47.773376 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3271-a5bf-445c-812f-50b37e04cb66 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:47.773376 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3271-a5bf-445c-812f-50b37e04cb66 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:47.775187 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 11:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:47.780232 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983fdce-4726-43f3-bed5-05b4c482e888 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:47.781201 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983fdce-4726-43f3-bed5-05b4c482e888 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:47.781301 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983fdce-4726-43f3-bed5-05b4c482e888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:47.799315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-8983fdce-4726-43f3-bed5-05b4c482e888 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:47.800550 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-8983fdce-4726-43f3-bed5-05b4c482e888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:47.808426 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 11:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:47.981606 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3271-a5bf-445c-812f-50b37e04cb66 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:47.995640 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3271-a5bf-445c-812f-50b37e04cb66 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:48.001132 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a7fd9-49ef-4346-b3d8-00df7232646a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:48.001758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a7fd9-49ef-4346-b3d8-00df7232646a service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:48.002038 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a7fd9-49ef-4346-b3d8-00df7232646a service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:48.002312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a7fd9-49ef-4346-b3d8-00df7232646a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:48.010374 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a7fd9-49ef-4346-b3d8-00df7232646a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:48.012015 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a7fd9-49ef-4346-b3d8-00df7232646a service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:48.021639 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 722/1437] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:49.354388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5269a-76e8-4cbf-aee5-91d5c4b3a583 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:49.354955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5269a-76e8-4cbf-aee5-91d5c4b3a583 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:49.354955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5269a-76e8-4cbf-aee5-91d5c4b3a583 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:49.356718 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 11:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:49.362471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f9194-c719-4510-84fd-e2b29f4fa82a None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:49.362918 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f9194-c719-4510-84fd-e2b29f4fa82a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:49.363056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f9194-c719-4510-84fd-e2b29f4fa82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:49.380732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-a27f9194-c719-4510-84fd-e2b29f4fa82a None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:49.381921 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a27f9194-c719-4510-84fd-e2b29f4fa82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:49.389783 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 11:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:49.544770 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5269a-76e8-4cbf-aee5-91d5c4b3a583 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:49.558808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5269a-76e8-4cbf-aee5-91d5c4b3a583 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:49.564490 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b5932-4e63-4106-aaaa-000727567a41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:49.565131 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b5932-4e63-4106-aaaa-000727567a41 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:49.565411 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b5932-4e63-4106-aaaa-000727567a41 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:49.565682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b5932-4e63-4106-aaaa-000727567a41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:49.573742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b5932-4e63-4106-aaaa-000727567a41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:49.575327 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b5932-4e63-4106-aaaa-000727567a41 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:49.585097 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 717/1440] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:50.993901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc14d4-dd6d-4b51-a863-edb655737747 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:50.994430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc14d4-dd6d-4b51-a863-edb655737747 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:50.994430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc14d4-dd6d-4b51-a863-edb655737747 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:50.996228 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 11:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:51.001239 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e1f98-a534-4163-8384-e777c81dda83 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:51.001719 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e1f98-a534-4163-8384-e777c81dda83 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:51.001817 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e1f98-a534-4163-8384-e777c81dda83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:51.020170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-955e1f98-a534-4163-8384-e777c81dda83 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:51.021372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-955e1f98-a534-4163-8384-e777c81dda83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:51.029083 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 11:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:51.178639 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc14d4-dd6d-4b51-a863-edb655737747 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:51.193633 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc14d4-dd6d-4b51-a863-edb655737747 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:51.198543 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3ffab-aeda-4721-acb8-c64341d91480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:51.199182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3ffab-aeda-4721-acb8-c64341d91480 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:51.199465 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3ffab-aeda-4721-acb8-c64341d91480 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:51.199775 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3ffab-aeda-4721-acb8-c64341d91480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:51.208196 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3ffab-aeda-4721-acb8-c64341d91480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:51.209791 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3ffab-aeda-4721-acb8-c64341d91480 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:51.219077 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 725/1443] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:53.417129 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c9d6-f63f-47fd-907f-88c8408304f3 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:53.417691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c9d6-f63f-47fd-907f-88c8408304f3 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:53.417691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c9d6-f63f-47fd-907f-88c8408304f3 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:53.419450 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 11:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:53.424790 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc722db-385a-4081-b66d-0d37a20d4500 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:53.425217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc722db-385a-4081-b66d-0d37a20d4500 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:53.425344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc722db-385a-4081-b66d-0d37a20d4500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:53.442639 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-3dc722db-385a-4081-b66d-0d37a20d4500 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:53.443916 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3dc722db-385a-4081-b66d-0d37a20d4500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:53.451839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 11:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:53.492841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62c9d6-f63f-47fd-907f-88c8408304f3 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:53.504229 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62c9d6-f63f-47fd-907f-88c8408304f3 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:53.508049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d6dba-61c4-4d8e-bd09-3d4a1d870063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:53.508691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d6dba-61c4-4d8e-bd09-3d4a1d870063 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:53.508974 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d6dba-61c4-4d8e-bd09-3d4a1d870063 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:53.509252 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d6dba-61c4-4d8e-bd09-3d4a1d870063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:53.518680 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d6dba-61c4-4d8e-bd09-3d4a1d870063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:53.520180 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d6dba-61c4-4d8e-bd09-3d4a1d870063 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:53.529403 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 720/1446] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:55.966205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bc832-e74f-4e29-862a-486d73564d82 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:55.966832 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bc832-e74f-4e29-862a-486d73564d82 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:55.966832 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bc832-e74f-4e29-862a-486d73564d82 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:55.969201 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 11:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:55.974533 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19de240-9181-432c-b812-8391a8605f1c None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:55.974969 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19de240-9181-432c-b812-8391a8605f1c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:55.975093 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19de240-9181-432c-b812-8391a8605f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:55.993132 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-f19de240-9181-432c-b812-8391a8605f1c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:55.994325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f19de240-9181-432c-b812-8391a8605f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:56.002077 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 11:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:56.039930 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bc832-e74f-4e29-862a-486d73564d82 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:56.050941 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bc832-e74f-4e29-862a-486d73564d82 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:56.054433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7502be-5f7b-4553-8028-d6d694dcf709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:56.055053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7502be-5f7b-4553-8028-d6d694dcf709 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:56.055331 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7502be-5f7b-4553-8028-d6d694dcf709 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:56.055642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7502be-5f7b-4553-8028-d6d694dcf709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:56.064233 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7502be-5f7b-4553-8028-d6d694dcf709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:56.065664 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7502be-5f7b-4553-8028-d6d694dcf709 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:56.074668 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 728/1449] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:53:58.721068 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091776c-9546-4af4-917e-74405a2a16fc None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:58.721489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091776c-9546-4af4-917e-74405a2a16fc None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:58.721623 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091776c-9546-4af4-917e-74405a2a16fc None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:58.723458 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 11:53:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:53:58.728801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b1a0d-f178-42ba-b64f-7d0a92864eab None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:58.729225 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b1a0d-f178-42ba-b64f-7d0a92864eab None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:58.729358 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b1a0d-f178-42ba-b64f-7d0a92864eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:58.747093 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-141b1a0d-f178-42ba-b64f-7d0a92864eab None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:53:58.748367 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-141b1a0d-f178-42ba-b64f-7d0a92864eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:53:58.757077 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 11:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:53:58.797933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091776c-9546-4af4-917e-74405a2a16fc None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:53:58.808451 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091776c-9546-4af4-917e-74405a2a16fc None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:53:58.812077 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42413a1c-ec0a-4030-984f-1431ca11aa41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:53:58.812721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42413a1c-ec0a-4030-984f-1431ca11aa41 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:53:58.813003 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42413a1c-ec0a-4030-984f-1431ca11aa41 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:53:58.813279 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42413a1c-ec0a-4030-984f-1431ca11aa41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:53:58.821972 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42413a1c-ec0a-4030-984f-1431ca11aa41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:53:58.823407 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42413a1c-ec0a-4030-984f-1431ca11aa41 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:53:58.832652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 723/1452] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:54:01.245875 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c3a5d-d958-484d-9356-991d620880b4 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:01.246425 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c3a5d-d958-484d-9356-991d620880b4 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:01.246425 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c3a5d-d958-484d-9356-991d620880b4 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:01.248276 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 11:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:54:01.253833 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84372025-ed42-4590-b535-184e58cb5e31 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:01.254250 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84372025-ed42-4590-b535-184e58cb5e31 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:01.254389 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84372025-ed42-4590-b535-184e58cb5e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:01.272580 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-84372025-ed42-4590-b535-184e58cb5e31 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:54:01.273773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-84372025-ed42-4590-b535-184e58cb5e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:54:01.282044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 11:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:54:01.321253 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c3a5d-d958-484d-9356-991d620880b4 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:54:01.331671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c3a5d-d958-484d-9356-991d620880b4 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:54:01.335087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf8806-88bd-4005-9236-e0012fe838d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:54:01.335747 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf8806-88bd-4005-9236-e0012fe838d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:01.336025 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf8806-88bd-4005-9236-e0012fe838d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:01.336297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf8806-88bd-4005-9236-e0012fe838d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:01.345408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf8806-88bd-4005-9236-e0012fe838d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:54:01.346819 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf8806-88bd-4005-9236-e0012fe838d9 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:54:01.355815 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 731/1455] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:54:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:54:03.720046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64738f32-ec19-418a-8316-72d5a9662259 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:03.720594 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64738f32-ec19-418a-8316-72d5a9662259 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:03.720594 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64738f32-ec19-418a-8316-72d5a9662259 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:03.722360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 11:54:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:54:03.727945 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00634f73-190c-4609-be91-656dae851e72 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:03.728484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00634f73-190c-4609-be91-656dae851e72 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:03.728484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00634f73-190c-4609-be91-656dae851e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:03.746738 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-00634f73-190c-4609-be91-656dae851e72 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:54:03.747984 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-00634f73-190c-4609-be91-656dae851e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:54:03.756411 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 11:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:54:03.794535 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64738f32-ec19-418a-8316-72d5a9662259 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:54:03.806148 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64738f32-ec19-418a-8316-72d5a9662259 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:54:03.809692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aa401-827a-4b17-9e73-b1aafab6d525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:54:03.810328 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aa401-827a-4b17-9e73-b1aafab6d525 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:03.810617 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aa401-827a-4b17-9e73-b1aafab6d525 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:03.810899 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aa401-827a-4b17-9e73-b1aafab6d525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:03.820655 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aa401-827a-4b17-9e73-b1aafab6d525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:54:03.822086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aa401-827a-4b17-9e73-b1aafab6d525 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:54:03.831829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 726/1458] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:54:06.225374 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d08d30-24f3-4824-a50c-751c21580717 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:06.225936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d08d30-24f3-4824-a50c-751c21580717 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:06.225936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d08d30-24f3-4824-a50c-751c21580717 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:06.227760 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 11:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:54:06.233569 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7776b4-91fb-47c8-bc1b-4dd34e7cbabe None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:06.234839 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7776b4-91fb-47c8-bc1b-4dd34e7cbabe None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:06.235375 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7776b4-91fb-47c8-bc1b-4dd34e7cbabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:06.254193 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-3d7776b4-91fb-47c8-bc1b-4dd34e7cbabe None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:54:06.255514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-3d7776b4-91fb-47c8-bc1b-4dd34e7cbabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:54:06.263788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 11:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:54:06.302157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d08d30-24f3-4824-a50c-751c21580717 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:54:06.313208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d08d30-24f3-4824-a50c-751c21580717 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:54:06.316694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c00bbe-c2f0-4742-bf9b-ce72d1e89f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:54:06.317323 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c00bbe-c2f0-4742-bf9b-ce72d1e89f7c service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:06.317605 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c00bbe-c2f0-4742-bf9b-ce72d1e89f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:06.317880 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c00bbe-c2f0-4742-bf9b-ce72d1e89f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:06.327243 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c00bbe-c2f0-4742-bf9b-ce72d1e89f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:54:06.328677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c00bbe-c2f0-4742-bf9b-ce72d1e89f7c service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:54:06.338280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 734/1461] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:54:08.714019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fff3d3-ae4b-4494-8815-2b9b0c1cb384 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:08.714570 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fff3d3-ae4b-4494-8815-2b9b0c1cb384 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:08.714570 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fff3d3-ae4b-4494-8815-2b9b0c1cb384 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:08.716449 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 11:54:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:54:08.721701 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f1967-1262-4d91-b36a-1c4a579805c8 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:08.722126 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f1967-1262-4d91-b36a-1c4a579805c8 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:08.722258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f1967-1262-4d91-b36a-1c4a579805c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:08.739629 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-860f1967-1262-4d91-b36a-1c4a579805c8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:54:08.740831 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-860f1967-1262-4d91-b36a-1c4a579805c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:54:08.749365 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 11:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:54:08.796483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fff3d3-ae4b-4494-8815-2b9b0c1cb384 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:54:08.807022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fff3d3-ae4b-4494-8815-2b9b0c1cb384 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:54:08.810547 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6872d7-7c79-4600-81f0-825ad2c4f836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:54:08.811883 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6872d7-7c79-4600-81f0-825ad2c4f836 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:08.812161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6872d7-7c79-4600-81f0-825ad2c4f836 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:08.812435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6872d7-7c79-4600-81f0-825ad2c4f836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:08.821230 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6872d7-7c79-4600-81f0-825ad2c4f836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:54:08.822669 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6872d7-7c79-4600-81f0-825ad2c4f836 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:54:08.832770 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 729/1464] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:54:11.175863 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc11e8-e0b0-4672-b4b3-1a2c7b689cc3 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:11.176397 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc11e8-e0b0-4672-b4b3-1a2c7b689cc3 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:11.176397 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc11e8-e0b0-4672-b4b3-1a2c7b689cc3 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:11.178144 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 11:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:54:11.183284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da00aa8-5052-4c59-a894-07335479b550 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:11.183716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da00aa8-5052-4c59-a894-07335479b550 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:11.183872 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da00aa8-5052-4c59-a894-07335479b550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:11.202511 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-5da00aa8-5052-4c59-a894-07335479b550 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:54:11.203786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5da00aa8-5052-4c59-a894-07335479b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:54:11.211584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 11:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:54:11.249362 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc11e8-e0b0-4672-b4b3-1a2c7b689cc3 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:54:11.259979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc11e8-e0b0-4672-b4b3-1a2c7b689cc3 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:54:11.263380 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a3a25-c060-4e58-bc94-6e197519dbd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:54:11.264873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a3a25-c060-4e58-bc94-6e197519dbd2 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:11.265153 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a3a25-c060-4e58-bc94-6e197519dbd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:11.265430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a3a25-c060-4e58-bc94-6e197519dbd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:11.274063 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a3a25-c060-4e58-bc94-6e197519dbd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:54:11.275481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a3a25-c060-4e58-bc94-6e197519dbd2 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:54:11.285174 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 737/1467] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:54:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:54:13.603702 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b34fb-bc94-4560-8ffd-0d00845cfde3 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:13.604239 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b34fb-bc94-4560-8ffd-0d00845cfde3 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:13.604614 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b34fb-bc94-4560-8ffd-0d00845cfde3 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:13.607913 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 11:54:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:54:13.613375 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7dd93-7111-458e-b5cf-a7c84bacacf2 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:13.613816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7dd93-7111-458e-b5cf-a7c84bacacf2 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:13.613926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7dd93-7111-458e-b5cf-a7c84bacacf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:13.631283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-e0b7dd93-7111-458e-b5cf-a7c84bacacf2 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:54:13.632781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-e0b7dd93-7111-458e-b5cf-a7c84bacacf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:54:13.641027 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 11:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:54:13.676871 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b34fb-bc94-4560-8ffd-0d00845cfde3 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:54:13.687500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b34fb-bc94-4560-8ffd-0d00845cfde3 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:54:13.691035 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06c774-59cc-4012-bb7b-c0cc13b23ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:54:13.691700 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c774-59cc-4012-bb7b-c0cc13b23ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:13.691985 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c774-59cc-4012-bb7b-c0cc13b23ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:13.692265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c774-59cc-4012-bb7b-c0cc13b23ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:13.701548 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06c774-59cc-4012-bb7b-c0cc13b23ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:54:13.703044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06c774-59cc-4012-bb7b-c0cc13b23ce3 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:54:13.712296 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 732/1470] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:54:16.024258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12612b04-8ed1-419d-b434-1f61b893c52f None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:16.024829 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12612b04-8ed1-419d-b434-1f61b893c52f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:16.024829 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12612b04-8ed1-419d-b434-1f61b893c52f None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:16.026615 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 739/1471] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 11:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:54:16.032597 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375aeff-1b0c-4d70-b586-317285922a38 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:16.033052 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375aeff-1b0c-4d70-b586-317285922a38 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:16.033164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375aeff-1b0c-4d70-b586-317285922a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:16.051937 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-a375aeff-1b0c-4d70-b586-317285922a38 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:54:16.053154 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a375aeff-1b0c-4d70-b586-317285922a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:54:16.061480 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 733/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 11:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:54:16.098508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12612b04-8ed1-419d-b434-1f61b893c52f None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:54:16.109804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12612b04-8ed1-419d-b434-1f61b893c52f None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:54:16.113242 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4d17b-4248-45bf-a8c0-734118b1fee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:54:16.113867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4d17b-4248-45bf-a8c0-734118b1fee3 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:16.114145 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4d17b-4248-45bf-a8c0-734118b1fee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:16.114418 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4d17b-4248-45bf-a8c0-734118b1fee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:16.123827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4d17b-4248-45bf-a8c0-734118b1fee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:54:16.125378 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4d17b-4248-45bf-a8c0-734118b1fee3 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:54:16.134876 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 740/1473] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:54:36.923818 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3183a7-c9b1-4317-811c-dc0f6c3f77b0 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:36.924409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3183a7-c9b1-4317-811c-dc0f6c3f77b0 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:36.924409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3183a7-c9b1-4317-811c-dc0f6c3f77b0 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:36.926155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 734/1474] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:54:36.931288 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20723a-179b-4126-9bda-0ce8033f0144 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:36.931724 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20723a-179b-4126-9bda-0ce8033f0144 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:36.931868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20723a-179b-4126-9bda-0ce8033f0144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:36.950267 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-2f20723a-179b-4126-9bda-0ce8033f0144 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:54:36.951458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-2f20723a-179b-4126-9bda-0ce8033f0144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:54:36.959090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 741/1475] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:54:37.006273 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b92f3-68b9-4ea0-a6ce-97aa60188500 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:37.006561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b92f3-68b9-4ea0-a6ce-97aa60188500 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:37.006840 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b92f3-68b9-4ea0-a6ce-97aa60188500 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:37.008631 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 735/1476] 10.222.0.52 () {54 vars in 961 bytes} [Tue Mar 8 11:54:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:54:37.013576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9fe3e-e72b-4a3f-a060-0432b8ba634d None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:37.013864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9fe3e-e72b-4a3f-a060-0432b8ba634d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:37.014143 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9fe3e-e72b-4a3f-a060-0432b8ba634d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:37.032299 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-a9f9fe3e-e72b-4a3f-a060-0432b8ba634d None None] MFA Rules not processed for user `b65583446d2e40a69dff534b73e8fa7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:54:37.033489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a9f9fe3e-e72b-4a3f-a060-0432b8ba634d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:54:37.039858 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 742/1477] 10.222.0.52 () {58 vars in 1058 bytes} [Tue Mar 8 11:54:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 11:54:37.047358 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b92f3-68b9-4ea0-a6ce-97aa60188500 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:54:37.058009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b92f3-68b9-4ea0-a6ce-97aa60188500 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:54:37.061574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c35512-4605-46b0-bf3c-37e1a8b6cd88 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65583446d2e40a69dff534b73e8fa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:54:37.062218 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c35512-4605-46b0-bf3c-37e1a8b6cd88 service glance] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:37.062501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c35512-4605-46b0-bf3c-37e1a8b6cd88 service glance] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:37.062774 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c35512-4605-46b0-bf3c-37e1a8b6cd88 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:37.071371 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c35512-4605-46b0-bf3c-37e1a8b6cd88 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:54:37.072818 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c35512-4605-46b0-bf3c-37e1a8b6cd88 service glance] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:54:37.081884 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 736/1478] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:54:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:54:39.525277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a2ea0-008b-4843-9ff8-f398a7b55e23 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:39.525816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a2ea0-008b-4843-9ff8-f398a7b55e23 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:39.525816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a2ea0-008b-4843-9ff8-f398a7b55e23 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:39.528208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 743/1479] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:54:39.533605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4237ea-e2ee-4fd1-823c-4e8762b9cf7a None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:39.534005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4237ea-e2ee-4fd1-823c-4e8762b9cf7a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:39.534153 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4237ea-e2ee-4fd1-823c-4e8762b9cf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:39.552347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-0c4237ea-e2ee-4fd1-823c-4e8762b9cf7a None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:54:39.553530 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0c4237ea-e2ee-4fd1-823c-4e8762b9cf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:54:39.561547 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 737/1480] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:54:39.584368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a2ea0-008b-4843-9ff8-f398a7b55e23 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:54:39.597295 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a2ea0-008b-4843-9ff8-f398a7b55e23 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:54:39.601746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69244933-e865-4024-9d52-df837278e9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:54:39.602388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69244933-e865-4024-9d52-df837278e9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:39.602672 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69244933-e865-4024-9d52-df837278e9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:39.602949 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69244933-e865-4024-9d52-df837278e9a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:39.603707 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69244933-e865-4024-9d52-df837278e9a7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:54:39.605561 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69244933-e865-4024-9d52-df837278e9a7 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:54:39.620774 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 744/1481] 10.222.0.52 () {56 vars in 1108 bytes} [Tue Mar 8 11:54:39 2022] GET /identity/v3/projects => generated 2553 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 11:54:41.966216 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e17874-0989-4c71-a93b-bbc48910556b None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:41.966747 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e17874-0989-4c71-a93b-bbc48910556b None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:41.966747 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e17874-0989-4c71-a93b-bbc48910556b None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:41.968594 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 738/1482] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:54:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:54:41.973856 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963d26e-81d0-4bd3-8469-a47f231d23d2 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:41.974289 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963d26e-81d0-4bd3-8469-a47f231d23d2 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:41.974391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963d26e-81d0-4bd3-8469-a47f231d23d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:41.991848 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-8963d26e-81d0-4bd3-8469-a47f231d23d2 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:54:41.993029 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-8963d26e-81d0-4bd3-8469-a47f231d23d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:54:42.000919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 745/1483] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:54:42.042844 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e17874-0989-4c71-a93b-bbc48910556b None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:54:42.056952 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e17874-0989-4c71-a93b-bbc48910556b None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:54:42.062435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6187d6-e399-413d-b1f8-de8c54648a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:54:42.063064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6187d6-e399-413d-b1f8-de8c54648a76 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:42.063344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6187d6-e399-413d-b1f8-de8c54648a76 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:42.063678 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6187d6-e399-413d-b1f8-de8c54648a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:42.071467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6187d6-e399-413d-b1f8-de8c54648a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:54:42.074156 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6187d6-e399-413d-b1f8-de8c54648a76 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:54:42.082681 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 739/1484] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:54:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:54:44.650033 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c61e1-0108-4e3d-af62-f28779771343 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:44.652886 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c61e1-0108-4e3d-af62-f28779771343 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:44.652886 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c61e1-0108-4e3d-af62-f28779771343 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:44.653205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 746/1485] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:54:44.658489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f18f1c-21ab-4c50-b619-761b50be3869 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:44.658939 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f18f1c-21ab-4c50-b619-761b50be3869 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:44.659151 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f18f1c-21ab-4c50-b619-761b50be3869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:44.677686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-a7f18f1c-21ab-4c50-b619-761b50be3869 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:54:44.678868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a7f18f1c-21ab-4c50-b619-761b50be3869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:54:44.686569 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 740/1486] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:54:44.722735 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c61e1-0108-4e3d-af62-f28779771343 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:54:44.734198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c61e1-0108-4e3d-af62-f28779771343 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:54:44.737733 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc3575-d7d0-43c0-a933-00d8ea3e9578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:54:44.738365 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc3575-d7d0-43c0-a933-00d8ea3e9578 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:44.738643 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc3575-d7d0-43c0-a933-00d8ea3e9578 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:44.738915 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc3575-d7d0-43c0-a933-00d8ea3e9578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:44.747936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc3575-d7d0-43c0-a933-00d8ea3e9578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:54:44.749443 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc3575-d7d0-43c0-a933-00d8ea3e9578 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:54:44.758990 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 747/1487] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:54:47.094177 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e175f-d9c6-4e35-b96f-e8dbf1aae3c5 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:47.094696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e175f-d9c6-4e35-b96f-e8dbf1aae3c5 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:47.094696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e175f-d9c6-4e35-b96f-e8dbf1aae3c5 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:47.096481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 741/1488] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:54:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:54:47.101739 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0b236-d3e6-4c03-b773-aee6546286ee None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:47.102181 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0b236-d3e6-4c03-b773-aee6546286ee None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:47.102287 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0b236-d3e6-4c03-b773-aee6546286ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:47.121640 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-0cc0b236-d3e6-4c03-b773-aee6546286ee None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:54:47.122814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-0cc0b236-d3e6-4c03-b773-aee6546286ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:54:47.130735 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 748/1489] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:54:47.167301 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e175f-d9c6-4e35-b96f-e8dbf1aae3c5 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:54:47.178374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e175f-d9c6-4e35-b96f-e8dbf1aae3c5 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:54:47.181855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226e4da-aa9a-4cb9-b6cf-d030643457fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:54:47.182483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226e4da-aa9a-4cb9-b6cf-d030643457fb service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:47.182761 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226e4da-aa9a-4cb9-b6cf-d030643457fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:47.183033 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226e4da-aa9a-4cb9-b6cf-d030643457fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:47.192813 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226e4da-aa9a-4cb9-b6cf-d030643457fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:54:47.194244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226e4da-aa9a-4cb9-b6cf-d030643457fb service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:54:47.204839 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 742/1490] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:54:49.679406 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73eef3-f40b-44be-ad26-795865e33012 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:49.679952 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73eef3-f40b-44be-ad26-795865e33012 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:49.680087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73eef3-f40b-44be-ad26-795865e33012 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:49.681855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 749/1491] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:54:49.687414 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cc879-5d0e-4d56-ba20-455b995354dc None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:49.689357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cc879-5d0e-4d56-ba20-455b995354dc None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:49.689357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cc879-5d0e-4d56-ba20-455b995354dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:49.706517 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-b46cc879-5d0e-4d56-ba20-455b995354dc None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:54:49.707745 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b46cc879-5d0e-4d56-ba20-455b995354dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:54:49.716228 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 743/1492] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:54:49.758278 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73eef3-f40b-44be-ad26-795865e33012 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:54:49.769904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73eef3-f40b-44be-ad26-795865e33012 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:54:49.773915 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a985fb2-1e91-453c-b4ae-0841ceb2584f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:54:49.774574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a985fb2-1e91-453c-b4ae-0841ceb2584f service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:49.774854 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a985fb2-1e91-453c-b4ae-0841ceb2584f service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:49.775130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a985fb2-1e91-453c-b4ae-0841ceb2584f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:49.786508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a985fb2-1e91-453c-b4ae-0841ceb2584f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:54:49.788061 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a985fb2-1e91-453c-b4ae-0841ceb2584f service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:54:49.798689 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 750/1493] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 11:54:52.592144 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941d462-36fc-4ef6-8301-7bc926b5fe69 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:52.592674 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941d462-36fc-4ef6-8301-7bc926b5fe69 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:52.592674 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941d462-36fc-4ef6-8301-7bc926b5fe69 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:52.594429 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 744/1494] 10.222.0.52 () {54 vars in 926 bytes} [Tue Mar 8 11:54:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:54:52.599783 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468d492-0cae-485e-baf3-980eeb7eb904 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:52.600169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468d492-0cae-485e-baf3-980eeb7eb904 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:52.603683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468d492-0cae-485e-baf3-980eeb7eb904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:52.618115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-b468d492-0cae-485e-baf3-980eeb7eb904 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:54:52.619355 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-b468d492-0cae-485e-baf3-980eeb7eb904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:54:52.627202 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 751/1495] 10.222.0.52 () {58 vars in 1023 bytes} [Tue Mar 8 11:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:54:52.667170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941d462-36fc-4ef6-8301-7bc926b5fe69 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:54:52.677715 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941d462-36fc-4ef6-8301-7bc926b5fe69 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:54:52.681272 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31500bd4-2e23-4ad6-af6f-fb813d47df4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:54:52.681904 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31500bd4-2e23-4ad6-af6f-fb813d47df4b service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:54:52.682186 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31500bd4-2e23-4ad6-af6f-fb813d47df4b service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:54:52.682466 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31500bd4-2e23-4ad6-af6f-fb813d47df4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:54:52.691418 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31500bd4-2e23-4ad6-af6f-fb813d47df4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:54:52.692873 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31500bd4-2e23-4ad6-af6f-fb813d47df4b service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:54:52.702839 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 745/1496] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:56:27.225859 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eabe9-32d9-4a6b-9e65-214674835423 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:56:27.226410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eabe9-32d9-4a6b-9e65-214674835423 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:56:27.226532 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eabe9-32d9-4a6b-9e65-214674835423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:56:27.244084 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-446eabe9-32d9-4a6b-9e65-214674835423 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:56:27.245284 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-446eabe9-32d9-4a6b-9e65-214674835423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:56:27.253307 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 752/1497] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 11:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:56:27.263163 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15c4f3-64ad-4483-aeb7-1d09dd9077a2 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:56:27.263670 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15c4f3-64ad-4483-aeb7-1d09dd9077a2 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:56:27.263761 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15c4f3-64ad-4483-aeb7-1d09dd9077a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:56:27.281844 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-4d15c4f3-64ad-4483-aeb7-1d09dd9077a2 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:56:27.283024 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-4d15c4f3-64ad-4483-aeb7-1d09dd9077a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:56:27.290836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 746/1498] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 11:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:56:27.295417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446eabe9-32d9-4a6b-9e65-214674835423 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:56:27.305029 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446eabe9-32d9-4a6b-9e65-214674835423 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:56:27.309618 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58644491-e9e8-4334-bd84-2f09200cf16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:56:27.310259 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58644491-e9e8-4334-bd84-2f09200cf16a admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:56:27.310537 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58644491-e9e8-4334-bd84-2f09200cf16a admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:56:27.310810 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58644491-e9e8-4334-bd84-2f09200cf16a admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:56:27.311533 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58644491-e9e8-4334-bd84-2f09200cf16a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 11:56:27.311848 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58644491-e9e8-4334-bd84-2f09200cf16a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:56:27.312860 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING py.warnings [None req-58644491-e9e8-4334-bd84-2f09200cf16a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 11:56:27.312860 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: warnings.warn(msg) Mar 08 11:56:27.312860 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: Mar 08 11:56:27.313727 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58644491-e9e8-4334-bd84-2f09200cf16a admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:56:27.325343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 753/1499] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 11:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:56:27.333151 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15c4f3-64ad-4483-aeb7-1d09dd9077a2 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:56:27.342809 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15c4f3-64ad-4483-aeb7-1d09dd9077a2 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:56:27.347326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b54e0d-0791-4504-af1e-f4717fc0f4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:56:27.348018 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b54e0d-0791-4504-af1e-f4717fc0f4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:56:27.348302 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b54e0d-0791-4504-af1e-f4717fc0f4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:56:27.348577 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b54e0d-0791-4504-af1e-f4717fc0f4a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:56:27.349264 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b54e0d-0791-4504-af1e-f4717fc0f4a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:56:27.350989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING py.warnings [None req-12b54e0d-0791-4504-af1e-f4717fc0f4a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 11:56:27.350989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: warnings.warn(msg) Mar 08 11:56:27.350989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: Mar 08 11:56:27.352230 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b54e0d-0791-4504-af1e-f4717fc0f4a3 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:56:27.467143 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 747/1500] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 11:56:27 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:56:27.471410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58644491-e9e8-4334-bd84-2f09200cf16a admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:56:27.481246 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58644491-e9e8-4334-bd84-2f09200cf16a admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:56:27.534482 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914eed7-b1ba-4253-8485-5a7150c5c0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:56:27.535133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914eed7-b1ba-4253-8485-5a7150c5c0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:56:27.535412 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914eed7-b1ba-4253-8485-5a7150c5c0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:56:27.535718 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914eed7-b1ba-4253-8485-5a7150c5c0d7 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:56:27.536387 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914eed7-b1ba-4253-8485-5a7150c5c0d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:56:27.537438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING py.warnings [None req-2914eed7-b1ba-4253-8485-5a7150c5c0d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 11:56:27.537438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: warnings.warn(msg) Mar 08 11:56:27.537438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: Mar 08 11:56:27.538619 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914eed7-b1ba-4253-8485-5a7150c5c0d7 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:56:27.648975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 754/1501] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 11:56:27 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 11:56:27.653249 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b54e0d-0791-4504-af1e-f4717fc0f4a3 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:56:27.663296 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b54e0d-0791-4504-af1e-f4717fc0f4a3 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:56:27.668273 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87508b-984c-4cd3-8495-ea7893c54166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:56:27.668931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87508b-984c-4cd3-8495-ea7893c54166 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:56:27.669206 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87508b-984c-4cd3-8495-ea7893c54166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:56:27.669478 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87508b-984c-4cd3-8495-ea7893c54166 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:56:27.670194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87508b-984c-4cd3-8495-ea7893c54166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:56:27.671201 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING py.warnings [None req-1b87508b-984c-4cd3-8495-ea7893c54166 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 11:56:27.671201 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: warnings.warn(msg) Mar 08 11:56:27.671201 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: Mar 08 11:56:27.672109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87508b-984c-4cd3-8495-ea7893c54166 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:56:27.685068 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 748/1502] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 11:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 11:56:27.688965 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914eed7-b1ba-4253-8485-5a7150c5c0d7 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:56:27.699306 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914eed7-b1ba-4253-8485-5a7150c5c0d7 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:56:27.703878 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b002c02-b13c-412d-8cf4-aa11b360cca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:56:27.704523 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b002c02-b13c-412d-8cf4-aa11b360cca8 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:56:27.704810 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b002c02-b13c-412d-8cf4-aa11b360cca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:56:27.705082 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b002c02-b13c-412d-8cf4-aa11b360cca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:56:27.705795 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b002c02-b13c-412d-8cf4-aa11b360cca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:56:27.706841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING py.warnings [None req-1b002c02-b13c-412d-8cf4-aa11b360cca8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 11:56:27.706841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: warnings.warn(msg) Mar 08 11:56:27.706841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: Mar 08 11:56:27.707747 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b002c02-b13c-412d-8cf4-aa11b360cca8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:56:27.720708 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 755/1503] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 11:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 11:56:27.724722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87508b-984c-4cd3-8495-ea7893c54166 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:56:27.738165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87508b-984c-4cd3-8495-ea7893c54166 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:56:27.745476 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d81525-9f9d-4618-a3dc-3518c3d4655f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:56:27.746448 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d81525-9f9d-4618-a3dc-3518c3d4655f admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:56:27.746781 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d81525-9f9d-4618-a3dc-3518c3d4655f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:56:27.747112 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d81525-9f9d-4618-a3dc-3518c3d4655f admin admin] PATH_INFO: `/v3/projects/f482eb4c96e64fbf8a56984379e87465/users/d70ea193afb44d55873dbc501a64bec2/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:56:27.765531 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d81525-9f9d-4618-a3dc-3518c3d4655f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f482eb4c96e64fbf8a56984379e87465, user_id=d70ea193afb44d55873dbc501a64bec2, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:56:27.766582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING py.warnings [None req-03d81525-9f9d-4618-a3dc-3518c3d4655f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 11:56:27.766582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: warnings.warn(msg) Mar 08 11:56:27.766582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: Mar 08 11:56:27.768571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d81525-9f9d-4618-a3dc-3518c3d4655f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:56:27.838736 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 749/1504] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 11:56:27 2022] PUT /identity/v3/projects/f482eb4c96e64fbf8a56984379e87465/users/d70ea193afb44d55873dbc501a64bec2/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 11:56:27.850154 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b81275-1387-427b-9d7d-aa5913b9be21 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:56:27.850440 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b81275-1387-427b-9d7d-aa5913b9be21 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:56:27.850714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b81275-1387-427b-9d7d-aa5913b9be21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:56:27.876630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-81b81275-1387-427b-9d7d-aa5913b9be21 None None] MFA Rules not processed for user `d70ea193afb44d55873dbc501a64bec2`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:56:27.881607 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-81b81275-1387-427b-9d7d-aa5913b9be21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:56:27.937866 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 756/1505] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 11:56:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:56:27.949353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d81525-9f9d-4618-a3dc-3518c3d4655f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:56:28.016065 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d81525-9f9d-4618-a3dc-3518c3d4655f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:56:28.021341 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a321ad-b855-4058-8e7c-56a58f0b2b6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:56:28.021981 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a321ad-b855-4058-8e7c-56a58f0b2b6d service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:56:28.022259 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a321ad-b855-4058-8e7c-56a58f0b2b6d service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:56:28.022531 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a321ad-b855-4058-8e7c-56a58f0b2b6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:56:28.030543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a321ad-b855-4058-8e7c-56a58f0b2b6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:56:28.032171 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a321ad-b855-4058-8e7c-56a58f0b2b6d service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:56:28.040634 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 750/1506] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:56:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:56:28.113253 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9af8d-5dcc-47a2-bbe5-c34aa533fa54 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:56:28.113546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9af8d-5dcc-47a2-bbe5-c34aa533fa54 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:56:28.113855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9af8d-5dcc-47a2-bbe5-c34aa533fa54 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:56:28.115601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 757/1507] 10.222.0.52 () {52 vars in 829 bytes} [Tue Mar 8 11:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:56:28.119536 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a321ad-b855-4058-8e7c-56a58f0b2b6d service nova] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:56:28.178556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a321ad-b855-4058-8e7c-56a58f0b2b6d service nova] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:56:28.183132 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5dfe7-02a0-4c7d-abcc-d29a5d2fb390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:56:28.184030 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5dfe7-02a0-4c7d-abcc-d29a5d2fb390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:56:28.184312 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5dfe7-02a0-4c7d-abcc-d29a5d2fb390 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:56:28.184583 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5dfe7-02a0-4c7d-abcc-d29a5d2fb390 admin admin] PATH_INFO: `/v3/users/d70ea193afb44d55873dbc501a64bec2` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:56:28.185773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5dfe7-02a0-4c7d-abcc-d29a5d2fb390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70ea193afb44d55873dbc501a64bec2)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:56:28.186793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING py.warnings [None req-bbd5dfe7-02a0-4c7d-abcc-d29a5d2fb390 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 11:56:28.186793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: warnings.warn(msg) Mar 08 11:56:28.186793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: Mar 08 11:56:28.188088 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5dfe7-02a0-4c7d-abcc-d29a5d2fb390 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:56:28.381730 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-bbd5dfe7-02a0-4c7d-abcc-d29a5d2fb390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70ea193afb44d55873dbc501a64bec2'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 11:56:28.382419 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-bbd5dfe7-02a0-4c7d-abcc-d29a5d2fb390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70ea193afb44d55873dbc501a64bec2'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 11:56:28.443458 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-bbd5dfe7-02a0-4c7d-abcc-d29a5d2fb390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70ea193afb44d55873dbc501a64bec2'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 11:56:28.463675 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-bbd5dfe7-02a0-4c7d-abcc-d29a5d2fb390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70ea193afb44d55873dbc501a64bec2'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 11:56:28.475766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-bbd5dfe7-02a0-4c7d-abcc-d29a5d2fb390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70ea193afb44d55873dbc501a64bec2'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 11:56:28.482092 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 751/1508] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 11:56:28 2022] DELETE /identity/v3/users/d70ea193afb44d55873dbc501a64bec2 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:56:28.486785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e06af-7bda-4b86-b747-638f3388f7d4 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:56:28.501424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e06af-7bda-4b86-b747-638f3388f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:56:28.501424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e06af-7bda-4b86-b747-638f3388f7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:56:28.505911 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-fa8e06af-7bda-4b86-b747-638f3388f7d4 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:56:28.507116 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-fa8e06af-7bda-4b86-b747-638f3388f7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:56:28.564269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 758/1509] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 11:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:56:28.575073 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5dfe7-02a0-4c7d-abcc-d29a5d2fb390 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:56:28.576563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-bbd5dfe7-02a0-4c7d-abcc-d29a5d2fb390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:56:28.632013 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5dfe7-02a0-4c7d-abcc-d29a5d2fb390 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:56:28.636325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c80480-fd8a-41f4-883c-604714bd859d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:56:28.636970 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c80480-fd8a-41f4-883c-604714bd859d service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:56:28.637254 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c80480-fd8a-41f4-883c-604714bd859d service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:56:28.637533 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c80480-fd8a-41f4-883c-604714bd859d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:56:28.646149 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c80480-fd8a-41f4-883c-604714bd859d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:56:28.647613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c80480-fd8a-41f4-883c-604714bd859d service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:56:28.656813 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 752/1510] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:56:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:56:29.192076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e06af-7bda-4b86-b747-638f3388f7d4 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:56:29.193485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-fa8e06af-7bda-4b86-b747-638f3388f7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:56:29.209939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e06af-7bda-4b86-b747-638f3388f7d4 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:56:29.216791 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:56:29.217869 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:56:29.218128 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:56:29.218409 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7 admin admin] PATH_INFO: `/v3/projects/f482eb4c96e64fbf8a56984379e87465` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:56:29.219704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f482eb4c96e64fbf8a56984379e87465)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:56:29.220746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING py.warnings [None req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 11:56:29.220746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: warnings.warn(msg) Mar 08 11:56:29.220746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: Mar 08 11:56:29.221932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:56:29.368223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f482eb4c96e64fbf8a56984379e87465', 'request_id': 'req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 11:56:29.381354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f482eb4c96e64fbf8a56984379e87465', 'request_id': 'req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 11:56:29.465937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f482eb4c96e64fbf8a56984379e87465', 'request_id': 'req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 11:56:29.477461 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7 admin admin] The token cache is being invalidate because project f482eb4c96e64fbf8a56984379e87465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 11:56:29.477747 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 11:56:29.478478 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-2d7be7a5-e666-44b4-baba-cca4f7a02cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 11:56:29.480068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 759/1511] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 11:56:29 2022] DELETE /identity/v3/projects/f482eb4c96e64fbf8a56984379e87465 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 11:58:05.265297 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b6970-c11f-4aed-a2fa-62dcbe2b773a None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:05.265893 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b6970-c11f-4aed-a2fa-62dcbe2b773a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:05.265893 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b6970-c11f-4aed-a2fa-62dcbe2b773a None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:05.267629 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 753/1512] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 11:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:58:05.272607 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11182d-1d55-454a-b122-d26e76935c75 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:05.273067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11182d-1d55-454a-b122-d26e76935c75 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:05.273184 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11182d-1d55-454a-b122-d26e76935c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:05.293026 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-0f11182d-1d55-454a-b122-d26e76935c75 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:58:05.294417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-0f11182d-1d55-454a-b122-d26e76935c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:58:05.351494 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 760/1513] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 11:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:58:05.497626 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae8cc0-f39b-4878-a40a-f940f05ca16f None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:05.497829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae8cc0-f39b-4878-a40a-f940f05ca16f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:05.498121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae8cc0-f39b-4878-a40a-f940f05ca16f None None] PATH_INFO: `/v3` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:05.499423 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 754/1514] 10.222.0.58 () {54 vars in 925 bytes} [Tue Mar 8 11:58:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 11:58:05.505701 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d2b8b-8bbe-46ce-baf1-4b87d73406c2 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:05.505987 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d2b8b-8bbe-46ce-baf1-4b87d73406c2 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:05.506266 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d2b8b-8bbe-46ce-baf1-4b87d73406c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:05.508139 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae8cc0-f39b-4878-a40a-f940f05ca16f None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:58:05.509847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b1ae8cc0-f39b-4878-a40a-f940f05ca16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:58:05.524495 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-d76d2b8b-8bbe-46ce-baf1-4b87d73406c2 None None] MFA Rules not processed for user `8855284b10c64b8ca367e3c30b5f66fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:58:05.525708 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d76d2b8b-8bbe-46ce-baf1-4b87d73406c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:58:05.582389 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae8cc0-f39b-4878-a40a-f940f05ca16f None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:58:05.587635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 761/1515] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Mar 8 11:58:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:58:05.592872 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1183ae0-e300-4727-88b0-be5befabdf6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:58:05.592872 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1183ae0-e300-4727-88b0-be5befabdf6f service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:05.592872 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1183ae0-e300-4727-88b0-be5befabdf6f service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:05.592872 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1183ae0-e300-4727-88b0-be5befabdf6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:05.599106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1183ae0-e300-4727-88b0-be5befabdf6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:58:05.600742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1183ae0-e300-4727-88b0-be5befabdf6f service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:58:05.610104 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 755/1516] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:58:06.925661 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b784639-c9a6-47b8-8fa1-8e0851117405 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:06.926185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b784639-c9a6-47b8-8fa1-8e0851117405 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:06.926185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b784639-c9a6-47b8-8fa1-8e0851117405 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:06.928103 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 762/1517] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 11:58:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:58:06.933002 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ca096-fbc1-4ae9-8af8-5afac420931c None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:06.933424 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ca096-fbc1-4ae9-8af8-5afac420931c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:06.933554 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ca096-fbc1-4ae9-8af8-5afac420931c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:06.951979 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-611ca096-fbc1-4ae9-8af8-5afac420931c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:58:06.953182 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-611ca096-fbc1-4ae9-8af8-5afac420931c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:58:06.962050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 756/1518] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 11:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:58:07.117234 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b784639-c9a6-47b8-8fa1-8e0851117405 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:58:07.131582 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b784639-c9a6-47b8-8fa1-8e0851117405 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:58:07.136858 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da20444-eb4c-4670-ae27-f3c55100eff3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:58:07.137487 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da20444-eb4c-4670-ae27-f3c55100eff3 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:07.137770 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da20444-eb4c-4670-ae27-f3c55100eff3 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:07.138048 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da20444-eb4c-4670-ae27-f3c55100eff3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:07.146458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da20444-eb4c-4670-ae27-f3c55100eff3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:58:07.148098 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da20444-eb4c-4670-ae27-f3c55100eff3 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:58:07.157168 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 763/1519] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:58:14.666669 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef678dce-f740-490e-ad49-c9a1bd0046d2 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:14.667178 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef678dce-f740-490e-ad49-c9a1bd0046d2 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:14.667293 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef678dce-f740-490e-ad49-c9a1bd0046d2 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:14.669236 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 757/1520] 10.222.0.52 () {54 vars in 960 bytes} [Tue Mar 8 11:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:58:14.674626 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef787b8-08c0-4f85-b036-3def17e0ad46 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:14.675136 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef787b8-08c0-4f85-b036-3def17e0ad46 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:14.675237 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef787b8-08c0-4f85-b036-3def17e0ad46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:14.692846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-9ef787b8-08c0-4f85-b036-3def17e0ad46 None None] MFA Rules not processed for user `8855284b10c64b8ca367e3c30b5f66fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:58:14.694023 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-9ef787b8-08c0-4f85-b036-3def17e0ad46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:58:14.702389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 764/1521] 10.222.0.52 () {58 vars in 1057 bytes} [Tue Mar 8 11:58:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:58:14.710072 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef678dce-f740-490e-ad49-c9a1bd0046d2 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:58:14.723978 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef678dce-f740-490e-ad49-c9a1bd0046d2 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:58:14.729031 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131130a3-d2e6-4dfb-a7bd-64d43082f7a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8855284b10c64b8ca367e3c30b5f66fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:58:14.729669 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131130a3-d2e6-4dfb-a7bd-64d43082f7a1 service placement] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:14.729955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131130a3-d2e6-4dfb-a7bd-64d43082f7a1 service placement] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:14.730234 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131130a3-d2e6-4dfb-a7bd-64d43082f7a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:14.739378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131130a3-d2e6-4dfb-a7bd-64d43082f7a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:58:14.741125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131130a3-d2e6-4dfb-a7bd-64d43082f7a1 service placement] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:58:14.750896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 758/1522] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:58:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:58:18.842566 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abe83c-3d3d-4d6e-b700-81cbf04e2b85 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:18.843107 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abe83c-3d3d-4d6e-b700-81cbf04e2b85 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:18.843107 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abe83c-3d3d-4d6e-b700-81cbf04e2b85 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:18.844955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 765/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 11:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:58:18.850660 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96d9a1-196e-4a79-a4bf-62c09716fa63 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:18.854630 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96d9a1-196e-4a79-a4bf-62c09716fa63 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:18.854630 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96d9a1-196e-4a79-a4bf-62c09716fa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:18.871743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-0d96d9a1-196e-4a79-a4bf-62c09716fa63 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:58:18.872972 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0d96d9a1-196e-4a79-a4bf-62c09716fa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:58:18.881210 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 759/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 11:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:58:19.035082 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abe83c-3d3d-4d6e-b700-81cbf04e2b85 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:58:19.050361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abe83c-3d3d-4d6e-b700-81cbf04e2b85 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:58:19.055860 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be96dc0-ae64-4e49-8c0d-d02c6fcc1b40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:58:19.056496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be96dc0-ae64-4e49-8c0d-d02c6fcc1b40 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:19.056780 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be96dc0-ae64-4e49-8c0d-d02c6fcc1b40 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:19.057060 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be96dc0-ae64-4e49-8c0d-d02c6fcc1b40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:19.065223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be96dc0-ae64-4e49-8c0d-d02c6fcc1b40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:58:19.066815 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be96dc0-ae64-4e49-8c0d-d02c6fcc1b40 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:58:19.076276 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 766/1525] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:58:20.352602 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b194ef4-3e1f-4946-b8df-63560455b0b8 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:20.353155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b194ef4-3e1f-4946-b8df-63560455b0b8 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:20.353575 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b194ef4-3e1f-4946-b8df-63560455b0b8 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:20.356903 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 760/1526] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 11:58:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:58:20.362851 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f42a65-9ddf-4de6-b430-3732c5a872cc None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:20.363316 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f42a65-9ddf-4de6-b430-3732c5a872cc None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:20.363417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f42a65-9ddf-4de6-b430-3732c5a872cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:20.382041 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-00f42a65-9ddf-4de6-b430-3732c5a872cc None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:58:20.383237 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-00f42a65-9ddf-4de6-b430-3732c5a872cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:58:20.390959 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 767/1527] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 11:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:58:20.546073 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b194ef4-3e1f-4946-b8df-63560455b0b8 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:58:20.560449 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b194ef4-3e1f-4946-b8df-63560455b0b8 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:58:20.566946 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fd407-d47f-4be6-8cf9-694842229d3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:58:20.567607 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fd407-d47f-4be6-8cf9-694842229d3c service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:20.567893 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fd407-d47f-4be6-8cf9-694842229d3c service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:20.568172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fd407-d47f-4be6-8cf9-694842229d3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:20.576019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fd407-d47f-4be6-8cf9-694842229d3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:58:20.577598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fd407-d47f-4be6-8cf9-694842229d3c service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:58:20.587967 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 761/1528] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:58:24.974845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a8daf-9310-4c3a-9133-7b09846a6112 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:24.975395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a8daf-9310-4c3a-9133-7b09846a6112 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:24.975395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a8daf-9310-4c3a-9133-7b09846a6112 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:24.977231 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 768/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 11:58:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:58:24.982399 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469e30a-7dd8-4b58-95d1-daa23665d6d2 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:24.982802 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469e30a-7dd8-4b58-95d1-daa23665d6d2 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:24.982948 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469e30a-7dd8-4b58-95d1-daa23665d6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:25.001056 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-7469e30a-7dd8-4b58-95d1-daa23665d6d2 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:58:25.002236 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-7469e30a-7dd8-4b58-95d1-daa23665d6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:58:25.009874 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 762/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:58:25.045916 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a8daf-9310-4c3a-9133-7b09846a6112 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:58:25.047633 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-109a8daf-9310-4c3a-9133-7b09846a6112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:58:25.106574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a8daf-9310-4c3a-9133-7b09846a6112 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:58:25.110071 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb17cd-0a03-46d6-9a46-f95649c8645e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:58:25.110909 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb17cd-0a03-46d6-9a46-f95649c8645e service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:25.111190 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb17cd-0a03-46d6-9a46-f95649c8645e service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:25.111471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb17cd-0a03-46d6-9a46-f95649c8645e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:25.120345 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb17cd-0a03-46d6-9a46-f95649c8645e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:58:25.121780 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb17cd-0a03-46d6-9a46-f95649c8645e service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:58:25.130944 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 769/1531] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:58:27.435851 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dbfb7-903d-47cb-a699-598d8a7c3633 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:27.436403 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dbfb7-903d-47cb-a699-598d8a7c3633 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:27.436403 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dbfb7-903d-47cb-a699-598d8a7c3633 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:27.438867 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 763/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 11:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:58:27.444109 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0efd5-ba5f-482a-882d-71487ea5d845 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:27.444520 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0efd5-ba5f-482a-882d-71487ea5d845 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:27.444764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0efd5-ba5f-482a-882d-71487ea5d845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:27.462991 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-94c0efd5-ba5f-482a-882d-71487ea5d845 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:58:27.464222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-94c0efd5-ba5f-482a-882d-71487ea5d845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:58:27.473391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 770/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 11:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:58:27.508209 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dbfb7-903d-47cb-a699-598d8a7c3633 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:58:27.519194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dbfb7-903d-47cb-a699-598d8a7c3633 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:58:27.522692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490279e1-3ed7-45b8-83df-aeb20e388934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:58:27.523322 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490279e1-3ed7-45b8-83df-aeb20e388934 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:27.523637 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490279e1-3ed7-45b8-83df-aeb20e388934 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:27.523911 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490279e1-3ed7-45b8-83df-aeb20e388934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:27.533161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490279e1-3ed7-45b8-83df-aeb20e388934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:58:27.534576 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490279e1-3ed7-45b8-83df-aeb20e388934 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:58:27.543590 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 764/1534] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:58:31.620739 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26cb9e-92ad-4c50-9a4c-f3fa66f50f9d None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:31.621265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26cb9e-92ad-4c50-9a4c-f3fa66f50f9d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:31.621265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26cb9e-92ad-4c50-9a4c-f3fa66f50f9d None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:31.623019 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 771/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 11:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:58:31.629077 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efb3f9-7f5e-4c53-b8b6-c1dae82b7c2e None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:31.629476 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efb3f9-7f5e-4c53-b8b6-c1dae82b7c2e None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:31.629625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efb3f9-7f5e-4c53-b8b6-c1dae82b7c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:31.647326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-08efb3f9-7f5e-4c53-b8b6-c1dae82b7c2e None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:58:31.648556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-08efb3f9-7f5e-4c53-b8b6-c1dae82b7c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:58:31.656250 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 765/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 11:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 11:58:31.921542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26cb9e-92ad-4c50-9a4c-f3fa66f50f9d None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:58:31.924001 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-ba26cb9e-92ad-4c50-9a4c-f3fa66f50f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:58:31.980975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26cb9e-92ad-4c50-9a4c-f3fa66f50f9d None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:58:31.984476 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6effc7f-988a-4e16-924b-3aaabdfe6460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:58:31.985723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6effc7f-988a-4e16-924b-3aaabdfe6460 service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:31.986010 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6effc7f-988a-4e16-924b-3aaabdfe6460 service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:31.986283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6effc7f-988a-4e16-924b-3aaabdfe6460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:31.995219 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6effc7f-988a-4e16-924b-3aaabdfe6460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:58:31.996715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6effc7f-988a-4e16-924b-3aaabdfe6460 service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:58:32.006393 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 772/1537] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 11:58:34.359377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f93c0-4924-4f78-b371-ee031447a703 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:34.359986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f93c0-4924-4f78-b371-ee031447a703 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:34.360090 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f93c0-4924-4f78-b371-ee031447a703 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:34.361948 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 766/1538] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 11:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:58:34.367739 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80e099-5691-4750-941c-26218ce21c3e None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:34.368201 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80e099-5691-4750-941c-26218ce21c3e None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:34.368305 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80e099-5691-4750-941c-26218ce21c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:34.386003 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-db80e099-5691-4750-941c-26218ce21c3e None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:58:34.391437 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-db80e099-5691-4750-941c-26218ce21c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:58:34.395858 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 773/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 11:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:58:34.651582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12530f-09e8-4795-9d91-df241c244eaf None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:34.651879 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12530f-09e8-4795-9d91-df241c244eaf None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:34.652154 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12530f-09e8-4795-9d91-df241c244eaf None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:34.653901 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 767/1540] 10.222.0.52 () {54 vars in 963 bytes} [Tue Mar 8 11:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 11:58:34.659403 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39eae6-23e9-4af8-bf84-081c00a4eec3 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:34.659732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39eae6-23e9-4af8-bf84-081c00a4eec3 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:34.660013 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39eae6-23e9-4af8-bf84-081c00a4eec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:34.677751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-cd39eae6-23e9-4af8-bf84-081c00a4eec3 None None] MFA Rules not processed for user `1c5631271ed54eacbbbbbb5c8d14d764`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 11:58:34.678924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-cd39eae6-23e9-4af8-bf84-081c00a4eec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 11:58:34.685353 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 774/1541] 10.222.0.52 () {58 vars in 1060 bytes} [Tue Mar 8 11:58:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 11:58:34.693445 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12530f-09e8-4795-9d91-df241c244eaf None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 11:58:34.705919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12530f-09e8-4795-9d91-df241c244eaf None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 11:58:34.710051 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f91d5c-8e6a-4ff9-a865-68a74b95c700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 11:58:34.710782 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f91d5c-8e6a-4ff9-a865-68a74b95c700 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 11:58:34.711167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f91d5c-8e6a-4ff9-a865-68a74b95c700 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 11:58:34.711571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f91d5c-8e6a-4ff9-a865-68a74b95c700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 11:58:34.720696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f91d5c-8e6a-4ff9-a865-68a74b95c700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 11:58:34.722114 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f91d5c-8e6a-4ff9-a865-68a74b95c700 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 11:58:34.731304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 768/1542] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 11:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:05.769315 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f031da-ad41-465b-8246-722a0ed0bba9 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:05.769969 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f031da-ad41-465b-8246-722a0ed0bba9 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:05.769969 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f031da-ad41-465b-8246-722a0ed0bba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:05.808861 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-63f031da-ad41-465b-8246-722a0ed0bba9 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:05.811569 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-63f031da-ad41-465b-8246-722a0ed0bba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:05.822064 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 775/1543] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Mar 08 12:00:05.831342 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee7ffb-d463-4416-b0a5-b01baeb7a8af None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:05.831933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee7ffb-d463-4416-b0a5-b01baeb7a8af None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:05.831933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee7ffb-d463-4416-b0a5-b01baeb7a8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:05.860006 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-abee7ffb-d463-4416-b0a5-b01baeb7a8af None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:05.861895 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-abee7ffb-d463-4416-b0a5-b01baeb7a8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:05.875212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 769/1544] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:05.880162 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f031da-ad41-465b-8246-722a0ed0bba9 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:05.895298 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f031da-ad41-465b-8246-722a0ed0bba9 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:05.897777 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bd954-7970-4f98-afdf-eaecdd84d6f2 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:05.898069 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bd954-7970-4f98-afdf-eaecdd84d6f2 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:05.898574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bd954-7970-4f98-afdf-eaecdd84d6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:05.900520 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4f6af-52b2-4b82-8818-23c70b5cf60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:05.901445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4f6af-52b2-4b82-8818-23c70b5cf60a admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:05.901960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4f6af-52b2-4b82-8818-23c70b5cf60a admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:05.903160 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4f6af-52b2-4b82-8818-23c70b5cf60a admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:05.904270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4f6af-52b2-4b82-8818-23c70b5cf60a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:05.904923 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4f6af-52b2-4b82-8818-23c70b5cf60a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:05.906978 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4f6af-52b2-4b82-8818-23c70b5cf60a admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:05.929957 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 776/1545] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:05.932731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-e49bd954-7970-4f98-afdf-eaecdd84d6f2 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:05.932731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e49bd954-7970-4f98-afdf-eaecdd84d6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:05.939013 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4f6af-52b2-4b82-8818-23c70b5cf60a admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:05.951369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 770/1546] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:00:05.954519 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4f6af-52b2-4b82-8818-23c70b5cf60a admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:05.959391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee366e-3397-4d08-af22-b0736134e87a None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:05.959715 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee366e-3397-4d08-af22-b0736134e87a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:05.960002 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee366e-3397-4d08-af22-b0736134e87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:05.960340 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ddfcf-400f-4e15-b17c-46f4389dc685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:05.961240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ddfcf-400f-4e15-b17c-46f4389dc685 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:05.961830 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ddfcf-400f-4e15-b17c-46f4389dc685 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:05.962333 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ddfcf-400f-4e15-b17c-46f4389dc685 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:05.963320 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ddfcf-400f-4e15-b17c-46f4389dc685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:05.969553 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING py.warnings [None req-c38ddfcf-400f-4e15-b17c-46f4389dc685 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 12:00:05.969553 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: warnings.warn(msg) Mar 08 12:00:05.969553 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: Mar 08 12:00:05.971465 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ddfcf-400f-4e15-b17c-46f4389dc685 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:05.989101 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-19ee366e-3397-4d08-af22-b0736134e87a None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:05.990360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-19ee366e-3397-4d08-af22-b0736134e87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:06.010859 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 771/1547] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:06.015105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee366e-3397-4d08-af22-b0736134e87a None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.034009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee366e-3397-4d08-af22-b0736134e87a None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.036553 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10cf79-741f-4ed9-b3d3-6c93c8f66850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.037253 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10cf79-741f-4ed9-b3d3-6c93c8f66850 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.037545 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10cf79-741f-4ed9-b3d3-6c93c8f66850 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.037820 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10cf79-741f-4ed9-b3d3-6c93c8f66850 admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.038558 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10cf79-741f-4ed9-b3d3-6c93c8f66850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:06.038868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10cf79-741f-4ed9-b3d3-6c93c8f66850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.039979 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING py.warnings [None req-fd10cf79-741f-4ed9-b3d3-6c93c8f66850 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 12:00:06.039979 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: warnings.warn(msg) Mar 08 12:00:06.039979 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: Mar 08 12:00:06.041563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10cf79-741f-4ed9-b3d3-6c93c8f66850 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.061042 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 772/1548] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:00:06.075882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10cf79-741f-4ed9-b3d3-6c93c8f66850 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.091706 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10cf79-741f-4ed9-b3d3-6c93c8f66850 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.102635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 777/1549] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:05 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:06.109518 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16599b9f-1058-446d-8e35-c3628421d2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.110241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16599b9f-1058-446d-8e35-c3628421d2ae admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.110782 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16599b9f-1058-446d-8e35-c3628421d2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.111064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16599b9f-1058-446d-8e35-c3628421d2ae admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.111800 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16599b9f-1058-446d-8e35-c3628421d2ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.113883 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ddfcf-400f-4e15-b17c-46f4389dc685 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.114209 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16599b9f-1058-446d-8e35-c3628421d2ae admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.232801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ddfcf-400f-4e15-b17c-46f4389dc685 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.238686 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b551802-4a1b-4b4d-aa43-50c9b606ab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.242144 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b551802-4a1b-4b4d-aa43-50c9b606ab5f admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.242144 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b551802-4a1b-4b4d-aa43-50c9b606ab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.242144 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b551802-4a1b-4b4d-aa43-50c9b606ab5f admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.242144 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b551802-4a1b-4b4d-aa43-50c9b606ab5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.243926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 773/1550] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:00:06.244197 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b551802-4a1b-4b4d-aa43-50c9b606ab5f admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.245472 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223ca82-c02e-4ac0-acff-edaed57d9d7c None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.247101 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223ca82-c02e-4ac0-acff-edaed57d9d7c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.247470 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223ca82-c02e-4ac0-acff-edaed57d9d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.272789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-5223ca82-c02e-4ac0-acff-edaed57d9d7c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:06.276552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5223ca82-c02e-4ac0-acff-edaed57d9d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:06.335850 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 778/1551] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:00:06.339572 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761ba57-da53-4ef6-8a54-bf03c6c2ddc2 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.339572 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761ba57-da53-4ef6-8a54-bf03c6c2ddc2 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.339572 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761ba57-da53-4ef6-8a54-bf03c6c2ddc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.344440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 774/1552] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:06.352143 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223ca82-c02e-4ac0-acff-edaed57d9d7c None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.356117 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223ca82-c02e-4ac0-acff-edaed57d9d7c None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.361714 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90d3f0-8852-4ec8-9864-9ac7ace44bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.362267 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-4761ba57-da53-4ef6-8a54-bf03c6c2ddc2 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:06.362790 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90d3f0-8852-4ec8-9864-9ac7ace44bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.363230 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90d3f0-8852-4ec8-9864-9ac7ace44bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.363702 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90d3f0-8852-4ec8-9864-9ac7ace44bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.363962 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-4761ba57-da53-4ef6-8a54-bf03c6c2ddc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:06.364742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90d3f0-8852-4ec8-9864-9ac7ace44bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.366046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING py.warnings [None req-2f90d3f0-8852-4ec8-9864-9ac7ace44bb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 12:00:06.366046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: warnings.warn(msg) Mar 08 12:00:06.366046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: Mar 08 12:00:06.367597 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90d3f0-8852-4ec8-9864-9ac7ace44bb6 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.373125 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 779/1553] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:06.376917 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd35419-151c-4378-b840-daf0f5da89a7 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.377145 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd35419-151c-4378-b840-daf0f5da89a7 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.377510 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd35419-151c-4378-b840-daf0f5da89a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.395465 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-efd35419-151c-4378-b840-daf0f5da89a7 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:06.396733 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-efd35419-151c-4378-b840-daf0f5da89a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:06.405286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 780/1554] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:06.406533 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faefb4-ed7d-4cfe-a29f-550a9a9d0fa9 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.406826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faefb4-ed7d-4cfe-a29f-550a9a9d0fa9 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.407109 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faefb4-ed7d-4cfe-a29f-550a9a9d0fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.424772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-e2faefb4-ed7d-4cfe-a29f-550a9a9d0fa9 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:06.426046 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-e2faefb4-ed7d-4cfe-a29f-550a9a9d0fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:06.433827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 781/1555] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:06.435274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93036543-2e8e-4028-8f5d-bd27168927e1 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.435585 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93036543-2e8e-4028-8f5d-bd27168927e1 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.435865 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93036543-2e8e-4028-8f5d-bd27168927e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.453957 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-93036543-2e8e-4028-8f5d-bd27168927e1 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:06.455140 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-93036543-2e8e-4028-8f5d-bd27168927e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:06.462927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 782/1556] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:06.466481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93036543-2e8e-4028-8f5d-bd27168927e1 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.473567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93036543-2e8e-4028-8f5d-bd27168927e1 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.476638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 775/1557] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:06.476638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1f38a-f510-45bb-8ede-e96434e2de27 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.476638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1f38a-f510-45bb-8ede-e96434e2de27 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.476638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1f38a-f510-45bb-8ede-e96434e2de27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.478544 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2a8da-6f88-4dbe-83a3-72c00160744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.479202 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2a8da-6f88-4dbe-83a3-72c00160744e admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.479485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2a8da-6f88-4dbe-83a3-72c00160744e admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.479795 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2a8da-6f88-4dbe-83a3-72c00160744e admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.480543 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2a8da-6f88-4dbe-83a3-72c00160744e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.482280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2a8da-6f88-4dbe-83a3-72c00160744e admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.492448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 783/1558] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:06.494269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced36a60-b97d-47cb-8410-e882738be9a5 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.494269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced36a60-b97d-47cb-8410-e882738be9a5 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.494269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced36a60-b97d-47cb-8410-e882738be9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.494924 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-bba1f38a-f510-45bb-8ede-e96434e2de27 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:06.496221 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-bba1f38a-f510-45bb-8ede-e96434e2de27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:06.504167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 776/1559] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:06.505381 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df6504-6424-4542-82e3-9b692077cf62 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.505675 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df6504-6424-4542-82e3-9b692077cf62 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.505977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df6504-6424-4542-82e3-9b692077cf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.513183 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-ced36a60-b97d-47cb-8410-e882738be9a5 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:06.514389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-ced36a60-b97d-47cb-8410-e882738be9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:06.522239 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 784/1560] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:06.523624 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28b9b0-8c6e-40b4-9358-fd35837926ce None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.523913 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28b9b0-8c6e-40b4-9358-fd35837926ce None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.524192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28b9b0-8c6e-40b4-9358-fd35837926ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.530444 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-71df6504-6424-4542-82e3-9b692077cf62 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:06.532398 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-71df6504-6424-4542-82e3-9b692077cf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:06.540136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 777/1561] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:06.542450 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-fe28b9b0-8c6e-40b4-9358-fd35837926ce None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:06.543820 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-fe28b9b0-8c6e-40b4-9358-fd35837926ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:06.545152 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20467fe8-fd77-4ade-965f-177796177df8 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.546191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20467fe8-fd77-4ade-965f-177796177df8 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.546191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20467fe8-fd77-4ade-965f-177796177df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.555047 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 785/1562] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:06.555047 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8769c0a-6dea-49aa-9d4f-29d288e3fbf9 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.555047 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8769c0a-6dea-49aa-9d4f-29d288e3fbf9 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.555047 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8769c0a-6dea-49aa-9d4f-29d288e3fbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.564299 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-20467fe8-fd77-4ade-965f-177796177df8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:06.565499 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-20467fe8-fd77-4ade-965f-177796177df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:06.572853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-b8769c0a-6dea-49aa-9d4f-29d288e3fbf9 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:06.573834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 778/1563] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:06.574168 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-b8769c0a-6dea-49aa-9d4f-29d288e3fbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:06.575265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20467fe8-fd77-4ade-965f-177796177df8 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.583325 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 786/1564] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:06.584152 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8769c0a-6dea-49aa-9d4f-29d288e3fbf9 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.584624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20467fe8-fd77-4ade-965f-177796177df8 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.591781 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1522e-ab49-49c4-b07c-f603a339364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.592397 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1522e-ab49-49c4-b07c-f603a339364f admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.592685 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1522e-ab49-49c4-b07c-f603a339364f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.592966 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1522e-ab49-49c4-b07c-f603a339364f admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.593693 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8769c0a-6dea-49aa-9d4f-29d288e3fbf9 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.593818 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1522e-ab49-49c4-b07c-f603a339364f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.595297 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1522e-ab49-49c4-b07c-f603a339364f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.599109 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a5b77-97ce-481f-a88f-b7b6b2831790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.599798 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a5b77-97ce-481f-a88f-b7b6b2831790 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.600083 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a5b77-97ce-481f-a88f-b7b6b2831790 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.600365 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a5b77-97ce-481f-a88f-b7b6b2831790 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.601087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a5b77-97ce-481f-a88f-b7b6b2831790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.602716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a5b77-97ce-481f-a88f-b7b6b2831790 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.606000 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 779/1565] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:06.606968 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1522e-ab49-49c4-b07c-f603a339364f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.613645 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 787/1566] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:06.614827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b9e9d-7e38-47ec-b2f3-d769cc134f57 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.615092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b9e9d-7e38-47ec-b2f3-d769cc134f57 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.615376 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b9e9d-7e38-47ec-b2f3-d769cc134f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.618156 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1522e-ab49-49c4-b07c-f603a339364f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.623298 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91990de-f092-4194-971b-50c01e1e7431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.626001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91990de-f092-4194-971b-50c01e1e7431 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.626001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91990de-f092-4194-971b-50c01e1e7431 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.626001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91990de-f092-4194-971b-50c01e1e7431 admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.626001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91990de-f092-4194-971b-50c01e1e7431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:06.626001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91990de-f092-4194-971b-50c01e1e7431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.627135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91990de-f092-4194-971b-50c01e1e7431 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.633490 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-074b9e9d-7e38-47ec-b2f3-d769cc134f57 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:06.634696 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-074b9e9d-7e38-47ec-b2f3-d769cc134f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:06.639950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 780/1567] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:06.640758 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91990de-f092-4194-971b-50c01e1e7431 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.643551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 788/1568] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:06.644328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b9e9d-7e38-47ec-b2f3-d769cc134f57 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.653524 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b9e9d-7e38-47ec-b2f3-d769cc134f57 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.654173 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91990de-f092-4194-971b-50c01e1e7431 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.658162 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451accc-31ea-4031-9d52-c8e3a9218811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.658734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d9394-db92-4a64-9339-ed8fcaf8fe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.658878 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451accc-31ea-4031-9d52-c8e3a9218811 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.659070 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451accc-31ea-4031-9d52-c8e3a9218811 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.659348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451accc-31ea-4031-9d52-c8e3a9218811 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.659440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d9394-db92-4a64-9339-ed8fcaf8fe3c admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.659671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d9394-db92-4a64-9339-ed8fcaf8fe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.659944 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d9394-db92-4a64-9339-ed8fcaf8fe3c admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.660186 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451accc-31ea-4031-9d52-c8e3a9218811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:06.660495 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451accc-31ea-4031-9d52-c8e3a9218811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.660643 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d9394-db92-4a64-9339-ed8fcaf8fe3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:06.660948 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d9394-db92-4a64-9339-ed8fcaf8fe3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.662172 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451accc-31ea-4031-9d52-c8e3a9218811 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.662556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d9394-db92-4a64-9339-ed8fcaf8fe3c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.673579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 789/1569] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:06.674531 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 781/1570] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:06.675202 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451accc-31ea-4031-9d52-c8e3a9218811 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.675671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d9394-db92-4a64-9339-ed8fcaf8fe3c admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.686165 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451accc-31ea-4031-9d52-c8e3a9218811 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.686639 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d9394-db92-4a64-9339-ed8fcaf8fe3c admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.690868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31d081-0bcc-49ec-8c24-ecc58bc82811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.691060 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74472018-e4e6-4623-8a71-20115059d3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.691538 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d081-0bcc-49ec-8c24-ecc58bc82811 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.691751 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74472018-e4e6-4623-8a71-20115059d3dc admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.691856 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d081-0bcc-49ec-8c24-ecc58bc82811 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.692035 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74472018-e4e6-4623-8a71-20115059d3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.692133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d081-0bcc-49ec-8c24-ecc58bc82811 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.692292 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74472018-e4e6-4623-8a71-20115059d3dc admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.692794 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31d081-0bcc-49ec-8c24-ecc58bc82811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:06.692991 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74472018-e4e6-4623-8a71-20115059d3dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:06.693095 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31d081-0bcc-49ec-8c24-ecc58bc82811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.693296 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74472018-e4e6-4623-8a71-20115059d3dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.694703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31d081-0bcc-49ec-8c24-ecc58bc82811 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.694860 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74472018-e4e6-4623-8a71-20115059d3dc admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.707321 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 790/1571] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:06.707971 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 782/1572] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:06.708354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31d081-0bcc-49ec-8c24-ecc58bc82811 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.708642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74472018-e4e6-4623-8a71-20115059d3dc admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.719873 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74472018-e4e6-4623-8a71-20115059d3dc admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.721609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31d081-0bcc-49ec-8c24-ecc58bc82811 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.724389 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9fe71-3221-4fe9-bae5-aacdda68c0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.725289 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9fe71-3221-4fe9-bae5-aacdda68c0de admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.725562 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9fe71-3221-4fe9-bae5-aacdda68c0de admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.725830 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9fe71-3221-4fe9-bae5-aacdda68c0de admin admin] PATH_INFO: `/v3/projects/e692a28da1fa401392ff4beb46a1b3b3/users/d8cb563573d84848a9ad9db23ba891d3/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.726166 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2aa2ba-d030-4289-9690-e4460a6d15c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.726816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aa2ba-d030-4289-9690-e4460a6d15c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.727098 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aa2ba-d030-4289-9690-e4460a6d15c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.727371 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aa2ba-d030-4289-9690-e4460a6d15c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.728120 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2aa2ba-d030-4289-9690-e4460a6d15c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.729716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2aa2ba-d030-4289-9690-e4460a6d15c7 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.740271 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9fe71-3221-4fe9-bae5-aacdda68c0de admin admin] RBAC: Authorizing `identity:create_grant(project_id=e692a28da1fa401392ff4beb46a1b3b3, user_id=d8cb563573d84848a9ad9db23ba891d3, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.740440 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 791/1573] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:06.740930 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2aa2ba-d030-4289-9690-e4460a6d15c7 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.742666 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9fe71-3221-4fe9-bae5-aacdda68c0de admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.750892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2aa2ba-d030-4289-9690-e4460a6d15c7 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.755374 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef5665-f1ca-46ab-96e5-639767fb26df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.757528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef5665-f1ca-46ab-96e5-639767fb26df admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.757528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef5665-f1ca-46ab-96e5-639767fb26df admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.757528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef5665-f1ca-46ab-96e5-639767fb26df admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.757528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef5665-f1ca-46ab-96e5-639767fb26df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:06.757528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef5665-f1ca-46ab-96e5-639767fb26df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.759178 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef5665-f1ca-46ab-96e5-639767fb26df admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.771276 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 792/1574] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:06.772067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef5665-f1ca-46ab-96e5-639767fb26df admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.781617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef5665-f1ca-46ab-96e5-639767fb26df admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.786185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da08de0-1ea9-4d71-a25c-b99823fe5fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.791236 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da08de0-1ea9-4d71-a25c-b99823fe5fba admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.791236 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da08de0-1ea9-4d71-a25c-b99823fe5fba admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.791236 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da08de0-1ea9-4d71-a25c-b99823fe5fba admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.791236 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da08de0-1ea9-4d71-a25c-b99823fe5fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.791236 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da08de0-1ea9-4d71-a25c-b99823fe5fba admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.816062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 783/1575] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:06 2022] PUT /identity/v3/projects/e692a28da1fa401392ff4beb46a1b3b3/users/d8cb563573d84848a9ad9db23ba891d3/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:06.816852 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9fe71-3221-4fe9-bae5-aacdda68c0de admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.875887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9fe71-3221-4fe9-bae5-aacdda68c0de admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.880708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9ea0f-b433-4483-9489-9c6e71d3dcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.881377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9ea0f-b433-4483-9489-9c6e71d3dcbd admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.881692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9ea0f-b433-4483-9489-9c6e71d3dcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.881965 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9ea0f-b433-4483-9489-9c6e71d3dcbd admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.882659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9ea0f-b433-4483-9489-9c6e71d3dcbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.884736 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9ea0f-b433-4483-9489-9c6e71d3dcbd admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.908591 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 793/1576] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:06.908591 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da08de0-1ea9-4d71-a25c-b99823fe5fba admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:06.968794 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da08de0-1ea9-4d71-a25c-b99823fe5fba admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:06.974111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1665f41-03ec-4d08-b9e8-2d4b0f1666b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:06.974772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1665f41-03ec-4d08-b9e8-2d4b0f1666b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:06.975050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1665f41-03ec-4d08-b9e8-2d4b0f1666b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:06.975324 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1665f41-03ec-4d08-b9e8-2d4b0f1666b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:06.976039 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1665f41-03ec-4d08-b9e8-2d4b0f1666b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:06.977120 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 784/1577] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:06.977966 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1665f41-03ec-4d08-b9e8-2d4b0f1666b9 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:06.978086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9ea0f-b433-4483-9489-9c6e71d3dcbd admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:07.040196 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9ea0f-b433-4483-9489-9c6e71d3dcbd admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:07.045645 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07312321-c79a-4502-871f-e0c6236aea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:07.046304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07312321-c79a-4502-871f-e0c6236aea43 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:07.046591 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07312321-c79a-4502-871f-e0c6236aea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:07.046874 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07312321-c79a-4502-871f-e0c6236aea43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:07.047592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07312321-c79a-4502-871f-e0c6236aea43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:07.049502 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07312321-c79a-4502-871f-e0c6236aea43 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:07.115874 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 794/1578] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:07.116690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1665f41-03ec-4d08-b9e8-2d4b0f1666b9 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:07.152806 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 785/1579] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:06 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:07.152806 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07312321-c79a-4502-871f-e0c6236aea43 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:07.179821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1665f41-03ec-4d08-b9e8-2d4b0f1666b9 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:07.216431 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07312321-c79a-4502-871f-e0c6236aea43 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:07.220946 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d1497-63d7-4dcd-af40-a6b8705fc61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:07.221841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d1497-63d7-4dcd-af40-a6b8705fc61b admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:07.222125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d1497-63d7-4dcd-af40-a6b8705fc61b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:07.222402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d1497-63d7-4dcd-af40-a6b8705fc61b admin admin] PATH_INFO: `/v3/projects/53ce1ccc33ea417399e63877dbec8e70/users/c49fe06c6ef04cc387ce7c0dc4e491b4/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:07.234810 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5baf7-431c-475f-aa05-85c3a0a4cd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:07.235761 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5baf7-431c-475f-aa05-85c3a0a4cd2c admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:07.236043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5baf7-431c-475f-aa05-85c3a0a4cd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:07.236316 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5baf7-431c-475f-aa05-85c3a0a4cd2c admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:07.236998 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5baf7-431c-475f-aa05-85c3a0a4cd2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:07.237344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d1497-63d7-4dcd-af40-a6b8705fc61b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ce1ccc33ea417399e63877dbec8e70, user_id=c49fe06c6ef04cc387ce7c0dc4e491b4, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:07.238902 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5baf7-431c-475f-aa05-85c3a0a4cd2c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:07.240010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d1497-63d7-4dcd-af40-a6b8705fc61b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:07.335605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 786/1580] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:07 2022] PUT /identity/v3/projects/53ce1ccc33ea417399e63877dbec8e70/users/c49fe06c6ef04cc387ce7c0dc4e491b4/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:07.336440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d1497-63d7-4dcd-af40-a6b8705fc61b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:07.349670 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 795/1581] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:07 2022] POST /identity/v3/projects => generated 393 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:07.351233 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeb528-366a-44ae-a3d0-6af4574e9424 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:07.351536 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeb528-366a-44ae-a3d0-6af4574e9424 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:07.351814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeb528-366a-44ae-a3d0-6af4574e9424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:07.377712 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-4feeb528-366a-44ae-a3d0-6af4574e9424 None None] MFA Rules not processed for user `d8cb563573d84848a9ad9db23ba891d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:07.378939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-4feeb528-366a-44ae-a3d0-6af4574e9424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:07.396536 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d1497-63d7-4dcd-af40-a6b8705fc61b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:07.439396 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 796/1582] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:07.441787 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeb528-366a-44ae-a3d0-6af4574e9424 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:07.454632 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a29713-aa82-48f9-a915-5be518f9afee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:07.455293 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a29713-aa82-48f9-a915-5be518f9afee admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:07.455610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a29713-aa82-48f9-a915-5be518f9afee admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:07.455890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a29713-aa82-48f9-a915-5be518f9afee admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:07.456585 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a29713-aa82-48f9-a915-5be518f9afee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:07.458542 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a29713-aa82-48f9-a915-5be518f9afee admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:07.501782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeb528-366a-44ae-a3d0-6af4574e9424 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:07.506253 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2634fa-3670-45c5-8f4e-2394230e86b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:07.506911 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2634fa-3670-45c5-8f4e-2394230e86b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:07.507193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2634fa-3670-45c5-8f4e-2394230e86b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:07.507470 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2634fa-3670-45c5-8f4e-2394230e86b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:07.508180 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2634fa-3670-45c5-8f4e-2394230e86b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:07.510098 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2634fa-3670-45c5-8f4e-2394230e86b8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:07.565072 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 787/1583] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:07 2022] POST /identity/v3/projects => generated 357 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:07.565878 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a29713-aa82-48f9-a915-5be518f9afee admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:07.594269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 797/1584] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:07 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:07.594269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2634fa-3670-45c5-8f4e-2394230e86b8 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:07.603085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2634fa-3670-45c5-8f4e-2394230e86b8 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:07.626181 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a29713-aa82-48f9-a915-5be518f9afee admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:07.630938 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf9c7f-c76b-413a-b9bd-431d0ecd9f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:07.631730 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf9c7f-c76b-413a-b9bd-431d0ecd9f07 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:07.632014 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf9c7f-c76b-413a-b9bd-431d0ecd9f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:07.632293 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf9c7f-c76b-413a-b9bd-431d0ecd9f07 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:07.632990 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf9c7f-c76b-413a-b9bd-431d0ecd9f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:07.634940 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf9c7f-c76b-413a-b9bd-431d0ecd9f07 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:07.659037 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108878c-7735-4757-8cd9-8ea6db69ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:07.659732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108878c-7735-4757-8cd9-8ea6db69ef56 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:07.664823 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108878c-7735-4757-8cd9-8ea6db69ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:07.664823 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108878c-7735-4757-8cd9-8ea6db69ef56 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:07.664823 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108878c-7735-4757-8cd9-8ea6db69ef56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:07.664823 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108878c-7735-4757-8cd9-8ea6db69ef56 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:07.741522 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 788/1585] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:07 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:07.742430 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf9c7f-c76b-413a-b9bd-431d0ecd9f07 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:07.751745 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf9c7f-c76b-413a-b9bd-431d0ecd9f07 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:07.753131 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 798/1586] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:07 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:07.754544 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d36346-4cf7-488c-b57f-d8e0ef774b43 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:07.754836 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d36346-4cf7-488c-b57f-d8e0ef774b43 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:07.755152 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d36346-4cf7-488c-b57f-d8e0ef774b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:07.756761 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0526fc-cee4-406e-b1a7-d3b2ff075129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:07.757427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0526fc-cee4-406e-b1a7-d3b2ff075129 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:07.762374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0526fc-cee4-406e-b1a7-d3b2ff075129 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:07.762374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0526fc-cee4-406e-b1a7-d3b2ff075129 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:07.762374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0526fc-cee4-406e-b1a7-d3b2ff075129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:07.762374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0526fc-cee4-406e-b1a7-d3b2ff075129 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:07.784351 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-97d36346-4cf7-488c-b57f-d8e0ef774b43 None None] MFA Rules not processed for user `c49fe06c6ef04cc387ce7c0dc4e491b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:07.785600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-97d36346-4cf7-488c-b57f-d8e0ef774b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:07.846014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 799/1587] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:07.846824 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d36346-4cf7-488c-b57f-d8e0ef774b43 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:07.851062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 789/1588] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:07 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:07.851062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0526fc-cee4-406e-b1a7-d3b2ff075129 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:07.859188 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d36346-4cf7-488c-b57f-d8e0ef774b43 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:07.861977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0526fc-cee4-406e-b1a7-d3b2ff075129 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:07.863934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de97f-e106-4601-88f3-f424c397e33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:07.864595 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de97f-e106-4601-88f3-f424c397e33b admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:07.864873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de97f-e106-4601-88f3-f424c397e33b admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:07.865148 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de97f-e106-4601-88f3-f424c397e33b admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:07.865833 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6de97f-e106-4601-88f3-f424c397e33b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:07.866784 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880af537-1807-4a3a-8a31-fa0ca5b18ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:07.867462 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880af537-1807-4a3a-8a31-fa0ca5b18ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:07.867787 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880af537-1807-4a3a-8a31-fa0ca5b18ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:07.867912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6de97f-e106-4601-88f3-f424c397e33b admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:07.868058 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880af537-1807-4a3a-8a31-fa0ca5b18ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:07.868743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880af537-1807-4a3a-8a31-fa0ca5b18ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:07.870637 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880af537-1807-4a3a-8a31-fa0ca5b18ea9 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:07.930964 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 800/1589] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:07 2022] POST /identity/v3/users => generated 297 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:07.931934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de97f-e106-4601-88f3-f424c397e33b admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:07.941157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de97f-e106-4601-88f3-f424c397e33b admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:07.945642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c2306-e679-4c8b-b1c8-63cf6b981275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:07.946286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c2306-e679-4c8b-b1c8-63cf6b981275 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:07.946565 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c2306-e679-4c8b-b1c8-63cf6b981275 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:07.946835 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c2306-e679-4c8b-b1c8-63cf6b981275 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:07.947495 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c2306-e679-4c8b-b1c8-63cf6b981275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:07.949931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c2306-e679-4c8b-b1c8-63cf6b981275 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:07.964143 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 790/1590] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:07 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:07.964143 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880af537-1807-4a3a-8a31-fa0ca5b18ea9 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.020708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880af537-1807-4a3a-8a31-fa0ca5b18ea9 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.025167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3351984-f56a-4024-9767-6474ebd2d07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.025819 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3351984-f56a-4024-9767-6474ebd2d07f admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.026097 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3351984-f56a-4024-9767-6474ebd2d07f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.026369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3351984-f56a-4024-9767-6474ebd2d07f admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.027073 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3351984-f56a-4024-9767-6474ebd2d07f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.029396 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3351984-f56a-4024-9767-6474ebd2d07f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.041761 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 791/1591] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:08.041761 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3351984-f56a-4024-9767-6474ebd2d07f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.044563 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 801/1592] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:07 2022] POST /identity/v3/users => generated 279 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:08.045397 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c2306-e679-4c8b-b1c8-63cf6b981275 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.049316 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3351984-f56a-4024-9767-6474ebd2d07f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.055019 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c2306-e679-4c8b-b1c8-63cf6b981275 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.055230 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c21d4d-0972-47b6-8420-5175716b0867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.055999 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c21d4d-0972-47b6-8420-5175716b0867 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.056311 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c21d4d-0972-47b6-8420-5175716b0867 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.056587 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c21d4d-0972-47b6-8420-5175716b0867 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.057306 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c21d4d-0972-47b6-8420-5175716b0867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.059483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c21d4d-0972-47b6-8420-5175716b0867 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.063695 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb61da-c63a-4e2b-85ed-c6ea3015c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.064349 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb61da-c63a-4e2b-85ed-c6ea3015c498 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.064644 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb61da-c63a-4e2b-85ed-c6ea3015c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.064920 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb61da-c63a-4e2b-85ed-c6ea3015c498 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.065638 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb61da-c63a-4e2b-85ed-c6ea3015c498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.067304 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb61da-c63a-4e2b-85ed-c6ea3015c498 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.069654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 792/1593] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:08.070421 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c21d4d-0972-47b6-8420-5175716b0867 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.081852 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 802/1594] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:08.081852 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb61da-c63a-4e2b-85ed-c6ea3015c498 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.082105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c21d4d-0972-47b6-8420-5175716b0867 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.085344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adeaae2-bc57-449a-bc8d-dd963e4212b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.085986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adeaae2-bc57-449a-bc8d-dd963e4212b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.086391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adeaae2-bc57-449a-bc8d-dd963e4212b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.086673 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adeaae2-bc57-449a-bc8d-dd963e4212b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.087357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adeaae2-bc57-449a-bc8d-dd963e4212b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.089058 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb61da-c63a-4e2b-85ed-c6ea3015c498 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.089288 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adeaae2-bc57-449a-bc8d-dd963e4212b0 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.093738 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c34bd-5546-4e76-bd4f-6e1fae24b68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.094362 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c34bd-5546-4e76-bd4f-6e1fae24b68f admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.094647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c34bd-5546-4e76-bd4f-6e1fae24b68f admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.094919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c34bd-5546-4e76-bd4f-6e1fae24b68f admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.095654 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c34bd-5546-4e76-bd4f-6e1fae24b68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.097250 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c34bd-5546-4e76-bd4f-6e1fae24b68f admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.107088 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 803/1595] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:08.107925 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c34bd-5546-4e76-bd4f-6e1fae24b68f admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.117281 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c34bd-5546-4e76-bd4f-6e1fae24b68f admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.122328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900b5c8-550c-4f77-9a44-3d75332506b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.122875 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900b5c8-550c-4f77-9a44-3d75332506b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.123153 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900b5c8-550c-4f77-9a44-3d75332506b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.123426 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900b5c8-550c-4f77-9a44-3d75332506b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.124153 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900b5c8-550c-4f77-9a44-3d75332506b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.125743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900b5c8-550c-4f77-9a44-3d75332506b0 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.135041 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 804/1596] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:08.135797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900b5c8-550c-4f77-9a44-3d75332506b0 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.145239 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900b5c8-550c-4f77-9a44-3d75332506b0 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.149645 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f01ac0-67c2-46c7-b053-3aee4ce10387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.150241 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f01ac0-67c2-46c7-b053-3aee4ce10387 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.150520 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f01ac0-67c2-46c7-b053-3aee4ce10387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.150795 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f01ac0-67c2-46c7-b053-3aee4ce10387 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.151447 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f01ac0-67c2-46c7-b053-3aee4ce10387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.153528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f01ac0-67c2-46c7-b053-3aee4ce10387 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.167138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 793/1597] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:08 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:08.168136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adeaae2-bc57-449a-bc8d-dd963e4212b0 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.237952 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adeaae2-bc57-449a-bc8d-dd963e4212b0 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.243321 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 805/1598] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:08 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:08.243321 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f01ac0-67c2-46c7-b053-3aee4ce10387 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.246766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e43e95-7732-4b0d-a2a9-5fff009a392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.247961 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e43e95-7732-4b0d-a2a9-5fff009a392b admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.248469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e43e95-7732-4b0d-a2a9-5fff009a392b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.248922 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e43e95-7732-4b0d-a2a9-5fff009a392b admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.249836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e43e95-7732-4b0d-a2a9-5fff009a392b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.251748 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e43e95-7732-4b0d-a2a9-5fff009a392b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.256588 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f01ac0-67c2-46c7-b053-3aee4ce10387 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.257659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48701b35-7a00-4ebb-b5b0-72ce07ee1437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.258322 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701b35-7a00-4ebb-b5b0-72ce07ee1437 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.258605 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701b35-7a00-4ebb-b5b0-72ce07ee1437 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.258908 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701b35-7a00-4ebb-b5b0-72ce07ee1437 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.259648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48701b35-7a00-4ebb-b5b0-72ce07ee1437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.261238 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48701b35-7a00-4ebb-b5b0-72ce07ee1437 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.264705 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 794/1599] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:08.265509 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e43e95-7732-4b0d-a2a9-5fff009a392b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.272626 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 806/1600] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:08.273378 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48701b35-7a00-4ebb-b5b0-72ce07ee1437 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.278121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e43e95-7732-4b0d-a2a9-5fff009a392b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.283314 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925767d-5595-4d41-a0c0-b92d77cfa515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.285279 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48701b35-7a00-4ebb-b5b0-72ce07ee1437 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.285402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925767d-5595-4d41-a0c0-b92d77cfa515 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.285402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925767d-5595-4d41-a0c0-b92d77cfa515 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.285402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925767d-5595-4d41-a0c0-b92d77cfa515 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.285402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925767d-5595-4d41-a0c0-b92d77cfa515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.286870 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925767d-5595-4d41-a0c0-b92d77cfa515 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.288226 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1c072-78f9-457b-9756-f28e9c9c8ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.288868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1c072-78f9-457b-9756-f28e9c9c8ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.289148 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1c072-78f9-457b-9756-f28e9c9c8ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.289417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1c072-78f9-457b-9756-f28e9c9c8ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.290214 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1c072-78f9-457b-9756-f28e9c9c8ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.291887 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1c072-78f9-457b-9756-f28e9c9c8ff0 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.297119 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 795/1601] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:08.297700 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925767d-5595-4d41-a0c0-b92d77cfa515 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.307726 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 807/1602] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:08.311288 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925767d-5595-4d41-a0c0-b92d77cfa515 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.311408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1c072-78f9-457b-9756-f28e9c9c8ff0 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.314829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc2483-519e-4dac-a836-03bff07e4029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.315559 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc2483-519e-4dac-a836-03bff07e4029 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.315802 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc2483-519e-4dac-a836-03bff07e4029 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.316076 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc2483-519e-4dac-a836-03bff07e4029 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.316794 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc2483-519e-4dac-a836-03bff07e4029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.318384 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc2483-519e-4dac-a836-03bff07e4029 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.318759 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1c072-78f9-457b-9756-f28e9c9c8ff0 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.323545 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da959f91-e61a-40a1-ad22-25283f62289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.324281 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da959f91-e61a-40a1-ad22-25283f62289a admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.325120 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da959f91-e61a-40a1-ad22-25283f62289a admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.325393 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da959f91-e61a-40a1-ad22-25283f62289a admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.326105 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da959f91-e61a-40a1-ad22-25283f62289a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.327762 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da959f91-e61a-40a1-ad22-25283f62289a admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.331314 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 796/1603] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:08.331314 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc2483-519e-4dac-a836-03bff07e4029 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.339734 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 808/1604] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:08.340898 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da959f91-e61a-40a1-ad22-25283f62289a admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.346358 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc2483-519e-4dac-a836-03bff07e4029 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.350786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da959f91-e61a-40a1-ad22-25283f62289a admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.351208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1813199-fb71-46b3-994e-6c731799744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.351908 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1813199-fb71-46b3-994e-6c731799744b admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.352195 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1813199-fb71-46b3-994e-6c731799744b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.352474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1813199-fb71-46b3-994e-6c731799744b admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.353200 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1813199-fb71-46b3-994e-6c731799744b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.355233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1813199-fb71-46b3-994e-6c731799744b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.355504 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c265f1-bb37-41b2-ba28-9f2b2ddaa2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.356181 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c265f1-bb37-41b2-ba28-9f2b2ddaa2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.356460 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c265f1-bb37-41b2-ba28-9f2b2ddaa2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.356736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c265f1-bb37-41b2-ba28-9f2b2ddaa2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.357441 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c265f1-bb37-41b2-ba28-9f2b2ddaa2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.359089 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c265f1-bb37-41b2-ba28-9f2b2ddaa2f9 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.369781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 809/1605] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:08.370575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c265f1-bb37-41b2-ba28-9f2b2ddaa2f9 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.380427 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c265f1-bb37-41b2-ba28-9f2b2ddaa2f9 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.385002 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da82850-0f30-495b-993d-d775ad790b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.385853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da82850-0f30-495b-993d-d775ad790b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.386131 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da82850-0f30-495b-993d-d775ad790b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.386402 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da82850-0f30-495b-993d-d775ad790b43 admin admin] PATH_INFO: `/v3/projects/ab382c388f1e4605be7dd6193181f2c3/users/bda2f2412e6441c3a8c232f39c56fc9f/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.401921 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da82850-0f30-495b-993d-d775ad790b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab382c388f1e4605be7dd6193181f2c3, user_id=bda2f2412e6441c3a8c232f39c56fc9f, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.403298 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING py.warnings [None req-9da82850-0f30-495b-993d-d775ad790b43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 12:00:08.403298 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: warnings.warn(msg) Mar 08 12:00:08.403298 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: Mar 08 12:00:08.405259 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da82850-0f30-495b-993d-d775ad790b43 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.417953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 797/1606] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:08 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:08.418946 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1813199-fb71-46b3-994e-6c731799744b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.428382 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1813199-fb71-46b3-994e-6c731799744b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.432914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b91ff-1121-4c3a-b958-6b11061666c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.434106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b91ff-1121-4c3a-b958-6b11061666c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.434448 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b91ff-1121-4c3a-b958-6b11061666c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.434902 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b91ff-1121-4c3a-b958-6b11061666c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.435686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b91ff-1121-4c3a-b958-6b11061666c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.437268 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b91ff-1121-4c3a-b958-6b11061666c2 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.447036 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 798/1607] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:08.447815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b91ff-1121-4c3a-b958-6b11061666c2 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.458190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b91ff-1121-4c3a-b958-6b11061666c2 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.462692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b648ea9-4634-4ee1-8403-47db948e9e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.463580 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b648ea9-4634-4ee1-8403-47db948e9e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.463858 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b648ea9-4634-4ee1-8403-47db948e9e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.464125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b648ea9-4634-4ee1-8403-47db948e9e79 admin admin] PATH_INFO: `/v3/projects/f5cfbecc5ecd4f938ac389ee436b585d/users/43d7ea8eb084481087633dee37f36073/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.472191 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 810/1608] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:08 2022] PUT /identity/v3/projects/ab382c388f1e4605be7dd6193181f2c3/users/bda2f2412e6441c3a8c232f39c56fc9f/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:08.473000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da82850-0f30-495b-993d-d775ad790b43 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.478625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b648ea9-4634-4ee1-8403-47db948e9e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5cfbecc5ecd4f938ac389ee436b585d, user_id=43d7ea8eb084481087633dee37f36073, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.482038 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b648ea9-4634-4ee1-8403-47db948e9e79 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.530887 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da82850-0f30-495b-993d-d775ad790b43 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.535301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef190d7-e1e1-4ede-9fcb-317a2bd7fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.536210 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef190d7-e1e1-4ede-9fcb-317a2bd7fd62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.536486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef190d7-e1e1-4ede-9fcb-317a2bd7fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.536756 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef190d7-e1e1-4ede-9fcb-317a2bd7fd62 admin admin] PATH_INFO: `/v3/projects/b1448ba6682f467e81d56376b11b7b50/users/c973c34b0d934c9c88f198de32c54337/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.550692 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef190d7-e1e1-4ede-9fcb-317a2bd7fd62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1448ba6682f467e81d56376b11b7b50, user_id=c973c34b0d934c9c88f198de32c54337, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.553368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef190d7-e1e1-4ede-9fcb-317a2bd7fd62 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.577180 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 799/1609] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:08 2022] PUT /identity/v3/projects/f5cfbecc5ecd4f938ac389ee436b585d/users/43d7ea8eb084481087633dee37f36073/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:08.583290 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b648ea9-4634-4ee1-8403-47db948e9e79 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.634737 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 811/1610] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:08 2022] PUT /identity/v3/projects/b1448ba6682f467e81d56376b11b7b50/users/c973c34b0d934c9c88f198de32c54337/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:08.635463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef190d7-e1e1-4ede-9fcb-317a2bd7fd62 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.636604 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b648ea9-4634-4ee1-8403-47db948e9e79 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.697016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89281697-2496-40c5-a159-fbc79b4ee525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.697907 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89281697-2496-40c5-a159-fbc79b4ee525 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.698188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89281697-2496-40c5-a159-fbc79b4ee525 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.698465 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89281697-2496-40c5-a159-fbc79b4ee525 admin admin] PATH_INFO: `/v3/projects/3a975172f150436bb1a0fef5a805dabc/users/abd58985a7e84aa7b084862024d6ee41/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.702673 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef190d7-e1e1-4ede-9fcb-317a2bd7fd62 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.707487 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ed8a5-f970-4689-99b7-5364b5fa6a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.708437 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ed8a5-f970-4689-99b7-5364b5fa6a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.708843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ed8a5-f970-4689-99b7-5364b5fa6a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.709130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ed8a5-f970-4689-99b7-5364b5fa6a7b admin admin] PATH_INFO: `/v3/projects/960767a629b04fc39736132776c6b2e1/users/f98ed54ebbfd4c10aeff826dd1765150/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.712716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89281697-2496-40c5-a159-fbc79b4ee525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a975172f150436bb1a0fef5a805dabc, user_id=abd58985a7e84aa7b084862024d6ee41, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.715479 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89281697-2496-40c5-a159-fbc79b4ee525 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.723398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ed8a5-f970-4689-99b7-5364b5fa6a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=960767a629b04fc39736132776c6b2e1, user_id=f98ed54ebbfd4c10aeff826dd1765150, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.726062 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ed8a5-f970-4689-99b7-5364b5fa6a7b admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.805440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 800/1611] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:08 2022] PUT /identity/v3/projects/3a975172f150436bb1a0fef5a805dabc/users/abd58985a7e84aa7b084862024d6ee41/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:08.806484 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89281697-2496-40c5-a159-fbc79b4ee525 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.817136 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 812/1612] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:08 2022] PUT /identity/v3/projects/960767a629b04fc39736132776c6b2e1/users/f98ed54ebbfd4c10aeff826dd1765150/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:08.818605 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ed8a5-f970-4689-99b7-5364b5fa6a7b admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.865890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89281697-2496-40c5-a159-fbc79b4ee525 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.877932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ed8a5-f970-4689-99b7-5364b5fa6a7b admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.882785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078c5b5-5ae4-4616-a340-f6be02303918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.883445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078c5b5-5ae4-4616-a340-f6be02303918 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.883794 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078c5b5-5ae4-4616-a340-f6be02303918 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.884069 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078c5b5-5ae4-4616-a340-f6be02303918 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.884785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078c5b5-5ae4-4616-a340-f6be02303918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.886378 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078c5b5-5ae4-4616-a340-f6be02303918 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.896969 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 813/1613] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:08.897752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078c5b5-5ae4-4616-a340-f6be02303918 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:08.906994 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078c5b5-5ae4-4616-a340-f6be02303918 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:08.911587 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c15ba5-b489-44e8-87b5-4c918fa1f939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.912467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c15ba5-b489-44e8-87b5-4c918fa1f939 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.912746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c15ba5-b489-44e8-87b5-4c918fa1f939 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.913023 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c15ba5-b489-44e8-87b5-4c918fa1f939 admin admin] PATH_INFO: `/v3/projects/e5b26b7d869a4860ab2a6229f0f8647f/users/8a837dd0e1e343578cb48efcc7054233/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.919600 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a271cd-7f17-40fe-b2e3-5d9ccfbf6706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:08.920521 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a271cd-7f17-40fe-b2e3-5d9ccfbf6706 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:08.920804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a271cd-7f17-40fe-b2e3-5d9ccfbf6706 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:08.921079 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a271cd-7f17-40fe-b2e3-5d9ccfbf6706 admin admin] PATH_INFO: `/v3/projects/c7048970ac5043aab661be4579f959d8/users/321bf70884bb4c05b13ddffdb9a19487/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:08.927413 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c15ba5-b489-44e8-87b5-4c918fa1f939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b26b7d869a4860ab2a6229f0f8647f, user_id=8a837dd0e1e343578cb48efcc7054233, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.930641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c15ba5-b489-44e8-87b5-4c918fa1f939 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:08.936275 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a271cd-7f17-40fe-b2e3-5d9ccfbf6706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7048970ac5043aab661be4579f959d8, user_id=321bf70884bb4c05b13ddffdb9a19487, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:08.938913 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a271cd-7f17-40fe-b2e3-5d9ccfbf6706 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:09.018156 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 814/1614] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:08 2022] PUT /identity/v3/projects/e5b26b7d869a4860ab2a6229f0f8647f/users/8a837dd0e1e343578cb48efcc7054233/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:09.019724 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac0571-2947-472d-af0c-36c621d5af08 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.020011 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac0571-2947-472d-af0c-36c621d5af08 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.020289 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac0571-2947-472d-af0c-36c621d5af08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.034446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 801/1615] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:08 2022] PUT /identity/v3/projects/c7048970ac5043aab661be4579f959d8/users/321bf70884bb4c05b13ddffdb9a19487/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:09.035821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8bd47-b01d-40b3-bb50-938ef931fc51 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.036109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8bd47-b01d-40b3-bb50-938ef931fc51 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.036387 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8bd47-b01d-40b3-bb50-938ef931fc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.038242 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-26ac0571-2947-472d-af0c-36c621d5af08 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:09.039502 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-26ac0571-2947-472d-af0c-36c621d5af08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:09.062548 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-21a8bd47-b01d-40b3-bb50-938ef931fc51 None None] MFA Rules not processed for user `43d7ea8eb084481087633dee37f36073`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:09.063714 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-21a8bd47-b01d-40b3-bb50-938ef931fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:09.097424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 815/1616] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:09.098843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e153-ed69-420f-bb87-339323ef064d None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.099134 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e153-ed69-420f-bb87-339323ef064d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.099409 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e153-ed69-420f-bb87-339323ef064d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.125239 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-15e2e153-ed69-420f-bb87-339323ef064d None None] MFA Rules not processed for user `c973c34b0d934c9c88f198de32c54337`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:09.126447 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-15e2e153-ed69-420f-bb87-339323ef064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:09.131344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 802/1617] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:09.132807 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1c427-35da-4cd0-9cda-ca2f882cd1ed None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.133158 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1c427-35da-4cd0-9cda-ca2f882cd1ed None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.133444 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1c427-35da-4cd0-9cda-ca2f882cd1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.153272 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-39c1c427-35da-4cd0-9cda-ca2f882cd1ed None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:09.154468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-39c1c427-35da-4cd0-9cda-ca2f882cd1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:09.162452 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 803/1618] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:09.163936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27d119-e500-4a90-895e-26877c36ae88 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.164314 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27d119-e500-4a90-895e-26877c36ae88 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.164600 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27d119-e500-4a90-895e-26877c36ae88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.183020 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-bd27d119-e500-4a90-895e-26877c36ae88 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:09.184836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-bd27d119-e500-4a90-895e-26877c36ae88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:09.192834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 804/1619] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:09.195475 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 816/1620] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:09.196772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27d119-e500-4a90-895e-26877c36ae88 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:09.196860 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c3dcc-cdd3-4b97-ba9e-3ddc5310dc2a None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.197212 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c3dcc-cdd3-4b97-ba9e-3ddc5310dc2a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.197495 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c3dcc-cdd3-4b97-ba9e-3ddc5310dc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.208510 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27d119-e500-4a90-895e-26877c36ae88 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:09.213209 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd9e72-342c-4a7d-8dcc-a63a57f192d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:09.214105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd9e72-342c-4a7d-8dcc-a63a57f192d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.214392 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd9e72-342c-4a7d-8dcc-a63a57f192d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.214668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd9e72-342c-4a7d-8dcc-a63a57f192d9 admin admin] PATH_INFO: `/v3/projects/1b8cdeaa323c4f7dba6f017437a22621/users/33ac8c7558cc49598e610e6f0866c3e2/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.223864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-488c3dcc-cdd3-4b97-ba9e-3ddc5310dc2a None None] MFA Rules not processed for user `8a837dd0e1e343578cb48efcc7054233`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:09.225062 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-488c3dcc-cdd3-4b97-ba9e-3ddc5310dc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:09.228995 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd9e72-342c-4a7d-8dcc-a63a57f192d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8cdeaa323c4f7dba6f017437a22621, user_id=33ac8c7558cc49598e610e6f0866c3e2, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:09.232478 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd9e72-342c-4a7d-8dcc-a63a57f192d9 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:09.288574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 817/1621] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:09.289636 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c3dcc-cdd3-4b97-ba9e-3ddc5310dc2a None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:09.297592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 805/1622] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:09 2022] PUT /identity/v3/projects/1b8cdeaa323c4f7dba6f017437a22621/users/33ac8c7558cc49598e610e6f0866c3e2/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:09.298564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd9e72-342c-4a7d-8dcc-a63a57f192d9 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:09.301708 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c3dcc-cdd3-4b97-ba9e-3ddc5310dc2a None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:09.351802 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd9e72-342c-4a7d-8dcc-a63a57f192d9 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:09.355300 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c9c6e-88fe-4c6a-afcd-d03eb0db1e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:09.356376 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96e81d-90a2-4039-880e-13013c8150d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:09.356497 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c9c6e-88fe-4c6a-afcd-d03eb0db1e0c service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.356757 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c9c6e-88fe-4c6a-afcd-d03eb0db1e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.357033 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c9c6e-88fe-4c6a-afcd-d03eb0db1e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.357127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96e81d-90a2-4039-880e-13013c8150d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.357373 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96e81d-90a2-4039-880e-13013c8150d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.357650 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96e81d-90a2-4039-880e-13013c8150d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.358361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96e81d-90a2-4039-880e-13013c8150d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:09.360014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96e81d-90a2-4039-880e-13013c8150d6 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:09.366278 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c9c6e-88fe-4c6a-afcd-d03eb0db1e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:09.367740 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c9c6e-88fe-4c6a-afcd-d03eb0db1e0c service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:09.369925 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 818/1623] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:09.372220 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baded51d-860a-4f56-9add-2ed49b7f1a3a None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.372488 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baded51d-860a-4f56-9add-2ed49b7f1a3a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.372772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baded51d-860a-4f56-9add-2ed49b7f1a3a None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.374615 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 819/1624] 10.222.0.52 () {54 vars in 961 bytes} [Tue Mar 8 12:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:00:09.375388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baded51d-860a-4f56-9add-2ed49b7f1a3a None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:09.378294 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 806/1625] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:09.379053 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c9c6e-88fe-4c6a-afcd-d03eb0db1e0c service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:09.386223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baded51d-860a-4f56-9add-2ed49b7f1a3a None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:09.388891 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c9c6e-88fe-4c6a-afcd-d03eb0db1e0c service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:09.390939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa68635-a469-4414-9ac7-0af6cc62d724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:09.391745 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa68635-a469-4414-9ac7-0af6cc62d724 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.392068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa68635-a469-4414-9ac7-0af6cc62d724 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.392351 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa68635-a469-4414-9ac7-0af6cc62d724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.394505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6602d-cf11-4a70-a881-60892f2a2a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:09.395310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6602d-cf11-4a70-a881-60892f2a2a4e admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.395625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6602d-cf11-4a70-a881-60892f2a2a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.395892 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6602d-cf11-4a70-a881-60892f2a2a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.396593 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6602d-cf11-4a70-a881-60892f2a2a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:09.398524 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6602d-cf11-4a70-a881-60892f2a2a4e admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:09.402889 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa68635-a469-4414-9ac7-0af6cc62d724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:09.404843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa68635-a469-4414-9ac7-0af6cc62d724 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:09.414579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 820/1626] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:09.415373 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa68635-a469-4414-9ac7-0af6cc62d724 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:09.416763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-7aa68635-a469-4414-9ac7-0af6cc62d724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:09.427835 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa68635-a469-4414-9ac7-0af6cc62d724 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:09.431596 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855b2f3-09c7-4bb9-878f-af8329ae06a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:09.432252 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855b2f3-09c7-4bb9-878f-af8329ae06a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.432566 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855b2f3-09c7-4bb9-878f-af8329ae06a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.436322 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855b2f3-09c7-4bb9-878f-af8329ae06a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.443376 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855b2f3-09c7-4bb9-878f-af8329ae06a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:09.444890 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855b2f3-09c7-4bb9-878f-af8329ae06a3 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:09.454793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 821/1627] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:09.455828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855b2f3-09c7-4bb9-878f-af8329ae06a3 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:09.468940 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855b2f3-09c7-4bb9-878f-af8329ae06a3 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:09.469995 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785423a5-9ba7-482e-8858-4a1ea4cdcf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:09.470658 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785423a5-9ba7-482e-8858-4a1ea4cdcf46 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.470942 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785423a5-9ba7-482e-8858-4a1ea4cdcf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.471232 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785423a5-9ba7-482e-8858-4a1ea4cdcf46 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.471953 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785423a5-9ba7-482e-8858-4a1ea4cdcf46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:09.473967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785423a5-9ba7-482e-8858-4a1ea4cdcf46 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:09.491477 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 807/1628] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:09 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:09.493732 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6602d-cf11-4a70-a881-60892f2a2a4e admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:09.557216 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6602d-cf11-4a70-a881-60892f2a2a4e admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:09.562915 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e637b-c8a2-4f9a-9059-f2e5178e625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:09.563689 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e637b-c8a2-4f9a-9059-f2e5178e625f admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.563980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e637b-c8a2-4f9a-9059-f2e5178e625f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.564262 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e637b-c8a2-4f9a-9059-f2e5178e625f admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.565138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e637b-c8a2-4f9a-9059-f2e5178e625f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:09.566994 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e637b-c8a2-4f9a-9059-f2e5178e625f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:09.582141 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 808/1629] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:09.583682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e637b-c8a2-4f9a-9059-f2e5178e625f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:09.595388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e637b-c8a2-4f9a-9059-f2e5178e625f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:09.612169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731c8cb-a39e-4523-9f27-66b3d012a229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:09.612169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731c8cb-a39e-4523-9f27-66b3d012a229 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.612169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731c8cb-a39e-4523-9f27-66b3d012a229 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.612169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731c8cb-a39e-4523-9f27-66b3d012a229 admin admin] PATH_INFO: `/v3/projects/c7048970ac5043aab661be4579f959d8/users/321bf70884bb4c05b13ddffdb9a19487/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.612545 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 822/1630] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:09 2022] POST /identity/v3/projects => generated 357 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:09.612657 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731c8cb-a39e-4523-9f27-66b3d012a229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7048970ac5043aab661be4579f959d8, user_id=321bf70884bb4c05b13ddffdb9a19487, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:09.614763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4f0c3-211f-4712-999d-add394de5717 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.615028 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731c8cb-a39e-4523-9f27-66b3d012a229 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:09.615207 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4f0c3-211f-4712-999d-add394de5717 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.615637 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4f0c3-211f-4712-999d-add394de5717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.629124 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 809/1631] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:09 2022] PUT /identity/v3/projects/c7048970ac5043aab661be4579f959d8/users/321bf70884bb4c05b13ddffdb9a19487/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:09.629698 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731c8cb-a39e-4523-9f27-66b3d012a229 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:09.644569 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-6bd4f0c3-211f-4712-999d-add394de5717 None None] MFA Rules not processed for user `534fd902f96043068e99ca0537cf57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:09.645861 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-6bd4f0c3-211f-4712-999d-add394de5717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:09.706608 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731c8cb-a39e-4523-9f27-66b3d012a229 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:09.719631 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 823/1632] 10.222.0.52 () {58 vars in 1058 bytes} [Tue Mar 8 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:09.720839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4f0c3-211f-4712-999d-add394de5717 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:09.724524 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe5549-1d15-407f-b1f6-14a2fb88151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:09.725186 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe5549-1d15-407f-b1f6-14a2fb88151f admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.725496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe5549-1d15-407f-b1f6-14a2fb88151f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.725683 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe5549-1d15-407f-b1f6-14a2fb88151f admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.726482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe5549-1d15-407f-b1f6-14a2fb88151f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:09.730282 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe5549-1d15-407f-b1f6-14a2fb88151f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:09.735952 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4f0c3-211f-4712-999d-add394de5717 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:09.742120 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bbe74-a03f-401a-ae31-54788972aaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:09.743347 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bbe74-a03f-401a-ae31-54788972aaec admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.743734 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bbe74-a03f-401a-ae31-54788972aaec admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.744081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bbe74-a03f-401a-ae31-54788972aaec admin admin] PATH_INFO: `/v3/projects/1b8cdeaa323c4f7dba6f017437a22621/users/33ac8c7558cc49598e610e6f0866c3e2/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.747822 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bbe74-a03f-401a-ae31-54788972aaec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8cdeaa323c4f7dba6f017437a22621, user_id=33ac8c7558cc49598e610e6f0866c3e2, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:09.751181 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bbe74-a03f-401a-ae31-54788972aaec admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:09.763871 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 824/1633] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:09 2022] PUT /identity/v3/projects/1b8cdeaa323c4f7dba6f017437a22621/users/33ac8c7558cc49598e610e6f0866c3e2/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:09.774193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bbe74-a03f-401a-ae31-54788972aaec admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:09.844505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 810/1634] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:09 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:09.846668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c55635-1f8c-4720-a528-7ea62950173a None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.847167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c55635-1f8c-4720-a528-7ea62950173a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.847577 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c55635-1f8c-4720-a528-7ea62950173a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.871027 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bbe74-a03f-401a-ae31-54788972aaec admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:09.876711 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36cd71-f413-4ab6-a0c5-ea0342d05fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:09.877443 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36cd71-f413-4ab6-a0c5-ea0342d05fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.877723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36cd71-f413-4ab6-a0c5-ea0342d05fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.878096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36cd71-f413-4ab6-a0c5-ea0342d05fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:09.878804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36cd71-f413-4ab6-a0c5-ea0342d05fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:09.884763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36cd71-f413-4ab6-a0c5-ea0342d05fe8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:09.888251 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-70c55635-1f8c-4720-a528-7ea62950173a None None] MFA Rules not processed for user `321bf70884bb4c05b13ddffdb9a19487`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:09.889607 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-70c55635-1f8c-4720-a528-7ea62950173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:09.962923 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 811/1635] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:09.964065 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c55635-1f8c-4720-a528-7ea62950173a None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:09.978549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 825/1636] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:09 2022] POST /identity/v3/users => generated 285 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:09.980548 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344de4-025f-4b14-a6c1-5e3b84303a6b None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:09.980548 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344de4-025f-4b14-a6c1-5e3b84303a6b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:09.980805 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344de4-025f-4b14-a6c1-5e3b84303a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.014829 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-35344de4-025f-4b14-a6c1-5e3b84303a6b None None] MFA Rules not processed for user `33ac8c7558cc49598e610e6f0866c3e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:10.016535 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-35344de4-025f-4b14-a6c1-5e3b84303a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:10.061101 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c55635-1f8c-4720-a528-7ea62950173a None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:10.067498 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555fc2f-0926-442f-9f84-91850cc55a9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:10.068325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555fc2f-0926-442f-9f84-91850cc55a9e service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:10.068674 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555fc2f-0926-442f-9f84-91850cc55a9e service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:10.069018 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555fc2f-0926-442f-9f84-91850cc55a9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.134549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555fc2f-0926-442f-9f84-91850cc55a9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:10.137187 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555fc2f-0926-442f-9f84-91850cc55a9e service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:10.140932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 826/1637] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:10.142013 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35344de4-025f-4b14-a6c1-5e3b84303a6b None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:10.154159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 812/1638] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:10.155099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555fc2f-0926-442f-9f84-91850cc55a9e service nova] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:10.161042 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35344de4-025f-4b14-a6c1-5e3b84303a6b None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:10.166711 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611350d2-ea02-42c6-9003-59a391c494a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:10.167597 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611350d2-ea02-42c6-9003-59a391c494a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:10.168221 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611350d2-ea02-42c6-9003-59a391c494a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:10.168649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611350d2-ea02-42c6-9003-59a391c494a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.169526 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611350d2-ea02-42c6-9003-59a391c494a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:10.185362 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611350d2-ea02-42c6-9003-59a391c494a4 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:10.216554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 827/1639] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:10.221023 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611350d2-ea02-42c6-9003-59a391c494a4 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:10.236080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611350d2-ea02-42c6-9003-59a391c494a4 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:10.243304 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab16f-924a-44bf-88e5-f24c5d036ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:10.249269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab16f-924a-44bf-88e5-f24c5d036ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:10.249269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab16f-924a-44bf-88e5-f24c5d036ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:10.249269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab16f-924a-44bf-88e5-f24c5d036ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.249269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dab16f-924a-44bf-88e5-f24c5d036ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:10.249269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dab16f-924a-44bf-88e5-f24c5d036ff2 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:10.254570 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555fc2f-0926-442f-9f84-91850cc55a9e service nova] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:10.259989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707308f2-600f-4937-bc54-512ed9725356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:10.260940 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707308f2-600f-4937-bc54-512ed9725356 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:10.261390 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707308f2-600f-4937-bc54-512ed9725356 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:10.261906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707308f2-600f-4937-bc54-512ed9725356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.271738 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 828/1640] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:10.278105 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab16f-924a-44bf-88e5-f24c5d036ff2 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:10.278305 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707308f2-600f-4937-bc54-512ed9725356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:10.278305 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707308f2-600f-4937-bc54-512ed9725356 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:10.286659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab16f-924a-44bf-88e5-f24c5d036ff2 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:10.295729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602becc-65e1-40e1-a94e-7a185d5b778e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:10.296646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602becc-65e1-40e1-a94e-7a185d5b778e service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:10.297704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602becc-65e1-40e1-a94e-7a185d5b778e service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:10.306410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602becc-65e1-40e1-a94e-7a185d5b778e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.306516 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 813/1641] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:10.311056 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707308f2-600f-4937-bc54-512ed9725356 service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:10.337187 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707308f2-600f-4937-bc54-512ed9725356 service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:10.343085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602becc-65e1-40e1-a94e-7a185d5b778e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:10.348536 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602becc-65e1-40e1-a94e-7a185d5b778e service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:10.349675 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccabbb-6f74-411b-95cf-0408442c3e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:10.351021 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccabbb-6f74-411b-95cf-0408442c3e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:10.351378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccabbb-6f74-411b-95cf-0408442c3e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:10.351892 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccabbb-6f74-411b-95cf-0408442c3e45 admin admin] PATH_INFO: `/v3/projects/d676af96e9744733b409b8b360c476bd/users/58e4931a116a4046a454501264e53f53/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.376014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 829/1642] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:10.380533 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602becc-65e1-40e1-a94e-7a185d5b778e service cinder] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:10.398738 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccabbb-6f74-411b-95cf-0408442c3e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d676af96e9744733b409b8b360c476bd, user_id=58e4931a116a4046a454501264e53f53, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:10.403039 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602becc-65e1-40e1-a94e-7a185d5b778e service cinder] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:10.405712 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccabbb-6f74-411b-95cf-0408442c3e45 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:10.409089 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df33be-14a7-4924-b130-58c5effec195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:10.410311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df33be-14a7-4924-b130-58c5effec195 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:10.410760 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df33be-14a7-4924-b130-58c5effec195 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:10.411215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df33be-14a7-4924-b130-58c5effec195 admin admin] PATH_INFO: `/v3/projects/e071fc0570ef4ba6a35e104fa049aa54/users/75c0afce0a944abbb758cab4ba32209b/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.438297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df33be-14a7-4924-b130-58c5effec195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e071fc0570ef4ba6a35e104fa049aa54, user_id=75c0afce0a944abbb758cab4ba32209b, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:10.441656 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df33be-14a7-4924-b130-58c5effec195 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:10.564796 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 830/1643] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:10 2022] PUT /identity/v3/projects/e071fc0570ef4ba6a35e104fa049aa54/users/75c0afce0a944abbb758cab4ba32209b/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:10.572489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab0a63-1b46-4a86-b01e-83d4d81350bb None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:10.572489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab0a63-1b46-4a86-b01e-83d4d81350bb None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:10.572489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab0a63-1b46-4a86-b01e-83d4d81350bb None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.572489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 831/1644] 10.222.0.52 () {54 vars in 912 bytes} [Tue Mar 8 12:00:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:00:10.572489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab0a63-1b46-4a86-b01e-83d4d81350bb None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:10.573085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 814/1645] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:10 2022] PUT /identity/v3/projects/d676af96e9744733b409b8b360c476bd/users/58e4931a116a4046a454501264e53f53/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:10.576081 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccabbb-6f74-411b-95cf-0408442c3e45 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:10.676447 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab0a63-1b46-4a86-b01e-83d4d81350bb None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:10.677817 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccabbb-6f74-411b-95cf-0408442c3e45 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:10.681258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f15ca-c2aa-452e-81df-f895b558940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:10.681971 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f15ca-c2aa-452e-81df-f895b558940b admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:10.682259 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f15ca-c2aa-452e-81df-f895b558940b admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:10.682537 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f15ca-c2aa-452e-81df-f895b558940b admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.683029 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46487a6b-4f57-49e9-9af9-4e3f6c3a05a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:10.683303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f15ca-c2aa-452e-81df-f895b558940b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:10.683899 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46487a6b-4f57-49e9-9af9-4e3f6c3a05a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:10.684238 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46487a6b-4f57-49e9-9af9-4e3f6c3a05a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:10.684527 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46487a6b-4f57-49e9-9af9-4e3f6c3a05a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.685303 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46487a6b-4f57-49e9-9af9-4e3f6c3a05a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:10.685496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f15ca-c2aa-452e-81df-f895b558940b admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:10.686936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46487a6b-4f57-49e9-9af9-4e3f6c3a05a5 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:10.698643 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 815/1646] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:10.700629 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cb309-5219-4b15-b2ce-7d848938d241 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:10.700923 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cb309-5219-4b15-b2ce-7d848938d241 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:10.701200 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cb309-5219-4b15-b2ce-7d848938d241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.701764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 832/1647] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:10.702634 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f15ca-c2aa-452e-81df-f895b558940b admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:10.725347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-b67cb309-5219-4b15-b2ce-7d848938d241 None None] MFA Rules not processed for user `534fd902f96043068e99ca0537cf57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:10.726799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b67cb309-5219-4b15-b2ce-7d848938d241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:10.767150 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f15ca-c2aa-452e-81df-f895b558940b admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:10.771923 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c565fbc-1438-4f4e-b119-e55c9fb65709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:10.773857 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c565fbc-1438-4f4e-b119-e55c9fb65709 service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:10.774267 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c565fbc-1438-4f4e-b119-e55c9fb65709 service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:10.774561 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c565fbc-1438-4f4e-b119-e55c9fb65709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.813099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 816/1648] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 12:00:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:10.813778 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cb309-5219-4b15-b2ce-7d848938d241 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:10.825918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cb309-5219-4b15-b2ce-7d848938d241 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:10.833138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e9c97-1144-4221-b139-bd9c41176372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:10.834159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e9c97-1144-4221-b139-bd9c41176372 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:10.834460 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e9c97-1144-4221-b139-bd9c41176372 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:10.834948 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e9c97-1144-4221-b139-bd9c41176372 admin admin] PATH_INFO: `/v3/projects/e071fc0570ef4ba6a35e104fa049aa54/users/75c0afce0a944abbb758cab4ba32209b/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.836988 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e9c97-1144-4221-b139-bd9c41176372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e071fc0570ef4ba6a35e104fa049aa54, user_id=75c0afce0a944abbb758cab4ba32209b, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:10.841007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e9c97-1144-4221-b139-bd9c41176372 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:10.854434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 817/1649] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:10 2022] PUT /identity/v3/projects/e071fc0570ef4ba6a35e104fa049aa54/users/75c0afce0a944abbb758cab4ba32209b/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:10.855336 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e9c97-1144-4221-b139-bd9c41176372 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:10.859771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c565fbc-1438-4f4e-b119-e55c9fb65709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:10.863334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c565fbc-1438-4f4e-b119-e55c9fb65709 service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:10.876902 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 833/1650] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:10.878354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d7987-b40e-421a-9cf9-7e3732ad38df None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:10.878643 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d7987-b40e-421a-9cf9-7e3732ad38df None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:10.878968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d7987-b40e-421a-9cf9-7e3732ad38df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.913883 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-089d7987-b40e-421a-9cf9-7e3732ad38df None None] MFA Rules not processed for user `75c0afce0a944abbb758cab4ba32209b`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:10.915273 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-089d7987-b40e-421a-9cf9-7e3732ad38df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:10.929682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e9c97-1144-4221-b139-bd9c41176372 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:10.942636 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa64d4e-e7eb-4c47-a2ce-b03da57a20de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:10.944166 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa64d4e-e7eb-4c47-a2ce-b03da57a20de admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:10.944604 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa64d4e-e7eb-4c47-a2ce-b03da57a20de admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:10.945076 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa64d4e-e7eb-4c47-a2ce-b03da57a20de admin admin] PATH_INFO: `/v3/projects/d676af96e9744733b409b8b360c476bd/users/58e4931a116a4046a454501264e53f53/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:10.949990 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa64d4e-e7eb-4c47-a2ce-b03da57a20de admin admin] RBAC: Authorizing `identity:create_grant(project_id=d676af96e9744733b409b8b360c476bd, user_id=58e4931a116a4046a454501264e53f53, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:10.951988 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa64d4e-e7eb-4c47-a2ce-b03da57a20de admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:10.975047 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 818/1651] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:10 2022] PUT /identity/v3/projects/d676af96e9744733b409b8b360c476bd/users/58e4931a116a4046a454501264e53f53/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:10.976743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa64d4e-e7eb-4c47-a2ce-b03da57a20de admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:11.004248 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 834/1652] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:10 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:11.005857 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526fc6d-dda4-4518-8929-d244711d9435 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:11.006146 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526fc6d-dda4-4518-8929-d244711d9435 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:11.006630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526fc6d-dda4-4518-8929-d244711d9435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:11.039262 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c526fc6d-dda4-4518-8929-d244711d9435 None None] MFA Rules not processed for user `58e4931a116a4046a454501264e53f53`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:11.040540 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c526fc6d-dda4-4518-8929-d244711d9435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:11.087228 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa64d4e-e7eb-4c47-a2ce-b03da57a20de admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:11.094847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca73a0-2cc4-42d0-aa51-46c11b1d7532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:11.094847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca73a0-2cc4-42d0-aa51-46c11b1d7532 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:11.094847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca73a0-2cc4-42d0-aa51-46c11b1d7532 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:11.094847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca73a0-2cc4-42d0-aa51-46c11b1d7532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:11.125065 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 835/1653] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:11.199391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca73a0-2cc4-42d0-aa51-46c11b1d7532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:11.200941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca73a0-2cc4-42d0-aa51-46c11b1d7532 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:11.213115 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 819/1654] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:11.434645 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfb1c6-f3b8-4237-8d94-ed55c49c119f None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:11.435120 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfb1c6-f3b8-4237-8d94-ed55c49c119f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:11.435472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfb1c6-f3b8-4237-8d94-ed55c49c119f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:11.482931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca73a0-2cc4-42d0-aa51-46c11b1d7532 service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:11.492417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-3ccfb1c6-f3b8-4237-8d94-ed55c49c119f None None] MFA Rules not processed for user `abd58985a7e84aa7b084862024d6ee41`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:11.494927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3ccfb1c6-f3b8-4237-8d94-ed55c49c119f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:11.509754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca73a0-2cc4-42d0-aa51-46c11b1d7532 service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:11.516406 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde14470-a48c-437e-9897-77eb959bf3f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:11.516754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde14470-a48c-437e-9897-77eb959bf3f4 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:11.517040 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde14470-a48c-437e-9897-77eb959bf3f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:11.517313 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde14470-a48c-437e-9897-77eb959bf3f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:11.637095 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde14470-a48c-437e-9897-77eb959bf3f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:11.638693 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde14470-a48c-437e-9897-77eb959bf3f4 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:11.651236 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 820/1655] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:11 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:00:11.665031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 836/1656] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:11.665200 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d27571-536e-403c-a3c0-12e648bee87a None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:11.665511 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d27571-536e-403c-a3c0-12e648bee87a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:11.665941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d27571-536e-403c-a3c0-12e648bee87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:11.696357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-e4d27571-536e-403c-a3c0-12e648bee87a None None] MFA Rules not processed for user `abd58985a7e84aa7b084862024d6ee41`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:11.697717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e4d27571-536e-403c-a3c0-12e648bee87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:11.707387 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 821/1657] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:11.727723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420102c-fe42-4e3b-ae3b-0bb2b1433814 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:11.728298 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420102c-fe42-4e3b-ae3b-0bb2b1433814 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:11.728866 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420102c-fe42-4e3b-ae3b-0bb2b1433814 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:11.731387 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 837/1658] 10.222.0.52 () {54 vars in 961 bytes} [Tue Mar 8 12:00:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:00:11.738436 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc839-8fcb-463c-95b8-d6f83831dd4c None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:11.743924 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc839-8fcb-463c-95b8-d6f83831dd4c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:11.743924 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc839-8fcb-463c-95b8-d6f83831dd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:11.772130 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-cb3dc839-8fcb-463c-95b8-d6f83831dd4c None None] MFA Rules not processed for user `534fd902f96043068e99ca0537cf57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:11.773774 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-cb3dc839-8fcb-463c-95b8-d6f83831dd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:11.811164 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420102c-fe42-4e3b-ae3b-0bb2b1433814 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:11.821112 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 822/1659] 10.222.0.52 () {58 vars in 1058 bytes} [Tue Mar 8 12:00:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:00:11.822243 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dc839-8fcb-463c-95b8-d6f83831dd4c None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:11.845912 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dc839-8fcb-463c-95b8-d6f83831dd4c None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:11.851043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4874c2-7392-4293-928d-7111d457ae2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:11.851788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4874c2-7392-4293-928d-7111d457ae2f service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:11.852096 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4874c2-7392-4293-928d-7111d457ae2f service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:11.852345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4874c2-7392-4293-928d-7111d457ae2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:11.862506 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4874c2-7392-4293-928d-7111d457ae2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:11.862723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420102c-fe42-4e3b-ae3b-0bb2b1433814 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:11.863996 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4874c2-7392-4293-928d-7111d457ae2f service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:11.874976 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 823/1660] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:11.876473 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d158b-d7d9-4a9f-a664-b751a33bd79a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:11.877192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d158b-d7d9-4a9f-a664-b751a33bd79a service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:11.877771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d158b-d7d9-4a9f-a664-b751a33bd79a service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:11.877771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d158b-d7d9-4a9f-a664-b751a33bd79a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:11.892990 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d158b-d7d9-4a9f-a664-b751a33bd79a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:11.895564 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d158b-d7d9-4a9f-a664-b751a33bd79a service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:11.926760 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 838/1661] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:12.252691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5e008-da38-47f6-8a00-8bc546864570 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:12.253134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5e008-da38-47f6-8a00-8bc546864570 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:12.253563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5e008-da38-47f6-8a00-8bc546864570 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:12.256725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 824/1662] 10.222.0.52 () {54 vars in 912 bytes} [Tue Mar 8 12:00:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:00:12.267186 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245e996-1c45-4f4f-86b1-1fa130751ef4 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:12.271301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245e996-1c45-4f4f-86b1-1fa130751ef4 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:12.271301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245e996-1c45-4f4f-86b1-1fa130751ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:12.304449 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-2245e996-1c45-4f4f-86b1-1fa130751ef4 None None] MFA Rules not processed for user `534fd902f96043068e99ca0537cf57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:12.305662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-2245e996-1c45-4f4f-86b1-1fa130751ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:12.327428 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 839/1663] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 12:00:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:12.342515 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5e008-da38-47f6-8a00-8bc546864570 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:12.344605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-3da5e008-da38-47f6-8a00-8bc546864570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:12.487175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5e008-da38-47f6-8a00-8bc546864570 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:12.498705 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832c156-26eb-4ae5-82af-78276c3aae5f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65583446d2e40a69dff534b73e8fa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:12.499471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832c156-26eb-4ae5-82af-78276c3aae5f service glance] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:12.499704 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832c156-26eb-4ae5-82af-78276c3aae5f service glance] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:12.499962 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832c156-26eb-4ae5-82af-78276c3aae5f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:12.512690 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832c156-26eb-4ae5-82af-78276c3aae5f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:12.514191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832c156-26eb-4ae5-82af-78276c3aae5f service glance] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:12.531407 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 825/1664] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:12.552140 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245e996-1c45-4f4f-86b1-1fa130751ef4 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:12.564309 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245e996-1c45-4f4f-86b1-1fa130751ef4 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:12.584907 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6337a-7f11-47e9-bcd5-888071168ca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:12.587034 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6337a-7f11-47e9-bcd5-888071168ca5 service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:12.587207 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6337a-7f11-47e9-bcd5-888071168ca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:12.587493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6337a-7f11-47e9-bcd5-888071168ca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:12.722416 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6337a-7f11-47e9-bcd5-888071168ca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:12.724109 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6337a-7f11-47e9-bcd5-888071168ca5 service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:12.736603 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 840/1665] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:12 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:13.022771 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbbbd2-2305-4198-b77e-62a0e153c2c6 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:13.023231 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbbbd2-2305-4198-b77e-62a0e153c2c6 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:13.023731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbbbd2-2305-4198-b77e-62a0e153c2c6 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:13.026070 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 826/1666] 10.222.0.52 () {54 vars in 912 bytes} [Tue Mar 8 12:00:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:00:13.033260 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479ec2e-7b2c-45e0-aaf6-b7e9df3584c3 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:13.034137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479ec2e-7b2c-45e0-aaf6-b7e9df3584c3 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:13.034563 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479ec2e-7b2c-45e0-aaf6-b7e9df3584c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:13.082781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c479ec2e-7b2c-45e0-aaf6-b7e9df3584c3 None None] MFA Rules not processed for user `a5f8507c0ae342f7a3e97b48363ad606`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:13.084387 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c479ec2e-7b2c-45e0-aaf6-b7e9df3584c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:13.178101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 841/1667] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 12:00:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:13.228569 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbbbd2-2305-4198-b77e-62a0e153c2c6 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:13.250111 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbbbd2-2305-4198-b77e-62a0e153c2c6 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:13.258037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9288e-9635-4768-943f-a6d7d9654fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:13.258979 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9288e-9635-4768-943f-a6d7d9654fcd service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:13.259313 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9288e-9635-4768-943f-a6d7d9654fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:13.259676 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9288e-9635-4768-943f-a6d7d9654fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:13.280882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9288e-9635-4768-943f-a6d7d9654fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:13.295019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9288e-9635-4768-943f-a6d7d9654fcd service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:13.309929 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 827/1668] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:13.362549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479ec2e-7b2c-45e0-aaf6-b7e9df3584c3 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:13.380318 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479ec2e-7b2c-45e0-aaf6-b7e9df3584c3 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:13.391726 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19af03-9e08-4fd1-80e7-e35ed81f22b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:13.392837 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19af03-9e08-4fd1-80e7-e35ed81f22b0 service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:13.396014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19af03-9e08-4fd1-80e7-e35ed81f22b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:13.396319 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19af03-9e08-4fd1-80e7-e35ed81f22b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:13.553820 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19af03-9e08-4fd1-80e7-e35ed81f22b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:13.555444 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19af03-9e08-4fd1-80e7-e35ed81f22b0 service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:13.582674 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 842/1669] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:14.465313 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9288e-9635-4768-943f-a6d7d9654fcd service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:14.482923 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7b5fa-884c-4a02-919b-d3fca1f063bb None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:14.483946 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7b5fa-884c-4a02-919b-d3fca1f063bb None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:14.484430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7b5fa-884c-4a02-919b-d3fca1f063bb None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:14.487384 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 843/1670] 10.222.0.52 () {54 vars in 960 bytes} [Tue Mar 8 12:00:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:00:14.494000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0644b-55f5-41cb-8a3c-f4ceb2917060 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:14.497354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0644b-55f5-41cb-8a3c-f4ceb2917060 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:14.497875 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0644b-55f5-41cb-8a3c-f4ceb2917060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:14.550489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-4fd0644b-55f5-41cb-8a3c-f4ceb2917060 None None] MFA Rules not processed for user `8855284b10c64b8ca367e3c30b5f66fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:14.552090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-4fd0644b-55f5-41cb-8a3c-f4ceb2917060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:14.664869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9288e-9635-4768-943f-a6d7d9654fcd service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:14.679154 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12807792-c4cc-48ac-9bd1-434290402d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:14.680075 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12807792-c4cc-48ac-9bd1-434290402d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:14.680459 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12807792-c4cc-48ac-9bd1-434290402d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:14.680775 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12807792-c4cc-48ac-9bd1-434290402d97 admin admin] PATH_INFO: `/v3/users/c49fe06c6ef04cc387ce7c0dc4e491b4` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:14.692448 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12807792-c4cc-48ac-9bd1-434290402d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49fe06c6ef04cc387ce7c0dc4e491b4)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:14.695075 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12807792-c4cc-48ac-9bd1-434290402d97 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:14.700188 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 844/1671] 10.222.0.52 () {58 vars in 1057 bytes} [Tue Mar 8 12:00:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:00:14.722158 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0644b-55f5-41cb-8a3c-f4ceb2917060 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:14.734844 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0644b-55f5-41cb-8a3c-f4ceb2917060 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:14.761777 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f593b-e526-4fb0-81c6-fbbb03c2b98c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8855284b10c64b8ca367e3c30b5f66fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:14.761777 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f593b-e526-4fb0-81c6-fbbb03c2b98c service placement] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:14.761777 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f593b-e526-4fb0-81c6-fbbb03c2b98c service placement] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:14.761777 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f593b-e526-4fb0-81c6-fbbb03c2b98c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:14.767923 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-777f593b-e526-4fb0-81c6-fbbb03c2b98c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:14.795632 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f593b-e526-4fb0-81c6-fbbb03c2b98c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:14.797211 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f593b-e526-4fb0-81c6-fbbb03c2b98c service placement] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:14.839017 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 845/1672] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:15.007889 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-12807792-c4cc-48ac-9bd1-434290402d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49fe06c6ef04cc387ce7c0dc4e491b4'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:15.011425 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-12807792-c4cc-48ac-9bd1-434290402d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49fe06c6ef04cc387ce7c0dc4e491b4'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:15.160167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-12807792-c4cc-48ac-9bd1-434290402d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49fe06c6ef04cc387ce7c0dc4e491b4'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:15.185432 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-12807792-c4cc-48ac-9bd1-434290402d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49fe06c6ef04cc387ce7c0dc4e491b4'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:15.198384 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-12807792-c4cc-48ac-9bd1-434290402d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49fe06c6ef04cc387ce7c0dc4e491b4'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:15.237847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 828/1673] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:14 2022] DELETE /identity/v3/users/c49fe06c6ef04cc387ce7c0dc4e491b4 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:15.238242 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825f723-1347-4ab8-b43d-5111d6db48b0 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:15.238541 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825f723-1347-4ab8-b43d-5111d6db48b0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:15.238825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825f723-1347-4ab8-b43d-5111d6db48b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:15.273754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-4825f723-1347-4ab8-b43d-5111d6db48b0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:15.277596 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-4825f723-1347-4ab8-b43d-5111d6db48b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:15.654092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 846/1674] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:15.655613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12807792-c4cc-48ac-9bd1-434290402d97 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:15.655613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-12807792-c4cc-48ac-9bd1-434290402d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:15.655613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12807792-c4cc-48ac-9bd1-434290402d97 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:15.656941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c2b6a-1408-4392-ae4a-c6615d2e02ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:15.656941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c2b6a-1408-4392-ae4a-c6615d2e02ea service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:15.656941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c2b6a-1408-4392-ae4a-c6615d2e02ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:15.656941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c2b6a-1408-4392-ae4a-c6615d2e02ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:15.658388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c2b6a-1408-4392-ae4a-c6615d2e02ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:15.658388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c2b6a-1408-4392-ae4a-c6615d2e02ea service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:15.658388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 829/1675] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:17.012804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825f723-1347-4ab8-b43d-5111d6db48b0 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:17.018599 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-4825f723-1347-4ab8-b43d-5111d6db48b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:17.092309 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825f723-1347-4ab8-b43d-5111d6db48b0 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:17.109289 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a10b47-c245-4dcb-bf1b-0209f17de253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:17.110643 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a10b47-c245-4dcb-bf1b-0209f17de253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:17.111286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a10b47-c245-4dcb-bf1b-0209f17de253 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:17.111826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a10b47-c245-4dcb-bf1b-0209f17de253 admin admin] PATH_INFO: `/v3/projects/53ce1ccc33ea417399e63877dbec8e70` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:17.116780 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a10b47-c245-4dcb-bf1b-0209f17de253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ce1ccc33ea417399e63877dbec8e70)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:17.119617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a10b47-c245-4dcb-bf1b-0209f17de253 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:17.170464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c2b6a-1408-4392-ae4a-c6615d2e02ea service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:17.172010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e51c2b6a-1408-4392-ae4a-c6615d2e02ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:17.187634 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c2b6a-1408-4392-ae4a-c6615d2e02ea service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:17.210905 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfca41-0c6f-46eb-a59e-19c7c9e177de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:17.211851 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfca41-0c6f-46eb-a59e-19c7c9e177de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:17.212137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfca41-0c6f-46eb-a59e-19c7c9e177de admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:17.213973 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfca41-0c6f-46eb-a59e-19c7c9e177de admin admin] PATH_INFO: `/v3/users/43d7ea8eb084481087633dee37f36073` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:17.217039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfca41-0c6f-46eb-a59e-19c7c9e177de admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d7ea8eb084481087633dee37f36073)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:17.219286 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfca41-0c6f-46eb-a59e-19c7c9e177de admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:17.303984 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-74a10b47-c245-4dcb-bf1b-0209f17de253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ce1ccc33ea417399e63877dbec8e70', 'request_id': 'req-74a10b47-c245-4dcb-bf1b-0209f17de253'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:17.317641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-74a10b47-c245-4dcb-bf1b-0209f17de253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ce1ccc33ea417399e63877dbec8e70', 'request_id': 'req-74a10b47-c245-4dcb-bf1b-0209f17de253'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:17.428866 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-74a10b47-c245-4dcb-bf1b-0209f17de253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ce1ccc33ea417399e63877dbec8e70', 'request_id': 'req-74a10b47-c245-4dcb-bf1b-0209f17de253'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:17.450526 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-74a10b47-c245-4dcb-bf1b-0209f17de253 admin admin] The token cache is being invalidate because project 53ce1ccc33ea417399e63877dbec8e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:17.450826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-74a10b47-c245-4dcb-bf1b-0209f17de253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:17.454636 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-74a10b47-c245-4dcb-bf1b-0209f17de253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:17.477029 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 847/1676] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:17 2022] DELETE /identity/v3/projects/53ce1ccc33ea417399e63877dbec8e70 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:17.478029 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a10b47-c245-4dcb-bf1b-0209f17de253 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:17.485887 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-74a10b47-c245-4dcb-bf1b-0209f17de253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:17.489877 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9adfca41-0c6f-46eb-a59e-19c7c9e177de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d7ea8eb084481087633dee37f36073'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:17.491312 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9adfca41-0c6f-46eb-a59e-19c7c9e177de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d7ea8eb084481087633dee37f36073'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:17.582619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9adfca41-0c6f-46eb-a59e-19c7c9e177de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d7ea8eb084481087633dee37f36073'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:17.604393 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9adfca41-0c6f-46eb-a59e-19c7c9e177de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d7ea8eb084481087633dee37f36073'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:17.618182 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9adfca41-0c6f-46eb-a59e-19c7c9e177de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d7ea8eb084481087633dee37f36073'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:17.637619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 830/1677] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:17 2022] DELETE /identity/v3/users/43d7ea8eb084481087633dee37f36073 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:00:17.639398 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7571b1-a217-4efc-89ee-5ba7c97ff92c None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:17.639512 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7571b1-a217-4efc-89ee-5ba7c97ff92c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:17.642771 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7571b1-a217-4efc-89ee-5ba7c97ff92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:17.653781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a10b47-c245-4dcb-bf1b-0209f17de253 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:17.682103 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-ce7571b1-a217-4efc-89ee-5ba7c97ff92c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:17.690865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ce7571b1-a217-4efc-89ee-5ba7c97ff92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:17.738714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd641b9-3758-4e4c-800d-680c16bb8282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:17.739956 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd641b9-3758-4e4c-800d-680c16bb8282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:17.740375 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd641b9-3758-4e4c-800d-680c16bb8282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:17.740784 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd641b9-3758-4e4c-800d-680c16bb8282 admin admin] PATH_INFO: `/v3/users/33ac8c7558cc49598e610e6f0866c3e2` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:17.743311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd641b9-3758-4e4c-800d-680c16bb8282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ac8c7558cc49598e610e6f0866c3e2)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:17.747834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: WARNING py.warnings [None req-9cd641b9-3758-4e4c-800d-680c16bb8282 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 12:00:17.747834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: warnings.warn(msg) Mar 08 12:00:17.747834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: Mar 08 12:00:17.749602 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd641b9-3758-4e4c-800d-680c16bb8282 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:17.827011 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 831/1678] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:17.843161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7571b1-a217-4efc-89ee-5ba7c97ff92c None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:17.844453 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ce7571b1-a217-4efc-89ee-5ba7c97ff92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:17.936969 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7571b1-a217-4efc-89ee-5ba7c97ff92c None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:17.943252 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ef0e8-3801-4254-b71f-81b4df86ed7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:17.944369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ef0e8-3801-4254-b71f-81b4df86ed7a service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:17.944829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ef0e8-3801-4254-b71f-81b4df86ed7a service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:17.945872 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ef0e8-3801-4254-b71f-81b4df86ed7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:17.979621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ef0e8-3801-4254-b71f-81b4df86ed7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:17.979621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ef0e8-3801-4254-b71f-81b4df86ed7a service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:17.987945 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 832/1679] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:00:17.989409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca276f-8c86-4f68-893a-a3788870cba8 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:17.989707 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca276f-8c86-4f68-893a-a3788870cba8 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:17.989960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca276f-8c86-4f68-893a-a3788870cba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:18.033554 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-4bca276f-8c86-4f68-893a-a3788870cba8 None None] MFA Rules not processed for user `f98ed54ebbfd4c10aeff826dd1765150`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:18.036659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-4bca276f-8c86-4f68-893a-a3788870cba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:18.047799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9cd641b9-3758-4e4c-800d-680c16bb8282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ac8c7558cc49598e610e6f0866c3e2'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:18.049932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9cd641b9-3758-4e4c-800d-680c16bb8282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ac8c7558cc49598e610e6f0866c3e2'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:18.086602 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9cd641b9-3758-4e4c-800d-680c16bb8282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ac8c7558cc49598e610e6f0866c3e2'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:18.157729 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 833/1680] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:18.168974 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf33d21-7b57-4ca6-b6f0-84350197d499 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:18.169793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf33d21-7b57-4ca6-b6f0-84350197d499 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:18.169793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf33d21-7b57-4ca6-b6f0-84350197d499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:18.170430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9cd641b9-3758-4e4c-800d-680c16bb8282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ac8c7558cc49598e610e6f0866c3e2'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:18.194836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-baf33d21-7b57-4ca6-b6f0-84350197d499 None None] MFA Rules not processed for user `f98ed54ebbfd4c10aeff826dd1765150`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:18.196363 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-baf33d21-7b57-4ca6-b6f0-84350197d499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:18.214403 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 834/1681] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:18.221505 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9cd641b9-3758-4e4c-800d-680c16bb8282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ac8c7558cc49598e610e6f0866c3e2'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:18.226310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf33d21-7b57-4ca6-b6f0-84350197d499 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:18.228399 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-baf33d21-7b57-4ca6-b6f0-84350197d499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:18.248092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 848/1682] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:17 2022] DELETE /identity/v3/users/33ac8c7558cc49598e610e6f0866c3e2 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:18.362429 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf33d21-7b57-4ca6-b6f0-84350197d499 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:18.519080 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ee200-000a-4582-a507-e4cd3ccc4f3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:18.529177 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ee200-000a-4582-a507-e4cd3ccc4f3b service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:18.532086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ee200-000a-4582-a507-e4cd3ccc4f3b service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:18.532674 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ee200-000a-4582-a507-e4cd3ccc4f3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:18.699573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ee200-000a-4582-a507-e4cd3ccc4f3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:18.703279 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ee200-000a-4582-a507-e4cd3ccc4f3b service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:18.726578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 835/1683] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:18.810521 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7d4d1-c2c1-4455-85a4-708fa195000a None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:18.810920 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7d4d1-c2c1-4455-85a4-708fa195000a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:18.811303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7d4d1-c2c1-4455-85a4-708fa195000a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:18.851753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-f6f7d4d1-c2c1-4455-85a4-708fa195000a None None] MFA Rules not processed for user `bda2f2412e6441c3a8c232f39c56fc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:18.852993 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f6f7d4d1-c2c1-4455-85a4-708fa195000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:18.940364 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 849/1684] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:18.952928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ee200-000a-4582-a507-e4cd3ccc4f3b service nova] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:18.954384 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-312ee200-000a-4582-a507-e4cd3ccc4f3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:18.977717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ee200-000a-4582-a507-e4cd3ccc4f3b service nova] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:18.988376 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81fbf6-eb1a-4c53-b7a9-5b8e8029c8a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:18.988376 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81fbf6-eb1a-4c53-b7a9-5b8e8029c8a6 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:18.988376 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81fbf6-eb1a-4c53-b7a9-5b8e8029c8a6 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:18.988376 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81fbf6-eb1a-4c53-b7a9-5b8e8029c8a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:18.999685 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81fbf6-eb1a-4c53-b7a9-5b8e8029c8a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:19.003894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81fbf6-eb1a-4c53-b7a9-5b8e8029c8a6 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:19.017833 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 836/1685] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:19.424767 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7d4d1-c2c1-4455-85a4-708fa195000a None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:19.426361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f6f7d4d1-c2c1-4455-85a4-708fa195000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:19.447938 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81fbf6-eb1a-4c53-b7a9-5b8e8029c8a6 service nova] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:19.450944 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0f81fbf6-eb1a-4c53-b7a9-5b8e8029c8a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:19.532491 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7d4d1-c2c1-4455-85a4-708fa195000a None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:19.537969 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9aba68-39cf-4693-8907-d49850d8a8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:19.540173 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aba68-39cf-4693-8907-d49850d8a8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:19.540608 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aba68-39cf-4693-8907-d49850d8a8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:19.541021 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aba68-39cf-4693-8907-d49850d8a8ef admin admin] PATH_INFO: `/v3/projects/f5cfbecc5ecd4f938ac389ee436b585d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:19.543949 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9aba68-39cf-4693-8907-d49850d8a8ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5cfbecc5ecd4f938ac389ee436b585d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:19.546387 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9aba68-39cf-4693-8907-d49850d8a8ef admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:19.644428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81fbf6-eb1a-4c53-b7a9-5b8e8029c8a6 service nova] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:19.652189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5555d-0dda-435a-9f6e-4209ca668fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:19.654008 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5555d-0dda-435a-9f6e-4209ca668fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:19.654438 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5555d-0dda-435a-9f6e-4209ca668fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:19.654716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5555d-0dda-435a-9f6e-4209ca668fb1 admin admin] PATH_INFO: `/v3/projects/1b8cdeaa323c4f7dba6f017437a22621` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:19.656214 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5555d-0dda-435a-9f6e-4209ca668fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8cdeaa323c4f7dba6f017437a22621)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:19.657251 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: WARNING py.warnings [None req-6ad5555d-0dda-435a-9f6e-4209ca668fb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 12:00:19.657251 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: warnings.warn(msg) Mar 08 12:00:19.657251 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: Mar 08 12:00:19.663061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5555d-0dda-435a-9f6e-4209ca668fb1 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:19.761601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5a9aba68-39cf-4693-8907-d49850d8a8ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5cfbecc5ecd4f938ac389ee436b585d', 'request_id': 'req-5a9aba68-39cf-4693-8907-d49850d8a8ef'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:19.785930 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5a9aba68-39cf-4693-8907-d49850d8a8ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5cfbecc5ecd4f938ac389ee436b585d', 'request_id': 'req-5a9aba68-39cf-4693-8907-d49850d8a8ef'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:19.885712 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6ad5555d-0dda-435a-9f6e-4209ca668fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8cdeaa323c4f7dba6f017437a22621', 'request_id': 'req-6ad5555d-0dda-435a-9f6e-4209ca668fb1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:19.896784 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5a9aba68-39cf-4693-8907-d49850d8a8ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5cfbecc5ecd4f938ac389ee436b585d', 'request_id': 'req-5a9aba68-39cf-4693-8907-d49850d8a8ef'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:19.910602 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5a9aba68-39cf-4693-8907-d49850d8a8ef admin admin] The token cache is being invalidate because project f5cfbecc5ecd4f938ac389ee436b585d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:19.910898 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5a9aba68-39cf-4693-8907-d49850d8a8ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:19.913295 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5a9aba68-39cf-4693-8907-d49850d8a8ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:19.916614 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 850/1686] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:19 2022] DELETE /identity/v3/projects/f5cfbecc5ecd4f938ac389ee436b585d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:19.921799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319d080-748f-4dce-aafb-1afd7494dcdd None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:19.922036 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319d080-748f-4dce-aafb-1afd7494dcdd None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:19.926038 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319d080-748f-4dce-aafb-1afd7494dcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:19.961384 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-0319d080-748f-4dce-aafb-1afd7494dcdd None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:19.963069 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-0319d080-748f-4dce-aafb-1afd7494dcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:20.032098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6ad5555d-0dda-435a-9f6e-4209ca668fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8cdeaa323c4f7dba6f017437a22621', 'request_id': 'req-6ad5555d-0dda-435a-9f6e-4209ca668fb1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:20.054290 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 851/1687] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:20.063896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8b95b-7f00-4169-ab80-f78a91953e5b None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:20.064063 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8b95b-7f00-4169-ab80-f78a91953e5b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:20.064270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8b95b-7f00-4169-ab80-f78a91953e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:20.069735 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6ad5555d-0dda-435a-9f6e-4209ca668fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8cdeaa323c4f7dba6f017437a22621', 'request_id': 'req-6ad5555d-0dda-435a-9f6e-4209ca668fb1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:20.111170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6ad5555d-0dda-435a-9f6e-4209ca668fb1 admin admin] The token cache is being invalidate because project 1b8cdeaa323c4f7dba6f017437a22621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:20.112418 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6ad5555d-0dda-435a-9f6e-4209ca668fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:20.115113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6ad5555d-0dda-435a-9f6e-4209ca668fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:20.123034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 837/1688] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:19 2022] DELETE /identity/v3/projects/1b8cdeaa323c4f7dba6f017437a22621 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:20.123034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca78c35-1c05-4586-b8fd-5f6f32cad7de None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:20.123034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca78c35-1c05-4586-b8fd-5f6f32cad7de None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:20.123349 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-83e8b95b-7f00-4169-ab80-f78a91953e5b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:20.126252 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-83e8b95b-7f00-4169-ab80-f78a91953e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:20.127471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca78c35-1c05-4586-b8fd-5f6f32cad7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:20.151160 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 852/1689] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:20.155610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54705bc-3841-455f-8dd1-a0e95b23f756 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:20.155910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54705bc-3841-455f-8dd1-a0e95b23f756 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:20.156187 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54705bc-3841-455f-8dd1-a0e95b23f756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:20.181817 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-2ca78c35-1c05-4586-b8fd-5f6f32cad7de None None] MFA Rules not processed for user `f98ed54ebbfd4c10aeff826dd1765150`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:20.191785 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-2ca78c35-1c05-4586-b8fd-5f6f32cad7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:20.242289 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-d54705bc-3841-455f-8dd1-a0e95b23f756 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:20.249550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d54705bc-3841-455f-8dd1-a0e95b23f756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:20.283111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 853/1690] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:20.284071 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54705bc-3841-455f-8dd1-a0e95b23f756 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:20.298933 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54705bc-3841-455f-8dd1-a0e95b23f756 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:20.308810 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a5745-ebee-4a17-80ed-623f4535bb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:20.309620 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a5745-ebee-4a17-80ed-623f4535bb5a admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:20.309905 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a5745-ebee-4a17-80ed-623f4535bb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:20.310327 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a5745-ebee-4a17-80ed-623f4535bb5a admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:20.316157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a5745-ebee-4a17-80ed-623f4535bb5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:20.316157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a5745-ebee-4a17-80ed-623f4535bb5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:20.316157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a5745-ebee-4a17-80ed-623f4535bb5a admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:20.327254 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 854/1691] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:20.328809 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e605e-35a6-4bc9-9456-f717b42ee279 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:20.329174 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e605e-35a6-4bc9-9456-f717b42ee279 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:20.329685 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e605e-35a6-4bc9-9456-f717b42ee279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:20.342373 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 838/1692] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:20.342373 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca78c35-1c05-4586-b8fd-5f6f32cad7de None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:20.353065 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-cb2e605e-35a6-4bc9-9456-f717b42ee279 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:20.354646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-cb2e605e-35a6-4bc9-9456-f717b42ee279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:20.360854 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca78c35-1c05-4586-b8fd-5f6f32cad7de None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:20.368368 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e332c-d5f1-42b0-aefb-7f82d144afd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:20.369304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e332c-d5f1-42b0-aefb-7f82d144afd6 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:20.369578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e332c-d5f1-42b0-aefb-7f82d144afd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:20.369921 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e332c-d5f1-42b0-aefb-7f82d144afd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:20.375918 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 855/1693] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:20.376332 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e332c-d5f1-42b0-aefb-7f82d144afd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:20.376420 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e605e-35a6-4bc9-9456-f717b42ee279 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:20.376496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e332c-d5f1-42b0-aefb-7f82d144afd6 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:20.382851 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e605e-35a6-4bc9-9456-f717b42ee279 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:20.393401 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67005ce9-a9a8-447b-a0c7-3808b15b65bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:20.394090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67005ce9-a9a8-447b-a0c7-3808b15b65bd admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:20.395666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67005ce9-a9a8-447b-a0c7-3808b15b65bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:20.395666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67005ce9-a9a8-447b-a0c7-3808b15b65bd admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:20.395666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67005ce9-a9a8-447b-a0c7-3808b15b65bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:20.395912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67005ce9-a9a8-447b-a0c7-3808b15b65bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:20.397784 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67005ce9-a9a8-447b-a0c7-3808b15b65bd admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:20.460429 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 856/1694] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:20.461334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67005ce9-a9a8-447b-a0c7-3808b15b65bd admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:20.482172 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67005ce9-a9a8-447b-a0c7-3808b15b65bd admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:20.502552 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14704b67-5811-4db4-a5b1-0c81bdc4a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:20.503436 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14704b67-5811-4db4-a5b1-0c81bdc4a022 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:20.503866 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14704b67-5811-4db4-a5b1-0c81bdc4a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:20.504601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14704b67-5811-4db4-a5b1-0c81bdc4a022 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:20.505697 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14704b67-5811-4db4-a5b1-0c81bdc4a022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:20.507964 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14704b67-5811-4db4-a5b1-0c81bdc4a022 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:20.509100 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 839/1695] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:20 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:20.515455 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e332c-d5f1-42b0-aefb-7f82d144afd6 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:20.638252 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e332c-d5f1-42b0-aefb-7f82d144afd6 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:20.654994 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 857/1696] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:20 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:20.661778 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14704b67-5811-4db4-a5b1-0c81bdc4a022 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:20.663064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e14899-2bce-4fd7-9ad0-78059f12b773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:20.663952 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e14899-2bce-4fd7-9ad0-78059f12b773 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:20.664245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e14899-2bce-4fd7-9ad0-78059f12b773 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:20.664522 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e14899-2bce-4fd7-9ad0-78059f12b773 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:20.665551 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e14899-2bce-4fd7-9ad0-78059f12b773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:20.668555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e14899-2bce-4fd7-9ad0-78059f12b773 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:20.779261 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14704b67-5811-4db4-a5b1-0c81bdc4a022 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:20.784612 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac666ffc-8855-4316-ab1a-c77b74f811b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:20.785074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac666ffc-8855-4316-ab1a-c77b74f811b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:20.785949 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac666ffc-8855-4316-ab1a-c77b74f811b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:20.786374 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac666ffc-8855-4316-ab1a-c77b74f811b4 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:20.787226 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac666ffc-8855-4316-ab1a-c77b74f811b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:20.789398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac666ffc-8855-4316-ab1a-c77b74f811b4 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:20.816347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 840/1697] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:20 2022] POST /identity/v3/users => generated 287 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:20.820906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e14899-2bce-4fd7-9ad0-78059f12b773 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:20.836456 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e14899-2bce-4fd7-9ad0-78059f12b773 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:20.847279 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790e46e-b892-452d-87de-6ad43b3101c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:20.849373 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790e46e-b892-452d-87de-6ad43b3101c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:20.851810 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790e46e-b892-452d-87de-6ad43b3101c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:20.852350 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790e46e-b892-452d-87de-6ad43b3101c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:20.853536 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790e46e-b892-452d-87de-6ad43b3101c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:20.865068 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790e46e-b892-452d-87de-6ad43b3101c7 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:20.909568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 858/1698] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:20 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:20.909568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac666ffc-8855-4316-ab1a-c77b74f811b4 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:20.910618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 841/1699] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:20.929268 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790e46e-b892-452d-87de-6ad43b3101c7 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:20.969346 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac666ffc-8855-4316-ab1a-c77b74f811b4 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:20.986237 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fb61f-6df4-4517-98cd-8a975ef7cfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:20.990722 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fb61f-6df4-4517-98cd-8a975ef7cfcb admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:20.992058 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fb61f-6df4-4517-98cd-8a975ef7cfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:20.994807 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fb61f-6df4-4517-98cd-8a975ef7cfcb admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:20.998381 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fb61f-6df4-4517-98cd-8a975ef7cfcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:21.003652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790e46e-b892-452d-87de-6ad43b3101c7 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:21.004358 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fb61f-6df4-4517-98cd-8a975ef7cfcb admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:21.024662 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8d0c0-5fdb-4e0e-b5a9-280745b99c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:21.026011 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8d0c0-5fdb-4e0e-b5a9-280745b99c3a admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:21.027663 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8d0c0-5fdb-4e0e-b5a9-280745b99c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:21.027663 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8d0c0-5fdb-4e0e-b5a9-280745b99c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:21.034795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8d0c0-5fdb-4e0e-b5a9-280745b99c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:21.048342 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8d0c0-5fdb-4e0e-b5a9-280745b99c3a admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:21.054139 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 859/1700] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:21.059568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fb61f-6df4-4517-98cd-8a975ef7cfcb admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:21.092713 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fb61f-6df4-4517-98cd-8a975ef7cfcb admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:21.108888 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4557b-e236-433f-b043-2f5595b84b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:21.110303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4557b-e236-433f-b043-2f5595b84b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:21.110724 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4557b-e236-433f-b043-2f5595b84b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:21.110980 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4557b-e236-433f-b043-2f5595b84b69 admin admin] PATH_INFO: `/v3/projects/b382f64efc8c47cf9d5a8877a8320451/users/bf278cb07a3a48a9abc413afbe787eb5/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:21.114072 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 842/1701] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:21.115348 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8d0c0-5fdb-4e0e-b5a9-280745b99c3a admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:21.141960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8d0c0-5fdb-4e0e-b5a9-280745b99c3a admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:21.153927 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38df7f-b478-4130-a527-0647e85aa740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:21.156056 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38df7f-b478-4130-a527-0647e85aa740 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:21.156540 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38df7f-b478-4130-a527-0647e85aa740 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:21.157004 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38df7f-b478-4130-a527-0647e85aa740 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:21.158164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38df7f-b478-4130-a527-0647e85aa740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:21.160459 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38df7f-b478-4130-a527-0647e85aa740 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:21.171686 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4557b-e236-433f-b043-2f5595b84b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b382f64efc8c47cf9d5a8877a8320451, user_id=bf278cb07a3a48a9abc413afbe787eb5, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:21.174842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4557b-e236-433f-b043-2f5595b84b69 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:21.219648 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 843/1702] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:21.221842 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38df7f-b478-4130-a527-0647e85aa740 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:21.253985 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38df7f-b478-4130-a527-0647e85aa740 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:21.265313 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c0e0f-8962-4ba8-a234-95790254be3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:21.268135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c0e0f-8962-4ba8-a234-95790254be3d admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:21.270154 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c0e0f-8962-4ba8-a234-95790254be3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:21.270554 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c0e0f-8962-4ba8-a234-95790254be3d admin admin] PATH_INFO: `/v3/projects/776022011073402fb4dfc211533a7e7c/users/77647e9fca1d429dbe0f157095d869e5/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:21.280956 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 860/1703] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:21 2022] PUT /identity/v3/projects/b382f64efc8c47cf9d5a8877a8320451/users/bf278cb07a3a48a9abc413afbe787eb5/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:21.296067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e6aa4-270a-47e0-8965-9f166fc1bb99 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:21.296364 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e6aa4-270a-47e0-8965-9f166fc1bb99 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:21.296646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e6aa4-270a-47e0-8965-9f166fc1bb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:21.322586 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c0e0f-8962-4ba8-a234-95790254be3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=776022011073402fb4dfc211533a7e7c, user_id=77647e9fca1d429dbe0f157095d869e5, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:21.327749 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c0e0f-8962-4ba8-a234-95790254be3d admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:21.361416 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-ad9e6aa4-270a-47e0-8965-9f166fc1bb99 None None] MFA Rules not processed for user `bf278cb07a3a48a9abc413afbe787eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:21.367683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-ad9e6aa4-270a-47e0-8965-9f166fc1bb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:21.464368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 861/1704] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:21.475955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e6aa4-270a-47e0-8965-9f166fc1bb99 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:21.478287 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-ad9e6aa4-270a-47e0-8965-9f166fc1bb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:21.499317 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 844/1705] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:21 2022] PUT /identity/v3/projects/776022011073402fb4dfc211533a7e7c/users/77647e9fca1d429dbe0f157095d869e5/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:21.523899 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10fb32-064c-4773-afba-bb74bcad560b None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:21.524512 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10fb32-064c-4773-afba-bb74bcad560b None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:21.524512 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10fb32-064c-4773-afba-bb74bcad560b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:21.607361 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-7d10fb32-064c-4773-afba-bb74bcad560b None None] MFA Rules not processed for user `77647e9fca1d429dbe0f157095d869e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:21.611885 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-7d10fb32-064c-4773-afba-bb74bcad560b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:21.792258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e6aa4-270a-47e0-8965-9f166fc1bb99 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:21.828785 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 845/1706] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:21.829682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10fb32-064c-4773-afba-bb74bcad560b None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:22.011899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd7368-22d8-4d59-8e1e-ef4feb85d72b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:22.013044 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd7368-22d8-4d59-8e1e-ef4feb85d72b service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:22.013335 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd7368-22d8-4d59-8e1e-ef4feb85d72b service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:22.013618 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd7368-22d8-4d59-8e1e-ef4feb85d72b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:22.108284 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd7368-22d8-4d59-8e1e-ef4feb85d72b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:22.109122 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd7368-22d8-4d59-8e1e-ef4feb85d72b service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:22.125850 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10fb32-064c-4773-afba-bb74bcad560b None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:22.145983 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 862/1707] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:00:22.151110 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fdffe-4a38-4fc1-8236-c88fad87f146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:22.152606 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fdffe-4a38-4fc1-8236-c88fad87f146 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:22.153040 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fdffe-4a38-4fc1-8236-c88fad87f146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:22.153326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fdffe-4a38-4fc1-8236-c88fad87f146 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:22.162681 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fdffe-4a38-4fc1-8236-c88fad87f146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:22.166878 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fdffe-4a38-4fc1-8236-c88fad87f146 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:22.356890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 846/1708] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:21 2022] POST /identity/v3/projects => generated 385 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:22.358526 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd7368-22d8-4d59-8e1e-ef4feb85d72b service nova] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:22.377502 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd7368-22d8-4d59-8e1e-ef4feb85d72b service nova] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:22.518151 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583c5e5-5449-4162-90cb-d8e6e6e077c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:22.518842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583c5e5-5449-4162-90cb-d8e6e6e077c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:22.519445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583c5e5-5449-4162-90cb-d8e6e6e077c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:22.521262 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583c5e5-5449-4162-90cb-d8e6e6e077c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:22.521427 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583c5e5-5449-4162-90cb-d8e6e6e077c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:22.524290 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583c5e5-5449-4162-90cb-d8e6e6e077c8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:22.658920 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 863/1709] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:22 2022] POST /identity/v3/users => generated 299 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:22.665554 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fdffe-4a38-4fc1-8236-c88fad87f146 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:22.677721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fdffe-4a38-4fc1-8236-c88fad87f146 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:22.682832 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807424c4-6fa4-4835-928e-91dcefcf12b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:22.683571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807424c4-6fa4-4835-928e-91dcefcf12b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:22.683864 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807424c4-6fa4-4835-928e-91dcefcf12b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:22.684138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807424c4-6fa4-4835-928e-91dcefcf12b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:22.685061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807424c4-6fa4-4835-928e-91dcefcf12b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:22.687480 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807424c4-6fa4-4835-928e-91dcefcf12b4 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:22.709007 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583c5e5-5449-4162-90cb-d8e6e6e077c8 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:22.709506 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 847/1710] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:22.712716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807424c4-6fa4-4835-928e-91dcefcf12b4 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:22.722549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583c5e5-5449-4162-90cb-d8e6e6e077c8 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:22.733750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807424c4-6fa4-4835-928e-91dcefcf12b4 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:22.767269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516090d-4729-4351-8c9a-fa6939fce19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:22.767723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10872079-b016-4755-946e-1442ded55e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:22.771449 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10872079-b016-4755-946e-1442ded55e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:22.775270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516090d-4729-4351-8c9a-fa6939fce19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:22.775270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516090d-4729-4351-8c9a-fa6939fce19d admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:22.775514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10872079-b016-4755-946e-1442ded55e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:22.775514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10872079-b016-4755-946e-1442ded55e11 admin admin] PATH_INFO: `/v3/projects/970ce2fe1444464fb8230979781d6128/users/875f9841ba4b43658c5c8de74e4ea3f6/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:22.775916 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516090d-4729-4351-8c9a-fa6939fce19d admin admin] PATH_INFO: `/v3/users/bf278cb07a3a48a9abc413afbe787eb5` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:22.781542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516090d-4729-4351-8c9a-fa6939fce19d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf278cb07a3a48a9abc413afbe787eb5)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:22.786079 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516090d-4729-4351-8c9a-fa6939fce19d admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:22.822866 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10872079-b016-4755-946e-1442ded55e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=970ce2fe1444464fb8230979781d6128, user_id=875f9841ba4b43658c5c8de74e4ea3f6, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:22.831563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10872079-b016-4755-946e-1442ded55e11 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:22.937471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 848/1711] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:22 2022] PUT /identity/v3/projects/970ce2fe1444464fb8230979781d6128/users/875f9841ba4b43658c5c8de74e4ea3f6/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:22.939431 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10872079-b016-4755-946e-1442ded55e11 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:23.032592 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-d516090d-4729-4351-8c9a-fa6939fce19d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf278cb07a3a48a9abc413afbe787eb5'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:23.040138 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-d516090d-4729-4351-8c9a-fa6939fce19d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf278cb07a3a48a9abc413afbe787eb5'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:23.050554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-d516090d-4729-4351-8c9a-fa6939fce19d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf278cb07a3a48a9abc413afbe787eb5'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:23.147984 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-d516090d-4729-4351-8c9a-fa6939fce19d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf278cb07a3a48a9abc413afbe787eb5'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:23.150309 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10872079-b016-4755-946e-1442ded55e11 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:23.162028 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba182de3-f3d3-4aea-ab64-cb6acbdfdf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:23.163444 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba182de3-f3d3-4aea-ab64-cb6acbdfdf78 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:23.163772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba182de3-f3d3-4aea-ab64-cb6acbdfdf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:23.164058 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba182de3-f3d3-4aea-ab64-cb6acbdfdf78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:23.166049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba182de3-f3d3-4aea-ab64-cb6acbdfdf78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:23.176856 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba182de3-f3d3-4aea-ab64-cb6acbdfdf78 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:23.203653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 849/1712] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:23.203833 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-d516090d-4729-4351-8c9a-fa6939fce19d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf278cb07a3a48a9abc413afbe787eb5'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:23.206926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba182de3-f3d3-4aea-ab64-cb6acbdfdf78 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:23.209146 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ba182de3-f3d3-4aea-ab64-cb6acbdfdf78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:23.219850 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 864/1713] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:22 2022] DELETE /identity/v3/users/bf278cb07a3a48a9abc413afbe787eb5 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:23.221502 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3e2b6-46e5-4a85-8299-95bf4f087f28 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:23.222149 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3e2b6-46e5-4a85-8299-95bf4f087f28 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:23.222436 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3e2b6-46e5-4a85-8299-95bf4f087f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:23.241026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba182de3-f3d3-4aea-ab64-cb6acbdfdf78 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:23.257692 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-d4f3e2b6-46e5-4a85-8299-95bf4f087f28 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:23.258969 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d4f3e2b6-46e5-4a85-8299-95bf4f087f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:23.371610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d270f7-cb19-49b9-82c6-68b7da88581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:23.375067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d270f7-cb19-49b9-82c6-68b7da88581a admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:23.375799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d270f7-cb19-49b9-82c6-68b7da88581a admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:23.375799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d270f7-cb19-49b9-82c6-68b7da88581a admin admin] PATH_INFO: `/v3/projects/970ce2fe1444464fb8230979781d6128/users/875f9841ba4b43658c5c8de74e4ea3f6/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:23.382313 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d270f7-cb19-49b9-82c6-68b7da88581a admin admin] RBAC: Authorizing `identity:create_grant(project_id=970ce2fe1444464fb8230979781d6128, user_id=875f9841ba4b43658c5c8de74e4ea3f6, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:23.393046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d270f7-cb19-49b9-82c6-68b7da88581a admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:23.423349 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 850/1714] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:23 2022] PUT /identity/v3/projects/970ce2fe1444464fb8230979781d6128/users/875f9841ba4b43658c5c8de74e4ea3f6/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:00:23.437966 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74126431-15ce-48a0-b711-930aa57cab5e None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:23.438632 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74126431-15ce-48a0-b711-930aa57cab5e None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:23.439217 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74126431-15ce-48a0-b711-930aa57cab5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:23.444876 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 865/1715] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:23.458201 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3e2b6-46e5-4a85-8299-95bf4f087f28 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:23.465667 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d4f3e2b6-46e5-4a85-8299-95bf4f087f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:23.490216 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-74126431-15ce-48a0-b711-930aa57cab5e None None] MFA Rules not processed for user `875f9841ba4b43658c5c8de74e4ea3f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:23.492256 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-74126431-15ce-48a0-b711-930aa57cab5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:23.564990 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3e2b6-46e5-4a85-8299-95bf4f087f28 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:23.607583 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 851/1716] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:23.619762 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74126431-15ce-48a0-b711-930aa57cab5e None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:23.627440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-74126431-15ce-48a0-b711-930aa57cab5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:23.654101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959fca0-62b1-4174-a9c4-4f1ff47f4977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:23.654101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959fca0-62b1-4174-a9c4-4f1ff47f4977 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:23.654101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959fca0-62b1-4174-a9c4-4f1ff47f4977 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:23.654101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959fca0-62b1-4174-a9c4-4f1ff47f4977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:23.746830 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959fca0-62b1-4174-a9c4-4f1ff47f4977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:23.750275 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959fca0-62b1-4174-a9c4-4f1ff47f4977 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:23.769088 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74126431-15ce-48a0-b711-930aa57cab5e None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:23.781934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ea2dd-79c3-4c64-9f9e-00301c44b65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:23.782622 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ea2dd-79c3-4c64-9f9e-00301c44b65e service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:23.782906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ea2dd-79c3-4c64-9f9e-00301c44b65e service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:23.783184 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ea2dd-79c3-4c64-9f9e-00301c44b65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:23.784712 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 866/1717] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:00:23.805459 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ea2dd-79c3-4c64-9f9e-00301c44b65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:23.809035 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ea2dd-79c3-4c64-9f9e-00301c44b65e service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:23.867678 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 852/1718] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:00:23.988842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959fca0-62b1-4174-a9c4-4f1ff47f4977 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:24.008132 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959fca0-62b1-4174-a9c4-4f1ff47f4977 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:24.026009 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67241dc3-8e1c-430e-a9bc-34e6f3fa1224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:24.028533 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67241dc3-8e1c-430e-a9bc-34e6f3fa1224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:24.029573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67241dc3-8e1c-430e-a9bc-34e6f3fa1224 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:24.030066 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67241dc3-8e1c-430e-a9bc-34e6f3fa1224 admin admin] PATH_INFO: `/v3/users/77647e9fca1d429dbe0f157095d869e5` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:24.032149 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67241dc3-8e1c-430e-a9bc-34e6f3fa1224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77647e9fca1d429dbe0f157095d869e5)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:24.034564 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67241dc3-8e1c-430e-a9bc-34e6f3fa1224 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:24.263898 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-67241dc3-8e1c-430e-a9bc-34e6f3fa1224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77647e9fca1d429dbe0f157095d869e5'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:24.267407 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-67241dc3-8e1c-430e-a9bc-34e6f3fa1224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77647e9fca1d429dbe0f157095d869e5'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:24.299833 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-67241dc3-8e1c-430e-a9bc-34e6f3fa1224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77647e9fca1d429dbe0f157095d869e5'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:24.362001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120feae-c8ff-49cd-91d6-784dab3916f7 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:24.362001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120feae-c8ff-49cd-91d6-784dab3916f7 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:24.362284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120feae-c8ff-49cd-91d6-784dab3916f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:24.379944 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-67241dc3-8e1c-430e-a9bc-34e6f3fa1224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77647e9fca1d429dbe0f157095d869e5'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:24.381863 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-1120feae-c8ff-49cd-91d6-784dab3916f7 None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:24.383302 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1120feae-c8ff-49cd-91d6-784dab3916f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:24.408173 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-67241dc3-8e1c-430e-a9bc-34e6f3fa1224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77647e9fca1d429dbe0f157095d869e5'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:24.419989 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 867/1719] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:23 2022] DELETE /identity/v3/users/77647e9fca1d429dbe0f157095d869e5 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:24.424311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d09dac-afb8-456b-ac76-9a37f35f43ed None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:24.425001 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d09dac-afb8-456b-ac76-9a37f35f43ed None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:24.425466 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d09dac-afb8-456b-ac76-9a37f35f43ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:24.456300 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-96d09dac-afb8-456b-ac76-9a37f35f43ed None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:24.459362 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-96d09dac-afb8-456b-ac76-9a37f35f43ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:24.477022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 853/1720] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 12:00:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:24.534226 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120feae-c8ff-49cd-91d6-784dab3916f7 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:24.538503 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1120feae-c8ff-49cd-91d6-784dab3916f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:24.584933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120feae-c8ff-49cd-91d6-784dab3916f7 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:24.593665 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 868/1721] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:00:24.595404 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d09dac-afb8-456b-ac76-9a37f35f43ed None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:24.597008 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-96d09dac-afb8-456b-ac76-9a37f35f43ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:24.601732 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc201b-e93d-4b47-a5e5-c102bca35989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:24.602867 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc201b-e93d-4b47-a5e5-c102bca35989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:24.604046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc201b-e93d-4b47-a5e5-c102bca35989 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:24.604403 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc201b-e93d-4b47-a5e5-c102bca35989 admin admin] PATH_INFO: `/v3/projects/b382f64efc8c47cf9d5a8877a8320451` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:24.605987 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc201b-e93d-4b47-a5e5-c102bca35989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b382f64efc8c47cf9d5a8877a8320451)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:24.627344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc201b-e93d-4b47-a5e5-c102bca35989 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:24.782910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d09dac-afb8-456b-ac76-9a37f35f43ed None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:24.785159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9abc201b-e93d-4b47-a5e5-c102bca35989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b382f64efc8c47cf9d5a8877a8320451', 'request_id': 'req-9abc201b-e93d-4b47-a5e5-c102bca35989'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:24.889593 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3399575-a2ed-486f-8479-03d6838264c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:24.890264 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3399575-a2ed-486f-8479-03d6838264c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:24.890540 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3399575-a2ed-486f-8479-03d6838264c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:24.890812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3399575-a2ed-486f-8479-03d6838264c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:24.903062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9abc201b-e93d-4b47-a5e5-c102bca35989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b382f64efc8c47cf9d5a8877a8320451', 'request_id': 'req-9abc201b-e93d-4b47-a5e5-c102bca35989'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:24.931030 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9abc201b-e93d-4b47-a5e5-c102bca35989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b382f64efc8c47cf9d5a8877a8320451', 'request_id': 'req-9abc201b-e93d-4b47-a5e5-c102bca35989'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:24.994299 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9abc201b-e93d-4b47-a5e5-c102bca35989 admin admin] The token cache is being invalidate because project b382f64efc8c47cf9d5a8877a8320451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:24.994587 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9abc201b-e93d-4b47-a5e5-c102bca35989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:24.995651 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9abc201b-e93d-4b47-a5e5-c102bca35989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:25.004287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 854/1722] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:24 2022] DELETE /identity/v3/projects/b382f64efc8c47cf9d5a8877a8320451 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:25.004287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e7b16-a67c-4e80-915c-15e2938224fb None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:25.004287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e7b16-a67c-4e80-915c-15e2938224fb None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:25.004287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e7b16-a67c-4e80-915c-15e2938224fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:25.043329 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-fc5e7b16-a67c-4e80-915c-15e2938224fb None None] MFA Rules not processed for user `bda2f2412e6441c3a8c232f39c56fc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:25.045467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-fc5e7b16-a67c-4e80-915c-15e2938224fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:25.148961 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3399575-a2ed-486f-8479-03d6838264c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:25.154121 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3399575-a2ed-486f-8479-03d6838264c6 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:25.200040 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 855/1723] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:25.202303 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e7b16-a67c-4e80-915c-15e2938224fb None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:25.206144 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-fc5e7b16-a67c-4e80-915c-15e2938224fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:25.209671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 869/1724] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:25.212878 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c56d41-a939-4701-b0c6-0ecac935b50a None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:25.213166 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c56d41-a939-4701-b0c6-0ecac935b50a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:25.213444 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c56d41-a939-4701-b0c6-0ecac935b50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:25.280601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-76c56d41-a939-4701-b0c6-0ecac935b50a None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:25.282240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-76c56d41-a939-4701-b0c6-0ecac935b50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:25.337008 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e7b16-a67c-4e80-915c-15e2938224fb None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:25.344543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d629217-99f2-4b19-bb73-ced1866eee3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:25.345708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d629217-99f2-4b19-bb73-ced1866eee3b service swift] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:25.345967 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d629217-99f2-4b19-bb73-ced1866eee3b service swift] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:25.346236 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d629217-99f2-4b19-bb73-ced1866eee3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:25.348736 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-6d629217-99f2-4b19-bb73-ced1866eee3b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:25.360738 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 870/1725] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:25.375905 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d642e-32f7-4732-855e-5a672e32c6d4 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:25.376467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d642e-32f7-4732-855e-5a672e32c6d4 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:25.377874 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d642e-32f7-4732-855e-5a672e32c6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:25.423892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-b51d642e-32f7-4732-855e-5a672e32c6d4 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:25.428713 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-b51d642e-32f7-4732-855e-5a672e32c6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:25.456556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 871/1726] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:25.460681 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d642e-32f7-4732-855e-5a672e32c6d4 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:25.476193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d642e-32f7-4732-855e-5a672e32c6d4 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:25.483618 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1ee00-0fcb-4d04-bd1a-167a047e5a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:25.484921 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1ee00-0fcb-4d04-bd1a-167a047e5a5e admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:25.485437 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1ee00-0fcb-4d04-bd1a-167a047e5a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:25.485916 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1ee00-0fcb-4d04-bd1a-167a047e5a5e admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:25.487041 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1ee00-0fcb-4d04-bd1a-167a047e5a5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:25.487595 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1ee00-0fcb-4d04-bd1a-167a047e5a5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:25.489485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1ee00-0fcb-4d04-bd1a-167a047e5a5e admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:25.512266 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 872/1727] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:25.516625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1ee00-0fcb-4d04-bd1a-167a047e5a5e admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:25.528321 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1ee00-0fcb-4d04-bd1a-167a047e5a5e admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:25.535189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7d083-7fd5-49f5-a892-7968cea7a2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:25.537662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7d083-7fd5-49f5-a892-7968cea7a2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:25.537662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7d083-7fd5-49f5-a892-7968cea7a2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:25.537662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7d083-7fd5-49f5-a892-7968cea7a2b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:25.538544 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7d083-7fd5-49f5-a892-7968cea7a2b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:25.541409 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7d083-7fd5-49f5-a892-7968cea7a2b1 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:25.572882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d629217-99f2-4b19-bb73-ced1866eee3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:25.575182 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d629217-99f2-4b19-bb73-ced1866eee3b service swift] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:25.585494 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 856/1728] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:00:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 12:00:25.643506 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 873/1729] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:25 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:25.645428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d629217-99f2-4b19-bb73-ced1866eee3b service swift] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:25.695648 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d629217-99f2-4b19-bb73-ced1866eee3b service swift] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:25.846821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eaff3-a45e-4362-aaef-d2049b60626d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:25.848669 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eaff3-a45e-4362-aaef-d2049b60626d admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:25.849402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eaff3-a45e-4362-aaef-d2049b60626d admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:25.850038 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eaff3-a45e-4362-aaef-d2049b60626d admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:25.851274 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eaff3-a45e-4362-aaef-d2049b60626d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:25.855066 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eaff3-a45e-4362-aaef-d2049b60626d admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:25.967148 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7d083-7fd5-49f5-a892-7968cea7a2b1 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:25.967630 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 857/1730] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:25 2022] POST /identity/v3/users => generated 290 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:26.013438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7d083-7fd5-49f5-a892-7968cea7a2b1 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:26.038960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da218659-8ca7-4654-97d1-1dd73b1a5c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:26.039769 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da218659-8ca7-4654-97d1-1dd73b1a5c1c admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:26.040050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da218659-8ca7-4654-97d1-1dd73b1a5c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:26.040344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da218659-8ca7-4654-97d1-1dd73b1a5c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:26.041170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da218659-8ca7-4654-97d1-1dd73b1a5c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:26.049125 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da218659-8ca7-4654-97d1-1dd73b1a5c1c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:26.081515 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eaff3-a45e-4362-aaef-d2049b60626d admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:26.096772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 874/1731] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:26.100754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eaff3-a45e-4362-aaef-d2049b60626d admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:26.118105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af429336-42fe-481f-b6a6-68cbc484fc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:26.119121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af429336-42fe-481f-b6a6-68cbc484fc0f admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:26.121342 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af429336-42fe-481f-b6a6-68cbc484fc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:26.122629 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af429336-42fe-481f-b6a6-68cbc484fc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:26.123805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af429336-42fe-481f-b6a6-68cbc484fc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:26.141725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af429336-42fe-481f-b6a6-68cbc484fc0f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:26.202672 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da218659-8ca7-4654-97d1-1dd73b1a5c1c admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:26.206003 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 858/1732] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:26.237853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da218659-8ca7-4654-97d1-1dd73b1a5c1c admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:26.260282 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552dca4d-f276-45ea-9f86-810f2127a740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:26.264699 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dca4d-f276-45ea-9f86-810f2127a740 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:26.265002 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dca4d-f276-45ea-9f86-810f2127a740 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:26.266755 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dca4d-f276-45ea-9f86-810f2127a740 admin admin] PATH_INFO: `/v3/projects/b7d54076626642c1b1480c6ade7f8d5f/users/8ae4871d81744f2dbb9c49b591cc1512/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:26.337464 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552dca4d-f276-45ea-9f86-810f2127a740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d54076626642c1b1480c6ade7f8d5f, user_id=8ae4871d81744f2dbb9c49b591cc1512, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:26.357673 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552dca4d-f276-45ea-9f86-810f2127a740 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:26.427770 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 875/1733] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:26 2022] PUT /identity/v3/projects/b7d54076626642c1b1480c6ade7f8d5f/users/8ae4871d81744f2dbb9c49b591cc1512/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:00:26.448052 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166835b4-ee9b-48ea-861f-3915ed265cb9 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:26.449074 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166835b4-ee9b-48ea-861f-3915ed265cb9 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:26.449420 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166835b4-ee9b-48ea-861f-3915ed265cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:26.565156 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-166835b4-ee9b-48ea-861f-3915ed265cb9 None None] MFA Rules not processed for user `8ae4871d81744f2dbb9c49b591cc1512`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:26.567432 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-166835b4-ee9b-48ea-861f-3915ed265cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:26.845815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 859/1734] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:26.847446 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552dca4d-f276-45ea-9f86-810f2127a740 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:26.958055 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149d0a-a93c-444c-a43d-e9d6da62f086 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:26.958601 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149d0a-a93c-444c-a43d-e9d6da62f086 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:26.958601 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149d0a-a93c-444c-a43d-e9d6da62f086 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:26.962316 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 860/1735] 10.222.0.52 () {54 vars in 912 bytes} [Tue Mar 8 12:00:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:00:26.983207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5dede-f788-4f1d-bb7a-12f71f8ff83f None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:26.983480 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5dede-f788-4f1d-bb7a-12f71f8ff83f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:26.983788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5dede-f788-4f1d-bb7a-12f71f8ff83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:27.050123 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-e0a5dede-f788-4f1d-bb7a-12f71f8ff83f None None] MFA Rules not processed for user `a5f8507c0ae342f7a3e97b48363ad606`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:27.063507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e0a5dede-f788-4f1d-bb7a-12f71f8ff83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:27.150304 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552dca4d-f276-45ea-9f86-810f2127a740 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:27.176650 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677cb6f-ef9f-4495-a2f2-a8a17d85e079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:27.179238 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677cb6f-ef9f-4495-a2f2-a8a17d85e079 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:27.179474 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677cb6f-ef9f-4495-a2f2-a8a17d85e079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:27.182744 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677cb6f-ef9f-4495-a2f2-a8a17d85e079 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:27.183633 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677cb6f-ef9f-4495-a2f2-a8a17d85e079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:27.214498 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677cb6f-ef9f-4495-a2f2-a8a17d85e079 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:27.310022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 861/1736] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 12:00:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:27.430247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5dede-f788-4f1d-bb7a-12f71f8ff83f None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:27.433064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e0a5dede-f788-4f1d-bb7a-12f71f8ff83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:27.476545 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5dede-f788-4f1d-bb7a-12f71f8ff83f None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:27.502647 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0378e6-006c-4da2-8620-a9d679528f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:27.502647 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0378e6-006c-4da2-8620-a9d679528f93 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:27.502647 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0378e6-006c-4da2-8620-a9d679528f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:27.502647 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0378e6-006c-4da2-8620-a9d679528f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:27.503361 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0378e6-006c-4da2-8620-a9d679528f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:27.503446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0378e6-006c-4da2-8620-a9d679528f93 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:27.518289 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 862/1737] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:00:27.568694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 876/1738] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:26 2022] POST /identity/v3/projects => generated 383 bytes in 721 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:27.573692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0378e6-006c-4da2-8620-a9d679528f93 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:27.609723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0378e6-006c-4da2-8620-a9d679528f93 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:27.797597 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5cf36-face-4b98-8b1f-da7784f6455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:27.799230 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5cf36-face-4b98-8b1f-da7784f6455d admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:27.800314 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5cf36-face-4b98-8b1f-da7784f6455d admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:27.801300 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5cf36-face-4b98-8b1f-da7784f6455d admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:27.803461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5cf36-face-4b98-8b1f-da7784f6455d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:27.809943 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5cf36-face-4b98-8b1f-da7784f6455d admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:28.113068 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 863/1739] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:27 2022] POST /identity/v3/users => generated 298 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:28.117510 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677cb6f-ef9f-4495-a2f2-a8a17d85e079 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:28.137333 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677cb6f-ef9f-4495-a2f2-a8a17d85e079 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:28.151508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1273282-9605-48cd-a034-89a8551a70fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:28.152507 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1273282-9605-48cd-a034-89a8551a70fd admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:28.152798 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1273282-9605-48cd-a034-89a8551a70fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:28.155166 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1273282-9605-48cd-a034-89a8551a70fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:28.156102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1273282-9605-48cd-a034-89a8551a70fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:28.159990 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1273282-9605-48cd-a034-89a8551a70fd admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:28.189708 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 877/1740] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:28.192217 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5cf36-face-4b98-8b1f-da7784f6455d admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:28.207575 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5cf36-face-4b98-8b1f-da7784f6455d admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:28.208815 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1273282-9605-48cd-a034-89a8551a70fd admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:28.212539 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c1273282-9605-48cd-a034-89a8551a70fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:28.252045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653508f-6c77-4478-ac70-91647d4ad16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:28.257216 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653508f-6c77-4478-ac70-91647d4ad16c admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:28.257496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653508f-6c77-4478-ac70-91647d4ad16c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:28.257952 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653508f-6c77-4478-ac70-91647d4ad16c admin admin] PATH_INFO: `/v3/projects/a227982ff0e04a86b9e642072ebdf9b1/users/29ba433f4ef64f6d985756949c4776f4/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:28.285888 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1273282-9605-48cd-a034-89a8551a70fd admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:28.313573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff0551-c100-44b2-aec3-d5bae85b4299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:28.314710 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653508f-6c77-4478-ac70-91647d4ad16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a227982ff0e04a86b9e642072ebdf9b1, user_id=29ba433f4ef64f6d985756949c4776f4, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:28.321302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff0551-c100-44b2-aec3-d5bae85b4299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:28.321302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff0551-c100-44b2-aec3-d5bae85b4299 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:28.321302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff0551-c100-44b2-aec3-d5bae85b4299 admin admin] PATH_INFO: `/v3/projects/776022011073402fb4dfc211533a7e7c` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:28.321302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff0551-c100-44b2-aec3-d5bae85b4299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=776022011073402fb4dfc211533a7e7c)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:28.322346 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff0551-c100-44b2-aec3-d5bae85b4299 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:28.323928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653508f-6c77-4478-ac70-91647d4ad16c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:28.438993 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 864/1741] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:28 2022] PUT /identity/v3/projects/a227982ff0e04a86b9e642072ebdf9b1/users/29ba433f4ef64f6d985756949c4776f4/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:00:28.443510 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b7676-ddd2-4af6-a9f7-21fce2c23a06 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:28.443999 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b7676-ddd2-4af6-a9f7-21fce2c23a06 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:28.444118 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b7676-ddd2-4af6-a9f7-21fce2c23a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:28.505008 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c9ff0551-c100-44b2-aec3-d5bae85b4299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776022011073402fb4dfc211533a7e7c', 'request_id': 'req-c9ff0551-c100-44b2-aec3-d5bae85b4299'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:28.516074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c9ff0551-c100-44b2-aec3-d5bae85b4299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776022011073402fb4dfc211533a7e7c', 'request_id': 'req-c9ff0551-c100-44b2-aec3-d5bae85b4299'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:28.519481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-e74b7676-ddd2-4af6-a9f7-21fce2c23a06 None None] MFA Rules not processed for user `a5f8507c0ae342f7a3e97b48363ad606`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:28.519481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e74b7676-ddd2-4af6-a9f7-21fce2c23a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:28.611761 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c9ff0551-c100-44b2-aec3-d5bae85b4299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776022011073402fb4dfc211533a7e7c', 'request_id': 'req-c9ff0551-c100-44b2-aec3-d5bae85b4299'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:28.643423 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c9ff0551-c100-44b2-aec3-d5bae85b4299 admin admin] The token cache is being invalidate because project 776022011073402fb4dfc211533a7e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:28.650932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c9ff0551-c100-44b2-aec3-d5bae85b4299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:28.650932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c9ff0551-c100-44b2-aec3-d5bae85b4299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:28.651547 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 865/1742] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Mar 8 12:00:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:28.651547 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b7676-ddd2-4af6-a9f7-21fce2c23a06 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:28.651719 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 878/1743] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:28 2022] DELETE /identity/v3/projects/776022011073402fb4dfc211533a7e7c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:28.661311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff0551-c100-44b2-aec3-d5bae85b4299 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:28.664486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c9ff0551-c100-44b2-aec3-d5bae85b4299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:28.857891 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b7676-ddd2-4af6-a9f7-21fce2c23a06 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:28.877386 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e87fc-0d2f-49ab-a903-dd330de5835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:28.878191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e87fc-0d2f-49ab-a903-dd330de5835c admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:28.878787 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e87fc-0d2f-49ab-a903-dd330de5835c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:28.879308 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e87fc-0d2f-49ab-a903-dd330de5835c admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:28.880398 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e87fc-0d2f-49ab-a903-dd330de5835c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:28.891605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e87fc-0d2f-49ab-a903-dd330de5835c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:28.903049 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff0551-c100-44b2-aec3-d5bae85b4299 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:28.914066 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 866/1744] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:28.916100 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e87fc-0d2f-49ab-a903-dd330de5835c admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:28.921754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f08e87fc-0d2f-49ab-a903-dd330de5835c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:28.923731 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593db63-b39f-45b5-894e-11c04614dfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:28.925099 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593db63-b39f-45b5-894e-11c04614dfe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:28.925647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593db63-b39f-45b5-894e-11c04614dfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:28.926018 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593db63-b39f-45b5-894e-11c04614dfe7 admin admin] PATH_INFO: `/v3/users/875f9841ba4b43658c5c8de74e4ea3f6` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:28.930091 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593db63-b39f-45b5-894e-11c04614dfe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=875f9841ba4b43658c5c8de74e4ea3f6)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:28.934927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593db63-b39f-45b5-894e-11c04614dfe7 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:28.951227 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e87fc-0d2f-49ab-a903-dd330de5835c admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:28.967430 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f45b1-1c93-4f77-aa97-0c4d22c2fffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:28.973952 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f45b1-1c93-4f77-aa97-0c4d22c2fffd service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:28.988874 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f45b1-1c93-4f77-aa97-0c4d22c2fffd service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:28.989869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f45b1-1c93-4f77-aa97-0c4d22c2fffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:29.006397 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a66f45b1-1c93-4f77-aa97-0c4d22c2fffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:29.021576 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f45b1-1c93-4f77-aa97-0c4d22c2fffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:29.023289 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f45b1-1c93-4f77-aa97-0c4d22c2fffd service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:29.045700 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 867/1745] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:29.046722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f45b1-1c93-4f77-aa97-0c4d22c2fffd service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:29.049339 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a66f45b1-1c93-4f77-aa97-0c4d22c2fffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:29.073995 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f45b1-1c93-4f77-aa97-0c4d22c2fffd service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:29.129711 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0d0c9-9b2c-494b-8033-2521f3f6957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:29.129711 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0d0c9-9b2c-494b-8033-2521f3f6957b admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:29.129711 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0d0c9-9b2c-494b-8033-2521f3f6957b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:29.129711 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0d0c9-9b2c-494b-8033-2521f3f6957b admin admin] PATH_INFO: `/v3/projects/a227982ff0e04a86b9e642072ebdf9b1/users/29ba433f4ef64f6d985756949c4776f4/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:29.137419 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0d0c9-9b2c-494b-8033-2521f3f6957b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a227982ff0e04a86b9e642072ebdf9b1, user_id=29ba433f4ef64f6d985756949c4776f4, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:29.163831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0d0c9-9b2c-494b-8033-2521f3f6957b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:29.187899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5593db63-b39f-45b5-894e-11c04614dfe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '875f9841ba4b43658c5c8de74e4ea3f6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:29.190252 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5593db63-b39f-45b5-894e-11c04614dfe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '875f9841ba4b43658c5c8de74e4ea3f6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:29.200864 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 868/1746] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:29 2022] PUT /identity/v3/projects/a227982ff0e04a86b9e642072ebdf9b1/users/29ba433f4ef64f6d985756949c4776f4/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:29.242531 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d50115-7e49-4c6f-8a13-a001388acff5 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:29.242531 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d50115-7e49-4c6f-8a13-a001388acff5 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:29.242531 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d50115-7e49-4c6f-8a13-a001388acff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:29.243367 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5593db63-b39f-45b5-894e-11c04614dfe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '875f9841ba4b43658c5c8de74e4ea3f6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:29.317014 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-10d50115-7e49-4c6f-8a13-a001388acff5 None None] MFA Rules not processed for user `29ba433f4ef64f6d985756949c4776f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:29.318372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-10d50115-7e49-4c6f-8a13-a001388acff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:29.318925 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5593db63-b39f-45b5-894e-11c04614dfe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '875f9841ba4b43658c5c8de74e4ea3f6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:29.343340 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5593db63-b39f-45b5-894e-11c04614dfe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '875f9841ba4b43658c5c8de74e4ea3f6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:29.371664 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 879/1747] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:28 2022] DELETE /identity/v3/users/875f9841ba4b43658c5c8de74e4ea3f6 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:29.516777 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 869/1748] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:29.578128 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593db63-b39f-45b5-894e-11c04614dfe7 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:29.579618 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-5593db63-b39f-45b5-894e-11c04614dfe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:29.708034 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593db63-b39f-45b5-894e-11c04614dfe7 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:29.717632 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0be9c-a8db-45a3-8dbd-c9d0115af55f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:29.718308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0be9c-a8db-45a3-8dbd-c9d0115af55f service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:29.718589 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0be9c-a8db-45a3-8dbd-c9d0115af55f service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:29.718891 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0be9c-a8db-45a3-8dbd-c9d0115af55f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:29.941396 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0be9c-a8db-45a3-8dbd-c9d0115af55f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:29.943701 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0be9c-a8db-45a3-8dbd-c9d0115af55f service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:29.959328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 880/1749] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:30.054834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d50115-7e49-4c6f-8a13-a001388acff5 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:30.056686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-10d50115-7e49-4c6f-8a13-a001388acff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:30.322917 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d50115-7e49-4c6f-8a13-a001388acff5 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:30.490939 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47518f-3890-49a9-8e13-cd3ce92e5991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:30.493047 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47518f-3890-49a9-8e13-cd3ce92e5991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:30.493406 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47518f-3890-49a9-8e13-cd3ce92e5991 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:30.493940 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47518f-3890-49a9-8e13-cd3ce92e5991 admin admin] PATH_INFO: `/v3/users/d8cb563573d84848a9ad9db23ba891d3` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:30.500544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47518f-3890-49a9-8e13-cd3ce92e5991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8cb563573d84848a9ad9db23ba891d3)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:30.506258 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47518f-3890-49a9-8e13-cd3ce92e5991 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:30.619292 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0be9c-a8db-45a3-8dbd-c9d0115af55f service cinder] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:30.623152 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-79b0be9c-a8db-45a3-8dbd-c9d0115af55f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:30.658101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0be9c-a8db-45a3-8dbd-c9d0115af55f service cinder] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:30.671192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996898ea-5628-4272-9d55-e8da8abfa19e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:30.673648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996898ea-5628-4272-9d55-e8da8abfa19e service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:30.674420 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996898ea-5628-4272-9d55-e8da8abfa19e service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:30.675672 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996898ea-5628-4272-9d55-e8da8abfa19e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:30.681297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-996898ea-5628-4272-9d55-e8da8abfa19e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:30.809916 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3d47518f-3890-49a9-8e13-cd3ce92e5991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8cb563573d84848a9ad9db23ba891d3'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:30.810937 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3d47518f-3890-49a9-8e13-cd3ce92e5991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8cb563573d84848a9ad9db23ba891d3'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:30.835878 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996898ea-5628-4272-9d55-e8da8abfa19e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:30.837695 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996898ea-5628-4272-9d55-e8da8abfa19e service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:30.850481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 881/1750] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:00:30.948658 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3d47518f-3890-49a9-8e13-cd3ce92e5991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8cb563573d84848a9ad9db23ba891d3'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:30.977020 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3d47518f-3890-49a9-8e13-cd3ce92e5991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8cb563573d84848a9ad9db23ba891d3'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:31.009420 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3d47518f-3890-49a9-8e13-cd3ce92e5991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8cb563573d84848a9ad9db23ba891d3'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:31.038018 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 870/1751] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:30 2022] DELETE /identity/v3/users/d8cb563573d84848a9ad9db23ba891d3 => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:31.058519 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be093c1e-1d8d-4181-a0a7-1dbe1d285b94 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:31.065934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be093c1e-1d8d-4181-a0a7-1dbe1d285b94 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:31.067892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be093c1e-1d8d-4181-a0a7-1dbe1d285b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:31.238988 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-be093c1e-1d8d-4181-a0a7-1dbe1d285b94 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:31.241215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-be093c1e-1d8d-4181-a0a7-1dbe1d285b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:31.259566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1047ea-61fa-4cf9-b53f-72ad2e4eecda None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:31.259826 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1047ea-61fa-4cf9-b53f-72ad2e4eecda None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:31.261389 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1047ea-61fa-4cf9-b53f-72ad2e4eecda None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:31.263758 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 871/1752] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 12:00:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:00:31.279773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0792-9fab-4742-bf53-f514b79a18bc None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:31.280299 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0792-9fab-4742-bf53-f514b79a18bc None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:31.280776 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0792-9fab-4742-bf53-f514b79a18bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:31.338808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-c36b0792-9fab-4742-bf53-f514b79a18bc None None] MFA Rules not processed for user `534fd902f96043068e99ca0537cf57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:31.346337 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c36b0792-9fab-4742-bf53-f514b79a18bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:31.507261 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 882/1753] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:31.532934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be093c1e-1d8d-4181-a0a7-1dbe1d285b94 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:31.534483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-be093c1e-1d8d-4181-a0a7-1dbe1d285b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:31.589270 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 872/1754] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 12:00:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:00:31.653008 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0792-9fab-4742-bf53-f514b79a18bc None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:31.654795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c36b0792-9fab-4742-bf53-f514b79a18bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:31.703161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0792-9fab-4742-bf53-f514b79a18bc None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:31.742897 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f89b8e-dd20-4b88-a616-b26ab91530d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:31.742897 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f89b8e-dd20-4b88-a616-b26ab91530d3 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:31.742897 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f89b8e-dd20-4b88-a616-b26ab91530d3 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:31.743306 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f89b8e-dd20-4b88-a616-b26ab91530d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:31.795796 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be093c1e-1d8d-4181-a0a7-1dbe1d285b94 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:31.806889 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f89b8e-dd20-4b88-a616-b26ab91530d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:31.806889 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f89b8e-dd20-4b88-a616-b26ab91530d3 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:31.824110 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373cb93-71d4-4766-ba2b-a9bdc06aad0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:31.826243 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373cb93-71d4-4766-ba2b-a9bdc06aad0c service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:31.828088 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373cb93-71d4-4766-ba2b-a9bdc06aad0c service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:31.829034 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373cb93-71d4-4766-ba2b-a9bdc06aad0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:31.841231 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 873/1755] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:00:31.861886 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f89b8e-dd20-4b88-a616-b26ab91530d3 service nova] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:31.869231 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c7f89b8e-dd20-4b88-a616-b26ab91530d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:31.883609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373cb93-71d4-4766-ba2b-a9bdc06aad0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:31.896951 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373cb93-71d4-4766-ba2b-a9bdc06aad0c service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:31.912358 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f89b8e-dd20-4b88-a616-b26ab91530d3 service nova] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:31.946022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32883d15-b051-450e-bb64-5e8ea0e43ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:31.948193 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32883d15-b051-450e-bb64-5e8ea0e43ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:31.948704 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32883d15-b051-450e-bb64-5e8ea0e43ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:31.949151 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32883d15-b051-450e-bb64-5e8ea0e43ef6 admin admin] PATH_INFO: `/v3/projects/970ce2fe1444464fb8230979781d6128` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:31.951240 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32883d15-b051-450e-bb64-5e8ea0e43ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=970ce2fe1444464fb8230979781d6128)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:31.953526 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32883d15-b051-450e-bb64-5e8ea0e43ef6 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:31.970496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 883/1756] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:32.201967 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-32883d15-b051-450e-bb64-5e8ea0e43ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970ce2fe1444464fb8230979781d6128', 'request_id': 'req-32883d15-b051-450e-bb64-5e8ea0e43ef6'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:32.312166 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-32883d15-b051-450e-bb64-5e8ea0e43ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970ce2fe1444464fb8230979781d6128', 'request_id': 'req-32883d15-b051-450e-bb64-5e8ea0e43ef6'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:32.328294 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-32883d15-b051-450e-bb64-5e8ea0e43ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970ce2fe1444464fb8230979781d6128', 'request_id': 'req-32883d15-b051-450e-bb64-5e8ea0e43ef6'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:32.351505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-32883d15-b051-450e-bb64-5e8ea0e43ef6 admin admin] The token cache is being invalidate because project 970ce2fe1444464fb8230979781d6128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:32.352228 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-32883d15-b051-450e-bb64-5e8ea0e43ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:32.355937 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-32883d15-b051-450e-bb64-5e8ea0e43ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:32.359234 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 874/1757] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:31 2022] DELETE /identity/v3/projects/970ce2fe1444464fb8230979781d6128 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:32.365263 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40562a0e-091e-4902-9c84-ca884f78575c None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:32.365880 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40562a0e-091e-4902-9c84-ca884f78575c None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:32.366361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40562a0e-091e-4902-9c84-ca884f78575c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:32.415076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-40562a0e-091e-4902-9c84-ca884f78575c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:32.417156 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-40562a0e-091e-4902-9c84-ca884f78575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:32.694219 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d00961-77a2-4ec7-bca3-f7f4a7c86604 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:32.694448 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d00961-77a2-4ec7-bca3-f7f4a7c86604 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:32.694734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d00961-77a2-4ec7-bca3-f7f4a7c86604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:32.705708 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 884/1758] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:32.762190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-26d00961-77a2-4ec7-bca3-f7f4a7c86604 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:32.768795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-26d00961-77a2-4ec7-bca3-f7f4a7c86604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:32.823143 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 875/1759] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:00:32.825059 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40562a0e-091e-4902-9c84-ca884f78575c None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:32.840787 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40562a0e-091e-4902-9c84-ca884f78575c None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:32.857467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3ebb9-797b-4a32-9b96-4e39e2488c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:32.858630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3ebb9-797b-4a32-9b96-4e39e2488c40 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:32.859457 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3ebb9-797b-4a32-9b96-4e39e2488c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:32.859992 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3ebb9-797b-4a32-9b96-4e39e2488c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:32.861645 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3ebb9-797b-4a32-9b96-4e39e2488c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:32.862182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3ebb9-797b-4a32-9b96-4e39e2488c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:32.867117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3ebb9-797b-4a32-9b96-4e39e2488c40 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:32.903301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 885/1760] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:32.913301 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d00961-77a2-4ec7-bca3-f7f4a7c86604 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:32.966058 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d00961-77a2-4ec7-bca3-f7f4a7c86604 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:32.980473 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996034c-6b85-44a4-baaf-f94972b191d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:32.981107 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996034c-6b85-44a4-baaf-f94972b191d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:32.981487 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996034c-6b85-44a4-baaf-f94972b191d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:32.982092 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996034c-6b85-44a4-baaf-f94972b191d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:32.985181 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996034c-6b85-44a4-baaf-f94972b191d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:32.987162 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996034c-6b85-44a4-baaf-f94972b191d5 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:33.116482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 876/1761] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:32 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:33.122479 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3ebb9-797b-4a32-9b96-4e39e2488c40 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:33.147734 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3ebb9-797b-4a32-9b96-4e39e2488c40 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:33.297496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daf564-0a7b-4fb0-b95d-adc1a0b9d2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:33.299728 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daf564-0a7b-4fb0-b95d-adc1a0b9d2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:33.299728 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daf564-0a7b-4fb0-b95d-adc1a0b9d2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:33.299728 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daf564-0a7b-4fb0-b95d-adc1a0b9d2f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:33.300300 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daf564-0a7b-4fb0-b95d-adc1a0b9d2f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:33.302685 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daf564-0a7b-4fb0-b95d-adc1a0b9d2f9 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:33.427910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 886/1762] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:33 2022] POST /identity/v3/users => generated 290 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:33.441331 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996034c-6b85-44a4-baaf-f94972b191d5 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:33.457412 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996034c-6b85-44a4-baaf-f94972b191d5 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:33.475286 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c573a-83b0-41c6-81e4-5ba61be90e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:33.477650 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c573a-83b0-41c6-81e4-5ba61be90e48 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:33.477650 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c573a-83b0-41c6-81e4-5ba61be90e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:33.477650 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c573a-83b0-41c6-81e4-5ba61be90e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:33.477650 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c573a-83b0-41c6-81e4-5ba61be90e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:33.482645 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c573a-83b0-41c6-81e4-5ba61be90e48 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:33.512338 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daf564-0a7b-4fb0-b95d-adc1a0b9d2f9 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:33.519942 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 877/1763] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:33.531100 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daf564-0a7b-4fb0-b95d-adc1a0b9d2f9 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:33.540341 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90235c-fcb9-46e1-86e8-df3e8cc4fb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:33.543458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90235c-fcb9-46e1-86e8-df3e8cc4fb5c admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:33.544074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90235c-fcb9-46e1-86e8-df3e8cc4fb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:33.544358 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90235c-fcb9-46e1-86e8-df3e8cc4fb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:33.545298 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90235c-fcb9-46e1-86e8-df3e8cc4fb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:33.547283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90235c-fcb9-46e1-86e8-df3e8cc4fb5c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:33.569964 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 887/1764] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:33.574496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c573a-83b0-41c6-81e4-5ba61be90e48 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:33.587222 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c573a-83b0-41c6-81e4-5ba61be90e48 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:33.594041 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65316d92-e93f-4ba1-96b4-1ba53c5657c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:33.595814 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65316d92-e93f-4ba1-96b4-1ba53c5657c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:33.596323 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65316d92-e93f-4ba1-96b4-1ba53c5657c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:33.596937 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65316d92-e93f-4ba1-96b4-1ba53c5657c8 admin admin] PATH_INFO: `/v3/projects/adcbb622dcd54cbfba22760ce0fcb1cc/users/e309ff3027db44c18329883692111af4/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:33.621375 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65316d92-e93f-4ba1-96b4-1ba53c5657c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adcbb622dcd54cbfba22760ce0fcb1cc, user_id=e309ff3027db44c18329883692111af4, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:33.626931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65316d92-e93f-4ba1-96b4-1ba53c5657c8 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:33.761931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 878/1765] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:33 2022] PUT /identity/v3/projects/adcbb622dcd54cbfba22760ce0fcb1cc/users/e309ff3027db44c18329883692111af4/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:33.770084 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed6cf7-11db-45bd-b339-4fb9de85b788 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:33.770796 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed6cf7-11db-45bd-b339-4fb9de85b788 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:33.771083 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed6cf7-11db-45bd-b339-4fb9de85b788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:33.808600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-a0ed6cf7-11db-45bd-b339-4fb9de85b788 None None] MFA Rules not processed for user `e309ff3027db44c18329883692111af4`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:33.810892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a0ed6cf7-11db-45bd-b339-4fb9de85b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:33.926803 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65316d92-e93f-4ba1-96b4-1ba53c5657c8 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:33.930141 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 888/1766] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:34.050438 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65316d92-e93f-4ba1-96b4-1ba53c5657c8 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:34.057799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d84e0-33d1-45be-b1ba-30f0ab89efcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:34.058836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d84e0-33d1-45be-b1ba-30f0ab89efcc admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:34.059760 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d84e0-33d1-45be-b1ba-30f0ab89efcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:34.060254 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d84e0-33d1-45be-b1ba-30f0ab89efcc admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:34.061210 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d84e0-33d1-45be-b1ba-30f0ab89efcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:34.064073 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d84e0-33d1-45be-b1ba-30f0ab89efcc admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:34.074962 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea413b22-f435-4c4a-950e-28ef6beb916b None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:34.074962 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea413b22-f435-4c4a-950e-28ef6beb916b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:34.075275 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea413b22-f435-4c4a-950e-28ef6beb916b None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:34.078473 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 889/1767] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 12:00:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:00:34.133177 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7363cee-d4c6-4e20-b3e2-0dd82df629b5 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:34.133886 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7363cee-d4c6-4e20-b3e2-0dd82df629b5 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:34.133886 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7363cee-d4c6-4e20-b3e2-0dd82df629b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:34.164267 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 879/1768] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:33 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:34.165169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d84e0-33d1-45be-b1ba-30f0ab89efcc admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:34.175644 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-f7363cee-d4c6-4e20-b3e2-0dd82df629b5 None None] MFA Rules not processed for user `534fd902f96043068e99ca0537cf57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:34.178256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f7363cee-d4c6-4e20-b3e2-0dd82df629b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:34.350655 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d84e0-33d1-45be-b1ba-30f0ab89efcc admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:34.370007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628df9d2-43ce-47ef-a86c-c76c317cff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:34.372005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628df9d2-43ce-47ef-a86c-c76c317cff8b admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:34.372879 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628df9d2-43ce-47ef-a86c-c76c317cff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:34.373655 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628df9d2-43ce-47ef-a86c-c76c317cff8b admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:34.374596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628df9d2-43ce-47ef-a86c-c76c317cff8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:34.377376 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628df9d2-43ce-47ef-a86c-c76c317cff8b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:34.460040 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 890/1769] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 12:00:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:00:34.461069 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7363cee-d4c6-4e20-b3e2-0dd82df629b5 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:34.462577 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f7363cee-d4c6-4e20-b3e2-0dd82df629b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:34.481870 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 880/1770] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:34 2022] POST /identity/v3/users => generated 296 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:34.486542 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628df9d2-43ce-47ef-a86c-c76c317cff8b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:34.493511 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7363cee-d4c6-4e20-b3e2-0dd82df629b5 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:34.505389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b246651-2a22-48bd-a689-a474e768084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:34.506266 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b246651-2a22-48bd-a689-a474e768084c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:34.506713 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b246651-2a22-48bd-a689-a474e768084c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:34.506997 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b246651-2a22-48bd-a689-a474e768084c admin admin] PATH_INFO: `/v3/projects/e692a28da1fa401392ff4beb46a1b3b3` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:34.508936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b246651-2a22-48bd-a689-a474e768084c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e692a28da1fa401392ff4beb46a1b3b3)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:34.512251 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b246651-2a22-48bd-a689-a474e768084c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:34.514968 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628df9d2-43ce-47ef-a86c-c76c317cff8b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:34.531345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df6e1d-fd4b-4dcb-b48e-e2e93be44597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:34.532631 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df6e1d-fd4b-4dcb-b48e-e2e93be44597 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:34.536686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df6e1d-fd4b-4dcb-b48e-e2e93be44597 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:34.536686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df6e1d-fd4b-4dcb-b48e-e2e93be44597 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:34.550160 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df6e1d-fd4b-4dcb-b48e-e2e93be44597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:34.552109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df6e1d-fd4b-4dcb-b48e-e2e93be44597 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:34.579749 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 881/1771] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:34.580903 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df6e1d-fd4b-4dcb-b48e-e2e93be44597 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:34.585267 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-10df6e1d-fd4b-4dcb-b48e-e2e93be44597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:34.618609 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df6e1d-fd4b-4dcb-b48e-e2e93be44597 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:34.628467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fb9d8-b699-48ea-9842-53d363cc19f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:34.629634 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fb9d8-b699-48ea-9842-53d363cc19f6 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:34.630065 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fb9d8-b699-48ea-9842-53d363cc19f6 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:34.630558 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fb9d8-b699-48ea-9842-53d363cc19f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:34.645051 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fb9d8-b699-48ea-9842-53d363cc19f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:34.647386 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fb9d8-b699-48ea-9842-53d363cc19f6 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:34.664328 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 882/1772] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:34.665193 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fb9d8-b699-48ea-9842-53d363cc19f6 service nova] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:34.680241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fb9d8-b699-48ea-9842-53d363cc19f6 service nova] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:34.702135 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-1b246651-2a22-48bd-a689-a474e768084c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e692a28da1fa401392ff4beb46a1b3b3', 'request_id': 'req-1b246651-2a22-48bd-a689-a474e768084c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:34.719750 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-1b246651-2a22-48bd-a689-a474e768084c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e692a28da1fa401392ff4beb46a1b3b3', 'request_id': 'req-1b246651-2a22-48bd-a689-a474e768084c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:34.819818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-1b246651-2a22-48bd-a689-a474e768084c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e692a28da1fa401392ff4beb46a1b3b3', 'request_id': 'req-1b246651-2a22-48bd-a689-a474e768084c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:34.862431 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-1b246651-2a22-48bd-a689-a474e768084c admin admin] The token cache is being invalidate because project e692a28da1fa401392ff4beb46a1b3b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:34.863097 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-1b246651-2a22-48bd-a689-a474e768084c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:34.864137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-1b246651-2a22-48bd-a689-a474e768084c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:34.868173 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 891/1773] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:34 2022] DELETE /identity/v3/projects/e692a28da1fa401392ff4beb46a1b3b3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:34.873897 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b246651-2a22-48bd-a689-a474e768084c admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:34.878122 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-1b246651-2a22-48bd-a689-a474e768084c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:34.932501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29c87c-665e-45fb-b97b-e02f7c58a51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:34.933826 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c87c-665e-45fb-b97b-e02f7c58a51f admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:34.934704 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c87c-665e-45fb-b97b-e02f7c58a51f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:34.935052 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c87c-665e-45fb-b97b-e02f7c58a51f admin admin] PATH_INFO: `/v3/projects/2c8bcaeb6c614bc28f10c38a7bb7dbfc/users/e4e9a4e6ab2a44e884a894eade59fa31/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:34.994955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29c87c-665e-45fb-b97b-e02f7c58a51f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8bcaeb6c614bc28f10c38a7bb7dbfc, user_id=e4e9a4e6ab2a44e884a894eade59fa31, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:35.005500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29c87c-665e-45fb-b97b-e02f7c58a51f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:35.037737 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b246651-2a22-48bd-a689-a474e768084c admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:35.053353 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6363b-5654-4441-add5-3726d5de4038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:35.057496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6363b-5654-4441-add5-3726d5de4038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:35.058285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6363b-5654-4441-add5-3726d5de4038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:35.058884 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6363b-5654-4441-add5-3726d5de4038 admin admin] PATH_INFO: `/v3/users/321bf70884bb4c05b13ddffdb9a19487` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:35.062146 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6363b-5654-4441-add5-3726d5de4038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=321bf70884bb4c05b13ddffdb9a19487)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:35.070670 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6363b-5654-4441-add5-3726d5de4038 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:35.117593 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 883/1774] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:34 2022] PUT /identity/v3/projects/2c8bcaeb6c614bc28f10c38a7bb7dbfc/users/e4e9a4e6ab2a44e884a894eade59fa31/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:35.138791 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29c87c-665e-45fb-b97b-e02f7c58a51f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:35.149197 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-4d29c87c-665e-45fb-b97b-e02f7c58a51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:35.342737 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29c87c-665e-45fb-b97b-e02f7c58a51f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:35.359351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275e49b-948e-44eb-b71d-41c7d08d132d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:35.363677 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275e49b-948e-44eb-b71d-41c7d08d132d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:35.364936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275e49b-948e-44eb-b71d-41c7d08d132d admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:35.365687 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275e49b-948e-44eb-b71d-41c7d08d132d admin admin] PATH_INFO: `/v3/users/8ae4871d81744f2dbb9c49b591cc1512` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:35.370186 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275e49b-948e-44eb-b71d-41c7d08d132d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae4871d81744f2dbb9c49b591cc1512)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:35.380680 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275e49b-948e-44eb-b71d-41c7d08d132d admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:35.462232 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-70f6363b-5654-4441-add5-3726d5de4038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321bf70884bb4c05b13ddffdb9a19487'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:35.466426 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-70f6363b-5654-4441-add5-3726d5de4038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321bf70884bb4c05b13ddffdb9a19487'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:35.539438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-70f6363b-5654-4441-add5-3726d5de4038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321bf70884bb4c05b13ddffdb9a19487'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:35.615493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-70f6363b-5654-4441-add5-3726d5de4038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321bf70884bb4c05b13ddffdb9a19487'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:35.638918 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-70f6363b-5654-4441-add5-3726d5de4038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321bf70884bb4c05b13ddffdb9a19487'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:35.650318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9275e49b-948e-44eb-b71d-41c7d08d132d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae4871d81744f2dbb9c49b591cc1512'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:35.651496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 892/1775] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:34 2022] DELETE /identity/v3/users/321bf70884bb4c05b13ddffdb9a19487 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:35.652149 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9275e49b-948e-44eb-b71d-41c7d08d132d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae4871d81744f2dbb9c49b591cc1512'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:35.652390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6363b-5654-4441-add5-3726d5de4038 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:35.656839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-70f6363b-5654-4441-add5-3726d5de4038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:35.735791 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9275e49b-948e-44eb-b71d-41c7d08d132d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae4871d81744f2dbb9c49b591cc1512'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:35.757626 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9275e49b-948e-44eb-b71d-41c7d08d132d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae4871d81744f2dbb9c49b591cc1512'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:35.772008 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9275e49b-948e-44eb-b71d-41c7d08d132d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae4871d81744f2dbb9c49b591cc1512'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:35.784758 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 884/1776] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:35 2022] DELETE /identity/v3/users/8ae4871d81744f2dbb9c49b591cc1512 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:35.791912 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b3649-97ca-4c73-94b4-d525f3cee04f None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:35.801310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b3649-97ca-4c73-94b4-d525f3cee04f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:35.808701 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b3649-97ca-4c73-94b4-d525f3cee04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:35.861288 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-f31b3649-97ca-4c73-94b4-d525f3cee04f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:35.862567 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f31b3649-97ca-4c73-94b4-d525f3cee04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:35.872147 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6363b-5654-4441-add5-3726d5de4038 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:36.080369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef8429-3818-45d1-a704-fddceea6aa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:36.082656 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef8429-3818-45d1-a704-fddceea6aa50 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:36.084341 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef8429-3818-45d1-a704-fddceea6aa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:36.084806 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef8429-3818-45d1-a704-fddceea6aa50 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:36.086571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 885/1777] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:36.090664 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef8429-3818-45d1-a704-fddceea6aa50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:36.093720 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef8429-3818-45d1-a704-fddceea6aa50 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:36.119208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 893/1778] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:36.122092 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b3649-97ca-4c73-94b4-d525f3cee04f None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:36.123817 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f31b3649-97ca-4c73-94b4-d525f3cee04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:36.130419 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef8429-3818-45d1-a704-fddceea6aa50 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:36.133818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-97ef8429-3818-45d1-a704-fddceea6aa50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:36.173011 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef8429-3818-45d1-a704-fddceea6aa50 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:36.193191 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35fc70-c8a8-404c-ab77-ecd424d4a45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:36.196894 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35fc70-c8a8-404c-ab77-ecd424d4a45f admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:36.199256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35fc70-c8a8-404c-ab77-ecd424d4a45f admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:36.200063 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35fc70-c8a8-404c-ab77-ecd424d4a45f admin admin] PATH_INFO: `/v3/projects/2c8bcaeb6c614bc28f10c38a7bb7dbfc/users/e4e9a4e6ab2a44e884a894eade59fa31/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:36.206012 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35fc70-c8a8-404c-ab77-ecd424d4a45f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8bcaeb6c614bc28f10c38a7bb7dbfc, user_id=e4e9a4e6ab2a44e884a894eade59fa31, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:36.231265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35fc70-c8a8-404c-ab77-ecd424d4a45f admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:36.272470 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 894/1779] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:36 2022] PUT /identity/v3/projects/2c8bcaeb6c614bc28f10c38a7bb7dbfc/users/e4e9a4e6ab2a44e884a894eade59fa31/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:36.285439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cf3ce-a8ae-4fea-9418-a3150dcb0c85 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:36.286589 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cf3ce-a8ae-4fea-9418-a3150dcb0c85 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:36.287832 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cf3ce-a8ae-4fea-9418-a3150dcb0c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:36.388836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b3649-97ca-4c73-94b4-d525f3cee04f None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:36.424308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-7f6cf3ce-a8ae-4fea-9418-a3150dcb0c85 None None] MFA Rules not processed for user `e4e9a4e6ab2a44e884a894eade59fa31`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:36.433029 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-7f6cf3ce-a8ae-4fea-9418-a3150dcb0c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:36.504047 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351389fb-363e-4934-95af-cba5b468036e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:36.506050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351389fb-363e-4934-95af-cba5b468036e service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:36.506770 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351389fb-363e-4934-95af-cba5b468036e service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:36.507259 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351389fb-363e-4934-95af-cba5b468036e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:36.622072 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351389fb-363e-4934-95af-cba5b468036e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:36.623025 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351389fb-363e-4934-95af-cba5b468036e service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:36.626989 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 895/1780] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:36.643157 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 886/1781] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:36.648427 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cf3ce-a8ae-4fea-9418-a3150dcb0c85 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:36.650897 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-7f6cf3ce-a8ae-4fea-9418-a3150dcb0c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:36.828790 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cf3ce-a8ae-4fea-9418-a3150dcb0c85 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:36.833655 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f38f8-6500-4d55-9058-b2eb841340fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:36.835033 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f38f8-6500-4d55-9058-b2eb841340fb service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:36.835608 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f38f8-6500-4d55-9058-b2eb841340fb service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:36.836150 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f38f8-6500-4d55-9058-b2eb841340fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:36.867234 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f38f8-6500-4d55-9058-b2eb841340fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:36.869597 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f38f8-6500-4d55-9058-b2eb841340fb service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:36.900959 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 896/1782] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:39.130690 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351389fb-363e-4934-95af-cba5b468036e service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:39.136792 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-351389fb-363e-4934-95af-cba5b468036e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:39.143410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f38f8-6500-4d55-9058-b2eb841340fb service cinder] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:39.163600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-1a0f38f8-6500-4d55-9058-b2eb841340fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:39.186131 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f38f8-6500-4d55-9058-b2eb841340fb service cinder] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:39.204886 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351389fb-363e-4934-95af-cba5b468036e service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:39.205270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c7465-f2ee-42b6-8fb9-67902aabdab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:39.205270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c7465-f2ee-42b6-8fb9-67902aabdab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:39.205270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c7465-f2ee-42b6-8fb9-67902aabdab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:39.208804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c7465-f2ee-42b6-8fb9-67902aabdab0 admin admin] PATH_INFO: `/v3/projects/b7d54076626642c1b1480c6ade7f8d5f` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:39.214510 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c7465-f2ee-42b6-8fb9-67902aabdab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d54076626642c1b1480c6ade7f8d5f)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:39.217199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c7465-f2ee-42b6-8fb9-67902aabdab0 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:39.220387 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98785cc8-1b2b-407e-a7ea-601f251166b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:39.221268 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98785cc8-1b2b-407e-a7ea-601f251166b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:39.221549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98785cc8-1b2b-407e-a7ea-601f251166b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:39.221877 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98785cc8-1b2b-407e-a7ea-601f251166b9 admin admin] PATH_INFO: `/v3/projects/c7048970ac5043aab661be4579f959d8` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:39.223142 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98785cc8-1b2b-407e-a7ea-601f251166b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7048970ac5043aab661be4579f959d8)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:39.225229 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98785cc8-1b2b-407e-a7ea-601f251166b9 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:39.503453 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-444c7465-f2ee-42b6-8fb9-67902aabdab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d54076626642c1b1480c6ade7f8d5f', 'request_id': 'req-444c7465-f2ee-42b6-8fb9-67902aabdab0'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:39.503618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-98785cc8-1b2b-407e-a7ea-601f251166b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7048970ac5043aab661be4579f959d8', 'request_id': 'req-98785cc8-1b2b-407e-a7ea-601f251166b9'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:39.511093 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-444c7465-f2ee-42b6-8fb9-67902aabdab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d54076626642c1b1480c6ade7f8d5f', 'request_id': 'req-444c7465-f2ee-42b6-8fb9-67902aabdab0'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:39.637817 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-98785cc8-1b2b-407e-a7ea-601f251166b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7048970ac5043aab661be4579f959d8', 'request_id': 'req-98785cc8-1b2b-407e-a7ea-601f251166b9'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:39.649159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-98785cc8-1b2b-407e-a7ea-601f251166b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7048970ac5043aab661be4579f959d8', 'request_id': 'req-98785cc8-1b2b-407e-a7ea-601f251166b9'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:39.689396 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-98785cc8-1b2b-407e-a7ea-601f251166b9 admin admin] The token cache is being invalidate because project c7048970ac5043aab661be4579f959d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:39.689734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-98785cc8-1b2b-407e-a7ea-601f251166b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:39.693221 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-98785cc8-1b2b-407e-a7ea-601f251166b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:39.703465 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 887/1783] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:39 2022] DELETE /identity/v3/projects/c7048970ac5043aab661be4579f959d8 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:39.715567 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15136e52-7748-4aa9-a928-4198464c9e35 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:39.716067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15136e52-7748-4aa9-a928-4198464c9e35 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:39.716363 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15136e52-7748-4aa9-a928-4198464c9e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:39.729651 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-444c7465-f2ee-42b6-8fb9-67902aabdab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d54076626642c1b1480c6ade7f8d5f', 'request_id': 'req-444c7465-f2ee-42b6-8fb9-67902aabdab0'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:39.750830 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-444c7465-f2ee-42b6-8fb9-67902aabdab0 admin admin] The token cache is being invalidate because project b7d54076626642c1b1480c6ade7f8d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:39.751132 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-444c7465-f2ee-42b6-8fb9-67902aabdab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:39.752403 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-444c7465-f2ee-42b6-8fb9-67902aabdab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:39.756453 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 897/1784] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:39 2022] DELETE /identity/v3/projects/b7d54076626642c1b1480c6ade7f8d5f => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:39.762267 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c7465-f2ee-42b6-8fb9-67902aabdab0 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:39.765918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-15136e52-7748-4aa9-a928-4198464c9e35 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:39.767106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-15136e52-7748-4aa9-a928-4198464c9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:39.767421 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-444c7465-f2ee-42b6-8fb9-67902aabdab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:39.899113 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c7465-f2ee-42b6-8fb9-67902aabdab0 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:39.915257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 888/1785] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:39.917300 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15136e52-7748-4aa9-a928-4198464c9e35 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:39.921294 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-15136e52-7748-4aa9-a928-4198464c9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:39.930266 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a04eb-88f9-479a-95d7-6e1477518e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:39.931184 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a04eb-88f9-479a-95d7-6e1477518e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:39.937980 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a04eb-88f9-479a-95d7-6e1477518e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:39.939677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a04eb-88f9-479a-95d7-6e1477518e08 admin admin] PATH_INFO: `/v3/users/29ba433f4ef64f6d985756949c4776f4` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:39.943347 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a04eb-88f9-479a-95d7-6e1477518e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ba433f4ef64f6d985756949c4776f4)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:39.963569 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a04eb-88f9-479a-95d7-6e1477518e08 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:40.069199 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15136e52-7748-4aa9-a928-4198464c9e35 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:40.077208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96234e4-e843-417d-bde4-d32f95e9b0fb tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e9a4e6ab2a44e884a894eade59fa31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8bcaeb6c614bc28f10c38a7bb7dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:40.078963 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96234e4-e843-417d-bde4-d32f95e9b0fb tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:40.080136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96234e4-e843-417d-bde4-d32f95e9b0fb tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:40.081329 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96234e4-e843-417d-bde4-d32f95e9b0fb tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:40.083421 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96234e4-e843-417d-bde4-d32f95e9b0fb tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:40.084525 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96234e4-e843-417d-bde4-d32f95e9b0fb tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:40.090675 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96234e4-e843-417d-bde4-d32f95e9b0fb tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:40.106551 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 889/1786] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:40.108698 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d82d9-66b1-45e1-bef9-43f6c4e8f54e None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:40.109175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d82d9-66b1-45e1-bef9-43f6c4e8f54e None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:40.109735 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d82d9-66b1-45e1-bef9-43f6c4e8f54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:40.141535 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-089d82d9-66b1-45e1-bef9-43f6c4e8f54e None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:40.143875 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-089d82d9-66b1-45e1-bef9-43f6c4e8f54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:40.156434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 890/1787] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:40.157922 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d82d9-66b1-45e1-bef9-43f6c4e8f54e None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:40.171756 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d82d9-66b1-45e1-bef9-43f6c4e8f54e None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:40.182993 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ec156-c20d-45dd-9830-3d3d35f6cb26 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e9a4e6ab2a44e884a894eade59fa31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8bcaeb6c614bc28f10c38a7bb7dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:40.183723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ec156-c20d-45dd-9830-3d3d35f6cb26 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:40.184039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ec156-c20d-45dd-9830-3d3d35f6cb26 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:40.184295 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ec156-c20d-45dd-9830-3d3d35f6cb26 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:40.185014 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ec156-c20d-45dd-9830-3d3d35f6cb26 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:40.190803 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ec156-c20d-45dd-9830-3d3d35f6cb26 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:40.267182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-816a04eb-88f9-479a-95d7-6e1477518e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ba433f4ef64f6d985756949c4776f4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:40.268299 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-816a04eb-88f9-479a-95d7-6e1477518e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ba433f4ef64f6d985756949c4776f4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:40.284163 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-816a04eb-88f9-479a-95d7-6e1477518e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ba433f4ef64f6d985756949c4776f4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:40.348141 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 891/1788] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:40 2022] POST /identity/v3/projects => generated 353 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:40.349917 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ec156-c20d-45dd-9830-3d3d35f6cb26 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:40.356178 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-fd5ec156-c20d-45dd-9830-3d3d35f6cb26 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:40.367981 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-816a04eb-88f9-479a-95d7-6e1477518e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ba433f4ef64f6d985756949c4776f4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:40.423418 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-816a04eb-88f9-479a-95d7-6e1477518e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ba433f4ef64f6d985756949c4776f4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:40.432637 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 898/1789] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:39 2022] DELETE /identity/v3/users/29ba433f4ef64f6d985756949c4776f4 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:40.433736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a04eb-88f9-479a-95d7-6e1477518e08 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:40.435770 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-816a04eb-88f9-479a-95d7-6e1477518e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:40.515297 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ec156-c20d-45dd-9830-3d3d35f6cb26 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:40.553776 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a04eb-88f9-479a-95d7-6e1477518e08 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:40.566344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d2284-e8ea-4c51-9f9e-5d623ebf54a6 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e9a4e6ab2a44e884a894eade59fa31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8bcaeb6c614bc28f10c38a7bb7dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:40.567614 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d2284-e8ea-4c51-9f9e-5d623ebf54a6 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:40.575512 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d2284-e8ea-4c51-9f9e-5d623ebf54a6 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:40.575512 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d2284-e8ea-4c51-9f9e-5d623ebf54a6 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:40.575512 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d2284-e8ea-4c51-9f9e-5d623ebf54a6 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:40.575512 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d2284-e8ea-4c51-9f9e-5d623ebf54a6 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:40.575512 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d2284-e8ea-4c51-9f9e-5d623ebf54a6 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:40.593524 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 899/1790] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:40.655263 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437bb1b-45ee-48c6-b66d-cd9c1d19002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:40.655263 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437bb1b-45ee-48c6-b66d-cd9c1d19002a admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:40.655263 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437bb1b-45ee-48c6-b66d-cd9c1d19002a admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:40.655263 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437bb1b-45ee-48c6-b66d-cd9c1d19002a admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:40.655769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437bb1b-45ee-48c6-b66d-cd9c1d19002a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:40.656395 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437bb1b-45ee-48c6-b66d-cd9c1d19002a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:40.658369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d2284-e8ea-4c51-9f9e-5d623ebf54a6 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:40.678730 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437bb1b-45ee-48c6-b66d-cd9c1d19002a admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:40.716586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d2284-e8ea-4c51-9f9e-5d623ebf54a6 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:40.738799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cbf58-9989-4519-b54d-8aa9f801cc00 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e9a4e6ab2a44e884a894eade59fa31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8bcaeb6c614bc28f10c38a7bb7dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:40.743238 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cbf58-9989-4519-b54d-8aa9f801cc00 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:40.746554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cbf58-9989-4519-b54d-8aa9f801cc00 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:40.746732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cbf58-9989-4519-b54d-8aa9f801cc00 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] PATH_INFO: `/v3/projects/f45b80a3af304c3d9de8a44111aa914a` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:40.756457 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cbf58-9989-4519-b54d-8aa9f801cc00 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f45b80a3af304c3d9de8a44111aa914a)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:40.761165 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cbf58-9989-4519-b54d-8aa9f801cc00 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:40.769521 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 892/1791] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:40.772300 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437bb1b-45ee-48c6-b66d-cd9c1d19002a admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:40.807184 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437bb1b-45ee-48c6-b66d-cd9c1d19002a admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:40.829398 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f210c-736e-4ffd-a064-cd536d3a6d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:40.830078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f210c-736e-4ffd-a064-cd536d3a6d79 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:40.830372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f210c-736e-4ffd-a064-cd536d3a6d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:40.830657 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f210c-736e-4ffd-a064-cd536d3a6d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:40.831371 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f210c-736e-4ffd-a064-cd536d3a6d79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:40.835977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f210c-736e-4ffd-a064-cd536d3a6d79 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:41.011169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-779cbf58-9989-4519-b54d-8aa9f801cc00 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45b80a3af304c3d9de8a44111aa914a', 'request_id': 'req-779cbf58-9989-4519-b54d-8aa9f801cc00'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:41.024495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 893/1792] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:40 2022] POST /identity/v3/projects => generated 365 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:41.029024 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f210c-736e-4ffd-a064-cd536d3a6d79 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:41.031092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-779cbf58-9989-4519-b54d-8aa9f801cc00 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45b80a3af304c3d9de8a44111aa914a', 'request_id': 'req-779cbf58-9989-4519-b54d-8aa9f801cc00'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:41.122541 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-779cbf58-9989-4519-b54d-8aa9f801cc00 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45b80a3af304c3d9de8a44111aa914a', 'request_id': 'req-779cbf58-9989-4519-b54d-8aa9f801cc00'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:41.145365 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f210c-736e-4ffd-a064-cd536d3a6d79 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:41.151040 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dcf5d-224f-4c60-9759-b2eaeea443b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:41.151972 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dcf5d-224f-4c60-9759-b2eaeea443b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:41.152381 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-779cbf58-9989-4519-b54d-8aa9f801cc00 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] The token cache is being invalidate because project f45b80a3af304c3d9de8a44111aa914a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:41.152780 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-779cbf58-9989-4519-b54d-8aa9f801cc00 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:41.152982 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dcf5d-224f-4c60-9759-b2eaeea443b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:41.153603 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dcf5d-224f-4c60-9759-b2eaeea443b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:41.155035 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286dcf5d-224f-4c60-9759-b2eaeea443b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:41.156024 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-779cbf58-9989-4519-b54d-8aa9f801cc00 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:41.157696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286dcf5d-224f-4c60-9759-b2eaeea443b1 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:41.158542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 900/1793] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:40 2022] DELETE /identity/v3/projects/f45b80a3af304c3d9de8a44111aa914a => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:00:41.330357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 894/1794] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:41 2022] POST /identity/v3/users => generated 283 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:00:41.335672 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cbf58-9989-4519-b54d-8aa9f801cc00 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:41.337654 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-779cbf58-9989-4519-b54d-8aa9f801cc00 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:41.439274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cbf58-9989-4519-b54d-8aa9f801cc00 tempest-VolumeQuotaClassesTest-499743389 tempest-VolumeQuotaClassesTest-499743389-project-admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:41.447564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dcf5d-224f-4c60-9759-b2eaeea443b1 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:41.447840 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79084ad-a0e1-411b-995a-e1f2ef8c6830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:41.448921 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79084ad-a0e1-411b-995a-e1f2ef8c6830 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:41.449390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79084ad-a0e1-411b-995a-e1f2ef8c6830 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:41.449834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79084ad-a0e1-411b-995a-e1f2ef8c6830 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:41.452155 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79084ad-a0e1-411b-995a-e1f2ef8c6830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:41.452891 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-286dcf5d-224f-4c60-9759-b2eaeea443b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:41.453862 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79084ad-a0e1-411b-995a-e1f2ef8c6830 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:41.472993 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 901/1795] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:41.477443 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79084ad-a0e1-411b-995a-e1f2ef8c6830 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:41.502432 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dcf5d-224f-4c60-9759-b2eaeea443b1 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:41.507366 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79084ad-a0e1-411b-995a-e1f2ef8c6830 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:41.525821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690c413-bc5b-4f6b-b39b-30ec2592a5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:41.525821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690c413-bc5b-4f6b-b39b-30ec2592a5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:41.525821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690c413-bc5b-4f6b-b39b-30ec2592a5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:41.525821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690c413-bc5b-4f6b-b39b-30ec2592a5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:41.526381 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690c413-bc5b-4f6b-b39b-30ec2592a5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:41.527155 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690c413-bc5b-4f6b-b39b-30ec2592a5d2 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:41.528815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bea7d-e563-4ec5-8891-f4400e901e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:41.530354 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bea7d-e563-4ec5-8891-f4400e901e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:41.530859 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bea7d-e563-4ec5-8891-f4400e901e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:41.531437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bea7d-e563-4ec5-8891-f4400e901e56 admin admin] PATH_INFO: `/v3/projects/a227982ff0e04a86b9e642072ebdf9b1` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:41.536255 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bea7d-e563-4ec5-8891-f4400e901e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a227982ff0e04a86b9e642072ebdf9b1)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:41.541274 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bea7d-e563-4ec5-8891-f4400e901e56 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:41.551929 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 902/1796] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:41.559355 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690c413-bc5b-4f6b-b39b-30ec2592a5d2 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:41.581337 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690c413-bc5b-4f6b-b39b-30ec2592a5d2 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:41.588358 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d524ed1-cec5-434b-ac14-888e78420232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:41.588754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d524ed1-cec5-434b-ac14-888e78420232 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:41.589141 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d524ed1-cec5-434b-ac14-888e78420232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:41.589486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d524ed1-cec5-434b-ac14-888e78420232 admin admin] PATH_INFO: `/v3/projects/19bd35e2fcc24b2983b30d85b718cf46/users/45770b9d477447a2995e832052e9fa23/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:41.607796 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d524ed1-cec5-434b-ac14-888e78420232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19bd35e2fcc24b2983b30d85b718cf46, user_id=45770b9d477447a2995e832052e9fa23, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:41.611229 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d524ed1-cec5-434b-ac14-888e78420232 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:41.719151 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 903/1797] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:41 2022] PUT /identity/v3/projects/19bd35e2fcc24b2983b30d85b718cf46/users/45770b9d477447a2995e832052e9fa23/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:00:41.721686 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc591a-35f7-4e3d-94de-9c57b0f7ffa3 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:41.722277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc591a-35f7-4e3d-94de-9c57b0f7ffa3 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:41.722670 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc591a-35f7-4e3d-94de-9c57b0f7ffa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:41.734749 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e66bea7d-e563-4ec5-8891-f4400e901e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a227982ff0e04a86b9e642072ebdf9b1', 'request_id': 'req-e66bea7d-e563-4ec5-8891-f4400e901e56'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:41.768513 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-89dc591a-35f7-4e3d-94de-9c57b0f7ffa3 None None] MFA Rules not processed for user `45770b9d477447a2995e832052e9fa23`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:41.769806 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-89dc591a-35f7-4e3d-94de-9c57b0f7ffa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:41.809884 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e66bea7d-e563-4ec5-8891-f4400e901e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a227982ff0e04a86b9e642072ebdf9b1', 'request_id': 'req-e66bea7d-e563-4ec5-8891-f4400e901e56'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:41.817958 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e66bea7d-e563-4ec5-8891-f4400e901e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a227982ff0e04a86b9e642072ebdf9b1', 'request_id': 'req-e66bea7d-e563-4ec5-8891-f4400e901e56'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:41.830174 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e66bea7d-e563-4ec5-8891-f4400e901e56 admin admin] The token cache is being invalidate because project a227982ff0e04a86b9e642072ebdf9b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:41.830454 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e66bea7d-e563-4ec5-8891-f4400e901e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:41.831153 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e66bea7d-e563-4ec5-8891-f4400e901e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:41.832801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 895/1798] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:41 2022] DELETE /identity/v3/projects/a227982ff0e04a86b9e642072ebdf9b1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:00:41.840687 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833070ec-2d00-4e08-bf7f-8d02a27a678f None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:41.841093 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833070ec-2d00-4e08-bf7f-8d02a27a678f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:41.841736 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833070ec-2d00-4e08-bf7f-8d02a27a678f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:41.866988 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-833070ec-2d00-4e08-bf7f-8d02a27a678f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:41.869523 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-833070ec-2d00-4e08-bf7f-8d02a27a678f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:41.869668 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 904/1799] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:41.872104 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc591a-35f7-4e3d-94de-9c57b0f7ffa3 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:41.874481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-89dc591a-35f7-4e3d-94de-9c57b0f7ffa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:41.995317 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 896/1800] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:00:42.007329 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807aa38-3854-47f7-bb67-388505f3cc99 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:42.007649 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807aa38-3854-47f7-bb67-388505f3cc99 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:42.007927 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807aa38-3854-47f7-bb67-388505f3cc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:42.038639 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-2807aa38-3854-47f7-bb67-388505f3cc99 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:42.041781 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-2807aa38-3854-47f7-bb67-388505f3cc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:42.060083 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 897/1801] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:00:42.066512 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807aa38-3854-47f7-bb67-388505f3cc99 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:42.070638 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc591a-35f7-4e3d-94de-9c57b0f7ffa3 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:42.080371 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecd35c-e4e1-4061-92d0-3ddddb94a25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:42.081555 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecd35c-e4e1-4061-92d0-3ddddb94a25d admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:42.082327 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecd35c-e4e1-4061-92d0-3ddddb94a25d admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:42.082830 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecd35c-e4e1-4061-92d0-3ddddb94a25d admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:42.084516 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecd35c-e4e1-4061-92d0-3ddddb94a25d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:42.084709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807aa38-3854-47f7-bb67-388505f3cc99 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:42.091755 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecd35c-e4e1-4061-92d0-3ddddb94a25d admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:42.100304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60774b-4eb1-4cc9-ad29-7e1e2c0c143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:42.100304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60774b-4eb1-4cc9-ad29-7e1e2c0c143a admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:42.100304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60774b-4eb1-4cc9-ad29-7e1e2c0c143a admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:42.100304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60774b-4eb1-4cc9-ad29-7e1e2c0c143a admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:42.100934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60774b-4eb1-4cc9-ad29-7e1e2c0c143a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:42.100934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60774b-4eb1-4cc9-ad29-7e1e2c0c143a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:42.100934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60774b-4eb1-4cc9-ad29-7e1e2c0c143a admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:42.125104 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 898/1802] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:42.130844 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60774b-4eb1-4cc9-ad29-7e1e2c0c143a admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:42.148362 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60774b-4eb1-4cc9-ad29-7e1e2c0c143a admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:42.169435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073a322-9069-4e13-a0a7-3c694b0295f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:42.169435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073a322-9069-4e13-a0a7-3c694b0295f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:42.169435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073a322-9069-4e13-a0a7-3c694b0295f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:42.169435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073a322-9069-4e13-a0a7-3c694b0295f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:42.170001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073a322-9069-4e13-a0a7-3c694b0295f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:42.177466 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073a322-9069-4e13-a0a7-3c694b0295f3 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:42.293261 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 905/1803] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:41 2022] POST /identity/v3/projects => generated 363 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:42.293261 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecd35c-e4e1-4061-92d0-3ddddb94a25d admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:42.293979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-0fecd35c-e4e1-4061-92d0-3ddddb94a25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:42.333053 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 899/1804] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:42 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:42.343492 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073a322-9069-4e13-a0a7-3c694b0295f3 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:42.391675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecd35c-e4e1-4061-92d0-3ddddb94a25d admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:42.448099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073a322-9069-4e13-a0a7-3c694b0295f3 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:42.463616 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e60ac0-6778-4142-9bce-399d80f1e517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:42.464312 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e60ac0-6778-4142-9bce-399d80f1e517 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:42.464596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e60ac0-6778-4142-9bce-399d80f1e517 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:42.464871 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e60ac0-6778-4142-9bce-399d80f1e517 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:42.465565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e60ac0-6778-4142-9bce-399d80f1e517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:42.467749 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e60ac0-6778-4142-9bce-399d80f1e517 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:42.467867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dcb70-541e-40e5-a237-712ca1d325eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:42.468722 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dcb70-541e-40e5-a237-712ca1d325eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:42.468995 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dcb70-541e-40e5-a237-712ca1d325eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:42.469278 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dcb70-541e-40e5-a237-712ca1d325eb admin admin] PATH_INFO: `/v3/users/e309ff3027db44c18329883692111af4` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:42.470553 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dcb70-541e-40e5-a237-712ca1d325eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e309ff3027db44c18329883692111af4)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:42.472550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dcb70-541e-40e5-a237-712ca1d325eb admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:42.616765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 900/1805] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:42 2022] POST /identity/v3/users => generated 288 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:42.616765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e60ac0-6778-4142-9bce-399d80f1e517 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:42.625552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e60ac0-6778-4142-9bce-399d80f1e517 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:42.630667 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85d82f-d74a-4d00-9b8c-97fc1684039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:42.631346 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85d82f-d74a-4d00-9b8c-97fc1684039e admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:42.631719 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85d82f-d74a-4d00-9b8c-97fc1684039e admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:42.631998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85d82f-d74a-4d00-9b8c-97fc1684039e admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:42.632854 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85d82f-d74a-4d00-9b8c-97fc1684039e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:42.635634 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85d82f-d74a-4d00-9b8c-97fc1684039e admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:42.701734 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-620dcb70-541e-40e5-a237-712ca1d325eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e309ff3027db44c18329883692111af4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:42.702402 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-620dcb70-541e-40e5-a237-712ca1d325eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e309ff3027db44c18329883692111af4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:42.709752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-620dcb70-541e-40e5-a237-712ca1d325eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e309ff3027db44c18329883692111af4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:42.721717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 901/1806] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:42 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:42.722559 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85d82f-d74a-4d00-9b8c-97fc1684039e admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:42.725821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-bc85d82f-d74a-4d00-9b8c-97fc1684039e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:42.738816 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85d82f-d74a-4d00-9b8c-97fc1684039e admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:42.744215 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94f5ed-6adc-4036-9e3c-a79df9815f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:42.745065 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94f5ed-6adc-4036-9e3c-a79df9815f23 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:42.745346 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94f5ed-6adc-4036-9e3c-a79df9815f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:42.745621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94f5ed-6adc-4036-9e3c-a79df9815f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:42.746389 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94f5ed-6adc-4036-9e3c-a79df9815f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:42.748059 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94f5ed-6adc-4036-9e3c-a79df9815f23 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:42.758587 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 902/1807] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:42.759328 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94f5ed-6adc-4036-9e3c-a79df9815f23 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:42.764461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ee94f5ed-6adc-4036-9e3c-a79df9815f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:42.777585 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94f5ed-6adc-4036-9e3c-a79df9815f23 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:42.785045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5935b1-346d-4f39-b81b-3b26069b6159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:42.785045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5935b1-346d-4f39-b81b-3b26069b6159 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:42.785348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-620dcb70-541e-40e5-a237-712ca1d325eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e309ff3027db44c18329883692111af4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:42.785441 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5935b1-346d-4f39-b81b-3b26069b6159 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:42.785441 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5935b1-346d-4f39-b81b-3b26069b6159 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:42.786140 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5935b1-346d-4f39-b81b-3b26069b6159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:42.788378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5935b1-346d-4f39-b81b-3b26069b6159 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:42.801931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 903/1808] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:42.802363 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-620dcb70-541e-40e5-a237-712ca1d325eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e309ff3027db44c18329883692111af4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:42.802813 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5935b1-346d-4f39-b81b-3b26069b6159 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:42.813715 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5935b1-346d-4f39-b81b-3b26069b6159 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:42.821193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 906/1809] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:42 2022] DELETE /identity/v3/users/e309ff3027db44c18329883692111af4 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:42.822799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dcb70-541e-40e5-a237-712ca1d325eb admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:42.823363 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3d5cc-0b20-4437-ae4c-b3371a04d009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:42.824750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3d5cc-0b20-4437-ae4c-b3371a04d009 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:42.824750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3d5cc-0b20-4437-ae4c-b3371a04d009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:42.825016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3d5cc-0b20-4437-ae4c-b3371a04d009 admin admin] PATH_INFO: `/v3/projects/6363311d9c5548cf8f3af3a1dbb1a73f/users/b6f188789358401f996f36985863a373/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:42.842886 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3d5cc-0b20-4437-ae4c-b3371a04d009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6363311d9c5548cf8f3af3a1dbb1a73f, user_id=b6f188789358401f996f36985863a373, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:42.846495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3d5cc-0b20-4437-ae4c-b3371a04d009 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:42.889892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dcb70-541e-40e5-a237-712ca1d325eb admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:42.901081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870990d-6163-4bf9-bcaf-a37c16e4b1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:42.905302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870990d-6163-4bf9-bcaf-a37c16e4b1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:42.905302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870990d-6163-4bf9-bcaf-a37c16e4b1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:42.905302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870990d-6163-4bf9-bcaf-a37c16e4b1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:42.905302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870990d-6163-4bf9-bcaf-a37c16e4b1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:42.905302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870990d-6163-4bf9-bcaf-a37c16e4b1a0 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:42.915292 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 907/1810] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:42.917000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e5c9-83f4-40a2-9279-85b995ead439 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:42.917289 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e5c9-83f4-40a2-9279-85b995ead439 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:42.917575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e5c9-83f4-40a2-9279-85b995ead439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:42.938081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-b857e5c9-83f4-40a2-9279-85b995ead439 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:42.939328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-b857e5c9-83f4-40a2-9279-85b995ead439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:42.948529 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 908/1811] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:42.949170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857e5c9-83f4-40a2-9279-85b995ead439 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:42.959374 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857e5c9-83f4-40a2-9279-85b995ead439 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:42.963051 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 904/1812] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:42 2022] PUT /identity/v3/projects/6363311d9c5548cf8f3af3a1dbb1a73f/users/b6f188789358401f996f36985863a373/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:42.963871 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3d5cc-0b20-4437-ae4c-b3371a04d009 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:42.966015 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0ab3d5cc-0b20-4437-ae4c-b3371a04d009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:43.028828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1a8d7-9880-4021-8a0a-aa9060986e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:43.029847 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1a8d7-9880-4021-8a0a-aa9060986e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:43.030138 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1a8d7-9880-4021-8a0a-aa9060986e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:43.030416 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1a8d7-9880-4021-8a0a-aa9060986e67 admin admin] PATH_INFO: `/v3/projects/208fd7a13f0d46de9b39b6cf67a877ac/users/42c0112e43a445ec8fb3d846a5a28680/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:43.040305 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3d5cc-0b20-4437-ae4c-b3371a04d009 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:43.046020 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c392bf-5431-4f35-9604-f3c615ec0f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:43.046676 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c392bf-5431-4f35-9604-f3c615ec0f9e service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:43.046779 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1a8d7-9880-4021-8a0a-aa9060986e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=208fd7a13f0d46de9b39b6cf67a877ac, user_id=42c0112e43a445ec8fb3d846a5a28680, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:43.046961 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c392bf-5431-4f35-9604-f3c615ec0f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:43.047227 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c392bf-5431-4f35-9604-f3c615ec0f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:43.049760 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1a8d7-9880-4021-8a0a-aa9060986e67 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:43.060418 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c392bf-5431-4f35-9604-f3c615ec0f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:43.061883 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c392bf-5431-4f35-9604-f3c615ec0f9e service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:43.072309 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 905/1813] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:43.073435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c392bf-5431-4f35-9604-f3c615ec0f9e service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:43.083637 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c392bf-5431-4f35-9604-f3c615ec0f9e service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:43.088999 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c8823-3540-42c1-8e28-fd7a478aa8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:43.089665 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c8823-3540-42c1-8e28-fd7a478aa8fc admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:43.090061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c8823-3540-42c1-8e28-fd7a478aa8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:43.090287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c8823-3540-42c1-8e28-fd7a478aa8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:43.091062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c8823-3540-42c1-8e28-fd7a478aa8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:43.092815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c8823-3540-42c1-8e28-fd7a478aa8fc admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:43.109618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 906/1814] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:43.110971 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c8823-3540-42c1-8e28-fd7a478aa8fc admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:43.122045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c8823-3540-42c1-8e28-fd7a478aa8fc admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:43.130203 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 909/1815] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:42 2022] PUT /identity/v3/projects/208fd7a13f0d46de9b39b6cf67a877ac/users/42c0112e43a445ec8fb3d846a5a28680/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:43.141776 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a59fd6-b4a1-42b4-a432-f15047c8c188 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:43.142060 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a59fd6-b4a1-42b4-a432-f15047c8c188 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:43.142332 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a59fd6-b4a1-42b4-a432-f15047c8c188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:43.169636 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-48a59fd6-b4a1-42b4-a432-f15047c8c188 None None] MFA Rules not processed for user `42c0112e43a445ec8fb3d846a5a28680`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:43.170858 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-48a59fd6-b4a1-42b4-a432-f15047c8c188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:43.192111 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0d205-4304-4734-be7d-5a27230a1681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:43.193345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0d205-4304-4734-be7d-5a27230a1681 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:43.193345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0d205-4304-4734-be7d-5a27230a1681 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:43.193611 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0d205-4304-4734-be7d-5a27230a1681 admin admin] PATH_INFO: `/v3/projects/6363311d9c5548cf8f3af3a1dbb1a73f/users/b6f188789358401f996f36985863a373/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:43.195738 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0d205-4304-4734-be7d-5a27230a1681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6363311d9c5548cf8f3af3a1dbb1a73f, user_id=b6f188789358401f996f36985863a373, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:43.198460 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0d205-4304-4734-be7d-5a27230a1681 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:43.210378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 907/1816] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:43 2022] PUT /identity/v3/projects/6363311d9c5548cf8f3af3a1dbb1a73f/users/b6f188789358401f996f36985863a373/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:43.222643 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832bd1a-e9dd-4dc9-b9f2-ecd708c0500d None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:43.223679 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832bd1a-e9dd-4dc9-b9f2-ecd708c0500d None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:43.224020 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832bd1a-e9dd-4dc9-b9f2-ecd708c0500d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:43.255412 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 910/1817] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:00:43.260064 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a59fd6-b4a1-42b4-a432-f15047c8c188 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:43.266223 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-1832bd1a-e9dd-4dc9-b9f2-ecd708c0500d None None] MFA Rules not processed for user `b6f188789358401f996f36985863a373`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:43.267481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1832bd1a-e9dd-4dc9-b9f2-ecd708c0500d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:43.282019 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a59fd6-b4a1-42b4-a432-f15047c8c188 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:43.351739 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 908/1818] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:43 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:43.390663 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae444d-fa23-48c0-aeb1-9dff41a25f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:43.395931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae444d-fa23-48c0-aeb1-9dff41a25f5c admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:43.395931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae444d-fa23-48c0-aeb1-9dff41a25f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:43.395931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae444d-fa23-48c0-aeb1-9dff41a25f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:43.395931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae444d-fa23-48c0-aeb1-9dff41a25f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:43.395931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae444d-fa23-48c0-aeb1-9dff41a25f5c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:43.430778 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832bd1a-e9dd-4dc9-b9f2-ecd708c0500d None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:43.433365 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1832bd1a-e9dd-4dc9-b9f2-ecd708c0500d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:43.510896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 911/1819] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:43 2022] POST /identity/v3/projects => generated 389 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:43.514105 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae444d-fa23-48c0-aeb1-9dff41a25f5c admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:43.539360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832bd1a-e9dd-4dc9-b9f2-ecd708c0500d None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:43.720706 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae444d-fa23-48c0-aeb1-9dff41a25f5c admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:43.725221 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aac39b-088f-4eec-a0dc-1defd5cd9f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:43.725221 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac39b-088f-4eec-a0dc-1defd5cd9f2d service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:43.725221 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac39b-088f-4eec-a0dc-1defd5cd9f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:43.725221 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac39b-088f-4eec-a0dc-1defd5cd9f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:43.725521 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da650e2-68fc-463d-8a50-96ae2fd3ca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:43.725913 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da650e2-68fc-463d-8a50-96ae2fd3ca9c admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:43.726201 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da650e2-68fc-463d-8a50-96ae2fd3ca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:43.726474 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da650e2-68fc-463d-8a50-96ae2fd3ca9c admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:43.727161 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da650e2-68fc-463d-8a50-96ae2fd3ca9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:43.729234 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da650e2-68fc-463d-8a50-96ae2fd3ca9c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:43.788557 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aac39b-088f-4eec-a0dc-1defd5cd9f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:43.789995 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aac39b-088f-4eec-a0dc-1defd5cd9f2d service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:43.801804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 909/1820] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:43 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:43.805093 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aac39b-088f-4eec-a0dc-1defd5cd9f2d service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:43.814029 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-67aac39b-088f-4eec-a0dc-1defd5cd9f2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:43.830718 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aac39b-088f-4eec-a0dc-1defd5cd9f2d service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:43.831262 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 912/1821] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:43 2022] POST /identity/v3/users => generated 301 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:43.834797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da650e2-68fc-463d-8a50-96ae2fd3ca9c admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:43.838669 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173ba81-7be1-4e75-979f-dbf7c63fd83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:43.839684 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173ba81-7be1-4e75-979f-dbf7c63fd83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:43.840034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173ba81-7be1-4e75-979f-dbf7c63fd83a admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:43.840377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173ba81-7be1-4e75-979f-dbf7c63fd83a admin admin] PATH_INFO: `/v3/projects/adcbb622dcd54cbfba22760ce0fcb1cc` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:43.841687 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173ba81-7be1-4e75-979f-dbf7c63fd83a admin admin] RBAC: Authorizing `identity:delete_project(project_id=adcbb622dcd54cbfba22760ce0fcb1cc)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:43.844776 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173ba81-7be1-4e75-979f-dbf7c63fd83a admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:43.858371 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da650e2-68fc-463d-8a50-96ae2fd3ca9c admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:43.866579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fb338-7891-46eb-b7a9-01d8d75684e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:43.867279 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fb338-7891-46eb-b7a9-01d8d75684e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:43.870685 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fb338-7891-46eb-b7a9-01d8d75684e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:43.870685 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fb338-7891-46eb-b7a9-01d8d75684e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:43.870685 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fb338-7891-46eb-b7a9-01d8d75684e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:43.871025 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fb338-7891-46eb-b7a9-01d8d75684e9 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:43.883551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 913/1822] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:00:43.887408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fb338-7891-46eb-b7a9-01d8d75684e9 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:43.897913 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fb338-7891-46eb-b7a9-01d8d75684e9 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:43.911792 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42303f2-36fb-4e0d-bdb3-7d2ab7710495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:43.911792 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42303f2-36fb-4e0d-bdb3-7d2ab7710495 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:43.911792 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42303f2-36fb-4e0d-bdb3-7d2ab7710495 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:43.911792 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42303f2-36fb-4e0d-bdb3-7d2ab7710495 admin admin] PATH_INFO: `/v3/projects/52b9acfe4c794dac9f25a6c360e9e5fb/users/600429f5eac742459d2d28fa2455c0ab/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:43.929832 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42303f2-36fb-4e0d-bdb3-7d2ab7710495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b9acfe4c794dac9f25a6c360e9e5fb, user_id=600429f5eac742459d2d28fa2455c0ab, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:43.933328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42303f2-36fb-4e0d-bdb3-7d2ab7710495 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:44.063579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 914/1823] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:43 2022] PUT /identity/v3/projects/52b9acfe4c794dac9f25a6c360e9e5fb/users/600429f5eac742459d2d28fa2455c0ab/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:44.064935 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42303f2-36fb-4e0d-bdb3-7d2ab7710495 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:44.066410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-b42303f2-36fb-4e0d-bdb3-7d2ab7710495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:44.085365 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9173ba81-7be1-4e75-979f-dbf7c63fd83a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adcbb622dcd54cbfba22760ce0fcb1cc', 'request_id': 'req-9173ba81-7be1-4e75-979f-dbf7c63fd83a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:44.144502 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42303f2-36fb-4e0d-bdb3-7d2ab7710495 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:44.153086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9173ba81-7be1-4e75-979f-dbf7c63fd83a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adcbb622dcd54cbfba22760ce0fcb1cc', 'request_id': 'req-9173ba81-7be1-4e75-979f-dbf7c63fd83a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:44.164491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9173ba81-7be1-4e75-979f-dbf7c63fd83a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adcbb622dcd54cbfba22760ce0fcb1cc', 'request_id': 'req-9173ba81-7be1-4e75-979f-dbf7c63fd83a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:44.176373 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9173ba81-7be1-4e75-979f-dbf7c63fd83a admin admin] The token cache is being invalidate because project adcbb622dcd54cbfba22760ce0fcb1cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:44.176676 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9173ba81-7be1-4e75-979f-dbf7c63fd83a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:44.177319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-9173ba81-7be1-4e75-979f-dbf7c63fd83a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:44.179210 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 910/1824] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:43 2022] DELETE /identity/v3/projects/adcbb622dcd54cbfba22760ce0fcb1cc => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:44.180351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173ba81-7be1-4e75-979f-dbf7c63fd83a admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:44.183562 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-9173ba81-7be1-4e75-979f-dbf7c63fd83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:44.224279 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420127a-df53-4675-b9ce-65bb4637c4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:44.225484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420127a-df53-4675-b9ce-65bb4637c4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:44.225773 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420127a-df53-4675-b9ce-65bb4637c4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:44.226052 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420127a-df53-4675-b9ce-65bb4637c4ab admin admin] PATH_INFO: `/v3/users/8a837dd0e1e343578cb48efcc7054233` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:44.227278 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420127a-df53-4675-b9ce-65bb4637c4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a837dd0e1e343578cb48efcc7054233)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:44.230355 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420127a-df53-4675-b9ce-65bb4637c4ab admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:44.263533 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173ba81-7be1-4e75-979f-dbf7c63fd83a admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:44.268731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8c2f8-3875-449f-85ea-650ea4a6082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:44.269469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8c2f8-3875-449f-85ea-650ea4a6082c admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:44.269805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8c2f8-3875-449f-85ea-650ea4a6082c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:44.270150 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8c2f8-3875-449f-85ea-650ea4a6082c admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:44.271044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8c2f8-3875-449f-85ea-650ea4a6082c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:44.272813 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8c2f8-3875-449f-85ea-650ea4a6082c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:44.283807 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 911/1825] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:44.284659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8c2f8-3875-449f-85ea-650ea4a6082c admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:44.286327 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e2d8c2f8-3875-449f-85ea-650ea4a6082c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:44.347985 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8c2f8-3875-449f-85ea-650ea4a6082c admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:44.352174 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec63181-459e-4309-96d7-50cd75396484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:44.352859 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec63181-459e-4309-96d7-50cd75396484 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:44.353147 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec63181-459e-4309-96d7-50cd75396484 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:44.353445 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec63181-459e-4309-96d7-50cd75396484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:44.355934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5ec63181-459e-4309-96d7-50cd75396484 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:44.420152 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec63181-459e-4309-96d7-50cd75396484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:44.421678 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec63181-459e-4309-96d7-50cd75396484 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:44.429946 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3420127a-df53-4675-b9ce-65bb4637c4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a837dd0e1e343578cb48efcc7054233'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:44.430702 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3420127a-df53-4675-b9ce-65bb4637c4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a837dd0e1e343578cb48efcc7054233'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:44.431618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 912/1826] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:44.432471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec63181-459e-4309-96d7-50cd75396484 service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:44.433950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5ec63181-459e-4309-96d7-50cd75396484 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:44.440424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3420127a-df53-4675-b9ce-65bb4637c4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a837dd0e1e343578cb48efcc7054233'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:44.449574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec63181-459e-4309-96d7-50cd75396484 service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:44.454121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a4fb7-5b26-415f-88da-78f008c46990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:44.455001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a4fb7-5b26-415f-88da-78f008c46990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:44.455284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a4fb7-5b26-415f-88da-78f008c46990 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:44.455621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a4fb7-5b26-415f-88da-78f008c46990 admin admin] PATH_INFO: `/v3/users/e4e9a4e6ab2a44e884a894eade59fa31` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:44.456832 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a4fb7-5b26-415f-88da-78f008c46990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e9a4e6ab2a44e884a894eade59fa31)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:44.458768 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a4fb7-5b26-415f-88da-78f008c46990 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:44.546478 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3420127a-df53-4675-b9ce-65bb4637c4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a837dd0e1e343578cb48efcc7054233'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:44.562171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3420127a-df53-4675-b9ce-65bb4637c4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a837dd0e1e343578cb48efcc7054233'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:44.568937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 915/1827] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:44 2022] DELETE /identity/v3/users/8a837dd0e1e343578cb48efcc7054233 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:44.569556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420127a-df53-4675-b9ce-65bb4637c4ab admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:44.570924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3420127a-df53-4675-b9ce-65bb4637c4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:44.637550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420127a-df53-4675-b9ce-65bb4637c4ab admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:44.642177 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc2a6a-5772-45f6-a0ea-6cb954bb0fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:44.643076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc2a6a-5772-45f6-a0ea-6cb954bb0fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:44.643392 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc2a6a-5772-45f6-a0ea-6cb954bb0fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:44.643706 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc2a6a-5772-45f6-a0ea-6cb954bb0fb4 admin admin] PATH_INFO: `/v3/projects/52b9acfe4c794dac9f25a6c360e9e5fb/users/600429f5eac742459d2d28fa2455c0ab/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:44.645703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc2a6a-5772-45f6-a0ea-6cb954bb0fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b9acfe4c794dac9f25a6c360e9e5fb, user_id=600429f5eac742459d2d28fa2455c0ab, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:44.648405 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc2a6a-5772-45f6-a0ea-6cb954bb0fb4 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:44.664669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 916/1828] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:44 2022] PUT /identity/v3/projects/52b9acfe4c794dac9f25a6c360e9e5fb/users/600429f5eac742459d2d28fa2455c0ab/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:44.666607 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc8246-4e40-4570-b290-52ab7c8fa4d1 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:44.666900 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc8246-4e40-4570-b290-52ab7c8fa4d1 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:44.667186 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc8246-4e40-4570-b290-52ab7c8fa4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:44.678942 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dd9a4fb7-5b26-415f-88da-78f008c46990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e9a4e6ab2a44e884a894eade59fa31'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:44.680061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dd9a4fb7-5b26-415f-88da-78f008c46990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e9a4e6ab2a44e884a894eade59fa31'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:44.694419 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-41fc8246-4e40-4570-b290-52ab7c8fa4d1 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:44.695734 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-41fc8246-4e40-4570-b290-52ab7c8fa4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:44.773408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 917/1829] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:44.775452 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35436b-ceb5-43bf-b745-ec6157940702 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:44.775789 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35436b-ceb5-43bf-b745-ec6157940702 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:44.776067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35436b-ceb5-43bf-b745-ec6157940702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:44.812067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-5b35436b-ceb5-43bf-b745-ec6157940702 None None] MFA Rules not processed for user `600429f5eac742459d2d28fa2455c0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:44.813375 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-5b35436b-ceb5-43bf-b745-ec6157940702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:44.830422 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dd9a4fb7-5b26-415f-88da-78f008c46990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e9a4e6ab2a44e884a894eade59fa31'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:44.848801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dd9a4fb7-5b26-415f-88da-78f008c46990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e9a4e6ab2a44e884a894eade59fa31'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:44.859968 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dd9a4fb7-5b26-415f-88da-78f008c46990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e9a4e6ab2a44e884a894eade59fa31'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:44.867814 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 913/1830] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:44 2022] DELETE /identity/v3/users/e4e9a4e6ab2a44e884a894eade59fa31 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:44.869728 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a4fb7-5b26-415f-88da-78f008c46990 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:44.871742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-dd9a4fb7-5b26-415f-88da-78f008c46990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:44.921945 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 918/1831] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:44.936968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35436b-ceb5-43bf-b745-ec6157940702 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:44.938468 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-5b35436b-ceb5-43bf-b745-ec6157940702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:44.984915 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a4fb7-5b26-415f-88da-78f008c46990 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:44.988800 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a5cb7-0994-41d4-a7ea-c8203451610b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:44.989465 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a5cb7-0994-41d4-a7ea-c8203451610b service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:44.989743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a5cb7-0994-41d4-a7ea-c8203451610b service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:44.990019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a5cb7-0994-41d4-a7ea-c8203451610b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:45.100285 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a5cb7-0994-41d4-a7ea-c8203451610b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:45.101734 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35436b-ceb5-43bf-b745-ec6157940702 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:45.102016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a5cb7-0994-41d4-a7ea-c8203451610b service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:45.113951 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 914/1832] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:45.174697 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b470fb3-fd71-418c-b44a-1667e2ca9b3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:45.175151 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b470fb3-fd71-418c-b44a-1667e2ca9b3c service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:45.175887 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b470fb3-fd71-418c-b44a-1667e2ca9b3c service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:45.176180 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b470fb3-fd71-418c-b44a-1667e2ca9b3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:45.278580 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b470fb3-fd71-418c-b44a-1667e2ca9b3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:45.280179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b470fb3-fd71-418c-b44a-1667e2ca9b3c service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:45.293573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 919/1833] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:00:45.440634 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a5cb7-0994-41d4-a7ea-c8203451610b service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:45.442356 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-6b7a5cb7-0994-41d4-a7ea-c8203451610b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:45.455452 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a5cb7-0994-41d4-a7ea-c8203451610b service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:45.460450 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32841cd2-38ea-4844-b4f9-2c2e82009ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:45.461321 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32841cd2-38ea-4844-b4f9-2c2e82009ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:45.461606 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32841cd2-38ea-4844-b4f9-2c2e82009ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:45.461879 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32841cd2-38ea-4844-b4f9-2c2e82009ea0 admin admin] PATH_INFO: `/v3/users/42c0112e43a445ec8fb3d846a5a28680` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:45.463686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32841cd2-38ea-4844-b4f9-2c2e82009ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c0112e43a445ec8fb3d846a5a28680)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:45.465626 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32841cd2-38ea-4844-b4f9-2c2e82009ea0 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:45.552926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b470fb3-fd71-418c-b44a-1667e2ca9b3c service cinder] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:45.554368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-8b470fb3-fd71-418c-b44a-1667e2ca9b3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:45.570788 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b470fb3-fd71-418c-b44a-1667e2ca9b3c service cinder] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:45.575615 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a60a76-ecab-4456-8fea-132c7ea8f37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:45.584092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a60a76-ecab-4456-8fea-132c7ea8f37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:45.584466 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a60a76-ecab-4456-8fea-132c7ea8f37b admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:45.584753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a60a76-ecab-4456-8fea-132c7ea8f37b admin admin] PATH_INFO: `/v3/projects/2c8bcaeb6c614bc28f10c38a7bb7dbfc` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:45.585991 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a60a76-ecab-4456-8fea-132c7ea8f37b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8bcaeb6c614bc28f10c38a7bb7dbfc)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:45.588493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a60a76-ecab-4456-8fea-132c7ea8f37b admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:45.674747 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-32841cd2-38ea-4844-b4f9-2c2e82009ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c0112e43a445ec8fb3d846a5a28680'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:45.675409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-32841cd2-38ea-4844-b4f9-2c2e82009ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c0112e43a445ec8fb3d846a5a28680'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:45.735244 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-50a60a76-ecab-4456-8fea-132c7ea8f37b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8bcaeb6c614bc28f10c38a7bb7dbfc', 'request_id': 'req-50a60a76-ecab-4456-8fea-132c7ea8f37b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:45.740413 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-32841cd2-38ea-4844-b4f9-2c2e82009ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c0112e43a445ec8fb3d846a5a28680'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:45.741246 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-50a60a76-ecab-4456-8fea-132c7ea8f37b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8bcaeb6c614bc28f10c38a7bb7dbfc', 'request_id': 'req-50a60a76-ecab-4456-8fea-132c7ea8f37b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:45.752503 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-32841cd2-38ea-4844-b4f9-2c2e82009ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c0112e43a445ec8fb3d846a5a28680'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:45.759309 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-32841cd2-38ea-4844-b4f9-2c2e82009ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c0112e43a445ec8fb3d846a5a28680'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:45.768433 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 915/1834] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:45 2022] DELETE /identity/v3/users/42c0112e43a445ec8fb3d846a5a28680 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:45.768433 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32841cd2-38ea-4844-b4f9-2c2e82009ea0 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:45.769599 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-32841cd2-38ea-4844-b4f9-2c2e82009ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:45.824438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-50a60a76-ecab-4456-8fea-132c7ea8f37b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8bcaeb6c614bc28f10c38a7bb7dbfc', 'request_id': 'req-50a60a76-ecab-4456-8fea-132c7ea8f37b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:45.836649 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32841cd2-38ea-4844-b4f9-2c2e82009ea0 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:45.838714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-50a60a76-ecab-4456-8fea-132c7ea8f37b admin admin] The token cache is being invalidate because project 2c8bcaeb6c614bc28f10c38a7bb7dbfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:45.839098 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-50a60a76-ecab-4456-8fea-132c7ea8f37b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:45.839899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-50a60a76-ecab-4456-8fea-132c7ea8f37b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:45.841885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 920/1835] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:45 2022] DELETE /identity/v3/projects/2c8bcaeb6c614bc28f10c38a7bb7dbfc => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:00:45.843290 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a17aa5-5436-46f6-8035-12485cef869a None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:45.843700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a17aa5-5436-46f6-8035-12485cef869a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:45.844151 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a17aa5-5436-46f6-8035-12485cef869a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:45.846185 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:45.847573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:45.847573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:45.847573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1 admin admin] PATH_INFO: `/v3/projects/e5b26b7d869a4860ab2a6229f0f8647f` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:45.848722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b26b7d869a4860ab2a6229f0f8647f)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:45.850703 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:45.865687 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c9a17aa5-5436-46f6-8035-12485cef869a None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:45.867036 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c9a17aa5-5436-46f6-8035-12485cef869a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:45.875935 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 921/1836] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:45.877146 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe947bb-0853-422f-ab51-36cd1f696f60 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:45.877566 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe947bb-0853-422f-ab51-36cd1f696f60 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:45.877917 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe947bb-0853-422f-ab51-36cd1f696f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:45.897652 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-dbe947bb-0853-422f-ab51-36cd1f696f60 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:45.898894 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-dbe947bb-0853-422f-ab51-36cd1f696f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:45.910914 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 922/1837] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:45.912299 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe947bb-0853-422f-ab51-36cd1f696f60 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:45.919641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-dbe947bb-0853-422f-ab51-36cd1f696f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:45.987128 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe947bb-0853-422f-ab51-36cd1f696f60 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:45.991125 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30791a53-b955-4de2-badb-ea18d3cd3703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:45.991842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30791a53-b955-4de2-badb-ea18d3cd3703 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:45.992261 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30791a53-b955-4de2-badb-ea18d3cd3703 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:45.992544 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30791a53-b955-4de2-badb-ea18d3cd3703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:46.002130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30791a53-b955-4de2-badb-ea18d3cd3703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:46.003618 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30791a53-b955-4de2-badb-ea18d3cd3703 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:46.014433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 923/1838] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:46.018686 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fd6f2-af24-4f84-b817-0f41b58cf6b4 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:46.018686 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fd6f2-af24-4f84-b817-0f41b58cf6b4 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:46.018686 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fd6f2-af24-4f84-b817-0f41b58cf6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:46.039237 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-5f7fd6f2-af24-4f84-b817-0f41b58cf6b4 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:46.042344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-5f7fd6f2-af24-4f84-b817-0f41b58cf6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:46.042939 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b26b7d869a4860ab2a6229f0f8647f', 'request_id': 'req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:46.129356 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b26b7d869a4860ab2a6229f0f8647f', 'request_id': 'req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:46.134825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 924/1839] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:46.147397 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b26b7d869a4860ab2a6229f0f8647f', 'request_id': 'req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:46.148954 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fd6f2-af24-4f84-b817-0f41b58cf6b4 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:46.161203 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fd6f2-af24-4f84-b817-0f41b58cf6b4 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:46.174194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1 admin admin] The token cache is being invalidate because project e5b26b7d869a4860ab2a6229f0f8647f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:46.174495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:46.175098 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cc87d-24c7-4298-8a3d-5405aaf6a629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:46.176134 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cc87d-24c7-4298-8a3d-5405aaf6a629 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:46.176737 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cc87d-24c7-4298-8a3d-5405aaf6a629 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:46.177209 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cc87d-24c7-4298-8a3d-5405aaf6a629 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:46.178130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cc87d-24c7-4298-8a3d-5405aaf6a629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:46.178678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cc87d-24c7-4298-8a3d-5405aaf6a629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:46.178871 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:46.181601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cc87d-24c7-4298-8a3d-5405aaf6a629 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:46.187242 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 916/1840] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:45 2022] DELETE /identity/v3/projects/e5b26b7d869a4860ab2a6229f0f8647f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:46.193007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:46.194496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:46.209994 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab0126-6caa-4c49-abb6-c71d9ba8e1a1 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:46.215560 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e5bb5-c7aa-4ed6-8903-80e11455578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:46.216504 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e5bb5-c7aa-4ed6-8903-80e11455578f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:46.216790 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e5bb5-c7aa-4ed6-8903-80e11455578f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:46.217067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e5bb5-c7aa-4ed6-8903-80e11455578f admin admin] PATH_INFO: `/v3/users/75c0afce0a944abbb758cab4ba32209b` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:46.218566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e5bb5-c7aa-4ed6-8903-80e11455578f admin admin] RBAC: Authorizing `identity:delete_user(user_id=75c0afce0a944abbb758cab4ba32209b)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:46.220023 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 925/1841] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:46.224885 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e5bb5-c7aa-4ed6-8903-80e11455578f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:46.226313 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cc87d-24c7-4298-8a3d-5405aaf6a629 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:46.228845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-1b0cc87d-24c7-4298-8a3d-5405aaf6a629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:46.260014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cc87d-24c7-4298-8a3d-5405aaf6a629 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:46.265485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276c28a-c6d1-4023-9948-aafceeca72ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:46.266163 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276c28a-c6d1-4023-9948-aafceeca72ab admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:46.266445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276c28a-c6d1-4023-9948-aafceeca72ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:46.266722 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276c28a-c6d1-4023-9948-aafceeca72ab admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:46.267421 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276c28a-c6d1-4023-9948-aafceeca72ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:46.269874 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276c28a-c6d1-4023-9948-aafceeca72ab admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:46.415696 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 926/1842] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:46 2022] POST /identity/v3/projects => generated 393 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:46.429547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276c28a-c6d1-4023-9948-aafceeca72ab admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:46.497804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276c28a-c6d1-4023-9948-aafceeca72ab admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:46.500566 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dab83-b435-45c6-933f-93bcde3b7dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:46.501499 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dab83-b435-45c6-933f-93bcde3b7dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:46.501499 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dab83-b435-45c6-933f-93bcde3b7dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:46.501499 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dab83-b435-45c6-933f-93bcde3b7dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:46.502063 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dab83-b435-45c6-933f-93bcde3b7dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:46.504131 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dab83-b435-45c6-933f-93bcde3b7dc5 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:46.542061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-a23e5bb5-c7aa-4ed6-8903-80e11455578f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75c0afce0a944abbb758cab4ba32209b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:46.542972 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-a23e5bb5-c7aa-4ed6-8903-80e11455578f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75c0afce0a944abbb758cab4ba32209b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:46.638034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-a23e5bb5-c7aa-4ed6-8903-80e11455578f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75c0afce0a944abbb758cab4ba32209b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:46.641716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 927/1843] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:46 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:00:46.644899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc5c54-5b19-45ee-9fe7-9ec56cae78b6 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:46.645203 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc5c54-5b19-45ee-9fe7-9ec56cae78b6 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:46.645487 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc5c54-5b19-45ee-9fe7-9ec56cae78b6 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:46.647642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-a23e5bb5-c7aa-4ed6-8903-80e11455578f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75c0afce0a944abbb758cab4ba32209b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:46.652007 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 928/1844] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 12:00:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:00:46.652664 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc5c54-5b19-45ee-9fe7-9ec56cae78b6 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:46.656225 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-a23e5bb5-c7aa-4ed6-8903-80e11455578f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75c0afce0a944abbb758cab4ba32209b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:46.661733 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-e0dc5c54-5b19-45ee-9fe7-9ec56cae78b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:46.662565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 917/1845] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:46 2022] DELETE /identity/v3/users/75c0afce0a944abbb758cab4ba32209b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:46.671096 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8f2c8-a6e0-4e6b-b874-88a3c1f1d9c2 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:46.671503 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8f2c8-a6e0-4e6b-b874-88a3c1f1d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:46.672067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8f2c8-a6e0-4e6b-b874-88a3c1f1d9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:46.725178 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-ebe8f2c8-a6e0-4e6b-b874-88a3c1f1d9c2 None None] MFA Rules not processed for user `534fd902f96043068e99ca0537cf57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:46.725178 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ebe8f2c8-a6e0-4e6b-b874-88a3c1f1d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:46.786070 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc5c54-5b19-45ee-9fe7-9ec56cae78b6 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:46.798612 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0d19c-4f3c-4bff-96fd-2093042dda34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:46.798748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0d19c-4f3c-4bff-96fd-2093042dda34 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:46.799176 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0d19c-4f3c-4bff-96fd-2093042dda34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:46.799869 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0d19c-4f3c-4bff-96fd-2093042dda34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:46.800539 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0d19c-4f3c-4bff-96fd-2093042dda34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:46.802324 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0d19c-4f3c-4bff-96fd-2093042dda34 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:46.814755 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 918/1846] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 12:00:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:46.815731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8f2c8-a6e0-4e6b-b874-88a3c1f1d9c2 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:46.817209 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ebe8f2c8-a6e0-4e6b-b874-88a3c1f1d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:46.817323 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 929/1847] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:46.818196 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0d19c-4f3c-4bff-96fd-2093042dda34 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:46.843060 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8f2c8-a6e0-4e6b-b874-88a3c1f1d9c2 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:46.847705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0d19c-4f3c-4bff-96fd-2093042dda34 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:46.850879 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac67ee-318d-433c-bf69-fc6047d4ceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:46.851664 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac67ee-318d-433c-bf69-fc6047d4ceb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:46.851950 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac67ee-318d-433c-bf69-fc6047d4ceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:46.852223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac67ee-318d-433c-bf69-fc6047d4ceb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:46.853196 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac67ee-318d-433c-bf69-fc6047d4ceb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:46.854738 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77d598-3496-4be1-8c43-0b3d4cbe547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:46.855164 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac67ee-318d-433c-bf69-fc6047d4ceb0 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:46.856208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77d598-3496-4be1-8c43-0b3d4cbe547a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:46.856687 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77d598-3496-4be1-8c43-0b3d4cbe547a admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:46.857368 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77d598-3496-4be1-8c43-0b3d4cbe547a admin admin] PATH_INFO: `/v3/projects/208fd7a13f0d46de9b39b6cf67a877ac` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:46.859764 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77d598-3496-4be1-8c43-0b3d4cbe547a admin admin] RBAC: Authorizing `identity:delete_project(project_id=208fd7a13f0d46de9b39b6cf67a877ac)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:46.863738 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77d598-3496-4be1-8c43-0b3d4cbe547a admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:46.870135 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 930/1848] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:46.871080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac67ee-318d-433c-bf69-fc6047d4ceb0 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:46.872858 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-70ac67ee-318d-433c-bf69-fc6047d4ceb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:46.889761 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac67ee-318d-433c-bf69-fc6047d4ceb0 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:46.895664 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c5196-684e-461c-af1c-e3e794e3cf14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:46.896319 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c5196-684e-461c-af1c-e3e794e3cf14 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:46.896599 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c5196-684e-461c-af1c-e3e794e3cf14 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:46.896880 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c5196-684e-461c-af1c-e3e794e3cf14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:46.908203 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c5196-684e-461c-af1c-e3e794e3cf14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:46.909823 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c5196-684e-461c-af1c-e3e794e3cf14 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:46.932758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 931/1849] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:46.933965 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c5196-684e-461c-af1c-e3e794e3cf14 service nova] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:46.950860 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c5196-684e-461c-af1c-e3e794e3cf14 service nova] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:46.968099 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958fb88-08cc-438d-a24e-315045e1a88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:46.969023 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958fb88-08cc-438d-a24e-315045e1a88f admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:46.969305 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958fb88-08cc-438d-a24e-315045e1a88f admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:46.969581 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958fb88-08cc-438d-a24e-315045e1a88f admin admin] PATH_INFO: `/v3/projects/e07aae2254984877a60d46bdcf5e8c64/users/7a0bcc85892444fe91a09a1b0e0ff798/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:46.988919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958fb88-08cc-438d-a24e-315045e1a88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07aae2254984877a60d46bdcf5e8c64, user_id=7a0bcc85892444fe91a09a1b0e0ff798, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:46.991736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958fb88-08cc-438d-a24e-315045e1a88f admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:47.095571 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 932/1850] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:46 2022] PUT /identity/v3/projects/e07aae2254984877a60d46bdcf5e8c64/users/7a0bcc85892444fe91a09a1b0e0ff798/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:47.106112 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f51148-1a5d-4838-9e22-547538e824e9 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:47.106458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f51148-1a5d-4838-9e22-547538e824e9 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:47.106841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f51148-1a5d-4838-9e22-547538e824e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:47.128608 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-5a77d598-3496-4be1-8c43-0b3d4cbe547a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208fd7a13f0d46de9b39b6cf67a877ac', 'request_id': 'req-5a77d598-3496-4be1-8c43-0b3d4cbe547a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:47.154091 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-78f51148-1a5d-4838-9e22-547538e824e9 None None] MFA Rules not processed for user `7a0bcc85892444fe91a09a1b0e0ff798`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:47.155344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-78f51148-1a5d-4838-9e22-547538e824e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:47.202942 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-5a77d598-3496-4be1-8c43-0b3d4cbe547a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208fd7a13f0d46de9b39b6cf67a877ac', 'request_id': 'req-5a77d598-3496-4be1-8c43-0b3d4cbe547a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:47.219491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-5a77d598-3496-4be1-8c43-0b3d4cbe547a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208fd7a13f0d46de9b39b6cf67a877ac', 'request_id': 'req-5a77d598-3496-4be1-8c43-0b3d4cbe547a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:47.235727 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-5a77d598-3496-4be1-8c43-0b3d4cbe547a admin admin] The token cache is being invalidate because project 208fd7a13f0d46de9b39b6cf67a877ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:47.235916 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-5a77d598-3496-4be1-8c43-0b3d4cbe547a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:47.237150 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-5a77d598-3496-4be1-8c43-0b3d4cbe547a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:47.238984 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 919/1851] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:46 2022] DELETE /identity/v3/projects/208fd7a13f0d46de9b39b6cf67a877ac => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:47.240489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77d598-3496-4be1-8c43-0b3d4cbe547a admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:47.242811 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5a77d598-3496-4be1-8c43-0b3d4cbe547a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:47.265277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 933/1852] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:47.270581 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f51148-1a5d-4838-9e22-547538e824e9 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:47.272518 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-78f51148-1a5d-4838-9e22-547538e824e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:47.363818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f51148-1a5d-4838-9e22-547538e824e9 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:47.370801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639ecc5-711d-4e8d-9e5b-1f528da8ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:47.373568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639ecc5-711d-4e8d-9e5b-1f528da8ad94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:47.373896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639ecc5-711d-4e8d-9e5b-1f528da8ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:47.374185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639ecc5-711d-4e8d-9e5b-1f528da8ad94 admin admin] PATH_INFO: `/v3/users/600429f5eac742459d2d28fa2455c0ab` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:47.376409 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639ecc5-711d-4e8d-9e5b-1f528da8ad94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=600429f5eac742459d2d28fa2455c0ab)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:47.377205 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77d598-3496-4be1-8c43-0b3d4cbe547a admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:47.379664 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639ecc5-711d-4e8d-9e5b-1f528da8ad94 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:47.383436 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52727f81-6d51-4aa4-a04d-148a72f3d044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:47.384821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52727f81-6d51-4aa4-a04d-148a72f3d044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:47.385201 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52727f81-6d51-4aa4-a04d-148a72f3d044 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:47.385541 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52727f81-6d51-4aa4-a04d-148a72f3d044 admin admin] PATH_INFO: `/v3/projects/e071fc0570ef4ba6a35e104fa049aa54` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:47.387296 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52727f81-6d51-4aa4-a04d-148a72f3d044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e071fc0570ef4ba6a35e104fa049aa54)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:47.389763 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52727f81-6d51-4aa4-a04d-148a72f3d044 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:47.657164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-52727f81-6d51-4aa4-a04d-148a72f3d044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e071fc0570ef4ba6a35e104fa049aa54', 'request_id': 'req-52727f81-6d51-4aa4-a04d-148a72f3d044'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:47.657733 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0639ecc5-711d-4e8d-9e5b-1f528da8ad94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '600429f5eac742459d2d28fa2455c0ab'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:47.658758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0639ecc5-711d-4e8d-9e5b-1f528da8ad94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '600429f5eac742459d2d28fa2455c0ab'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:47.674673 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0639ecc5-711d-4e8d-9e5b-1f528da8ad94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '600429f5eac742459d2d28fa2455c0ab'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:47.760775 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-52727f81-6d51-4aa4-a04d-148a72f3d044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e071fc0570ef4ba6a35e104fa049aa54', 'request_id': 'req-52727f81-6d51-4aa4-a04d-148a72f3d044'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:47.768744 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-52727f81-6d51-4aa4-a04d-148a72f3d044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e071fc0570ef4ba6a35e104fa049aa54', 'request_id': 'req-52727f81-6d51-4aa4-a04d-148a72f3d044'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:47.783392 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-52727f81-6d51-4aa4-a04d-148a72f3d044 admin admin] The token cache is being invalidate because project e071fc0570ef4ba6a35e104fa049aa54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:47.784247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-52727f81-6d51-4aa4-a04d-148a72f3d044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:47.785610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-52727f81-6d51-4aa4-a04d-148a72f3d044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:47.787181 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 920/1853] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:47 2022] DELETE /identity/v3/projects/e071fc0570ef4ba6a35e104fa049aa54 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:47.787578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52727f81-6d51-4aa4-a04d-148a72f3d044 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:47.788882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-52727f81-6d51-4aa4-a04d-148a72f3d044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:47.849648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0639ecc5-711d-4e8d-9e5b-1f528da8ad94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '600429f5eac742459d2d28fa2455c0ab'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:47.882545 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0639ecc5-711d-4e8d-9e5b-1f528da8ad94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '600429f5eac742459d2d28fa2455c0ab'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:47.908461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52727f81-6d51-4aa4-a04d-148a72f3d044 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:47.912708 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 934/1854] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:47 2022] DELETE /identity/v3/users/600429f5eac742459d2d28fa2455c0ab => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:47.914908 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc54c7-6eeb-4434-bb10-be78f181bad7 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:47.915573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc54c7-6eeb-4434-bb10-be78f181bad7 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:47.916977 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc54c7-6eeb-4434-bb10-be78f181bad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:47.937818 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d34c-bf34-41a1-85a8-2f69e39735e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:47.938741 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d34c-bf34-41a1-85a8-2f69e39735e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:47.939106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d34c-bf34-41a1-85a8-2f69e39735e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:47.939401 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d34c-bf34-41a1-85a8-2f69e39735e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:47.940292 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511d34c-bf34-41a1-85a8-2f69e39735e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:47.943585 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511d34c-bf34-41a1-85a8-2f69e39735e4 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:47.943790 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-68bc54c7-6eeb-4434-bb10-be78f181bad7 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:47.945694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-68bc54c7-6eeb-4434-bb10-be78f181bad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:48.031112 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 921/1855] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:47 2022] POST /identity/v3/projects => generated 391 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:48.036227 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d34c-bf34-41a1-85a8-2f69e39735e4 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:48.085401 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 935/1856] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:48.098457 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de12b1-f2d9-4a7b-a94e-910006223a01 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:48.098901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de12b1-f2d9-4a7b-a94e-910006223a01 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:48.099280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de12b1-f2d9-4a7b-a94e-910006223a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:48.135570 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c8de12b1-f2d9-4a7b-a94e-910006223a01 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:48.141770 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c8de12b1-f2d9-4a7b-a94e-910006223a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:48.155889 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 936/1857] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:48.156207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d34c-bf34-41a1-85a8-2f69e39735e4 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:48.162083 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de12b1-f2d9-4a7b-a94e-910006223a01 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:48.169692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf161d2-020e-446e-aa92-048197f0c149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:48.170818 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf161d2-020e-446e-aa92-048197f0c149 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:48.171265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf161d2-020e-446e-aa92-048197f0c149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:48.171738 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf161d2-020e-446e-aa92-048197f0c149 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:48.174832 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf161d2-020e-446e-aa92-048197f0c149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:48.177142 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf161d2-020e-446e-aa92-048197f0c149 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:48.183137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de12b1-f2d9-4a7b-a94e-910006223a01 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:48.198746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1bc6b-b273-4812-9ff9-0d4974e1f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:48.198746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1bc6b-b273-4812-9ff9-0d4974e1f971 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:48.198746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1bc6b-b273-4812-9ff9-0d4974e1f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:48.199916 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1bc6b-b273-4812-9ff9-0d4974e1f971 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:48.199916 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1bc6b-b273-4812-9ff9-0d4974e1f971 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:48.199916 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1bc6b-b273-4812-9ff9-0d4974e1f971 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:48.202308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1bc6b-b273-4812-9ff9-0d4974e1f971 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:48.226138 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 937/1858] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:00:48.232078 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1bc6b-b273-4812-9ff9-0d4974e1f971 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:48.245662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1bc6b-b273-4812-9ff9-0d4974e1f971 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:48.260859 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3b54d-ec47-4921-adc7-9e912c887a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:48.263827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3b54d-ec47-4921-adc7-9e912c887a37 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:48.263827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3b54d-ec47-4921-adc7-9e912c887a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:48.263827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3b54d-ec47-4921-adc7-9e912c887a37 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:48.264934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3b54d-ec47-4921-adc7-9e912c887a37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:48.269186 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3b54d-ec47-4921-adc7-9e912c887a37 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:48.282693 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 922/1859] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:48 2022] POST /identity/v3/users => generated 302 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:00:48.285303 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf161d2-020e-446e-aa92-048197f0c149 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:48.296554 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf161d2-020e-446e-aa92-048197f0c149 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:48.302380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70931074-8b28-43d0-8029-b72c078c1a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:48.307964 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70931074-8b28-43d0-8029-b72c078c1a92 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:48.307964 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70931074-8b28-43d0-8029-b72c078c1a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:48.307964 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70931074-8b28-43d0-8029-b72c078c1a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:48.307964 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70931074-8b28-43d0-8029-b72c078c1a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:48.307964 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70931074-8b28-43d0-8029-b72c078c1a92 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:48.318735 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 923/1860] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:48.324811 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70931074-8b28-43d0-8029-b72c078c1a92 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:48.339933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70931074-8b28-43d0-8029-b72c078c1a92 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:48.346630 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b0801-b0ba-4920-9d85-1ff4ef240115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:48.347877 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b0801-b0ba-4920-9d85-1ff4ef240115 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:48.348161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b0801-b0ba-4920-9d85-1ff4ef240115 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:48.348436 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b0801-b0ba-4920-9d85-1ff4ef240115 admin admin] PATH_INFO: `/v3/projects/01070cb9907e49bfad98932e4afd3928/users/4b48ff00f6a4493d804d37f6f4f8949a/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:48.370971 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b0801-b0ba-4920-9d85-1ff4ef240115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01070cb9907e49bfad98932e4afd3928, user_id=4b48ff00f6a4493d804d37f6f4f8949a, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:48.373946 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b0801-b0ba-4920-9d85-1ff4ef240115 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:48.388452 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 938/1861] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:48 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:00:48.394171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3b54d-ec47-4921-adc7-9e912c887a37 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:48.470594 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3b54d-ec47-4921-adc7-9e912c887a37 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:48.476038 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e7f02-a47f-4a21-84cd-69d95fdc441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:48.477003 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e7f02-a47f-4a21-84cd-69d95fdc441c admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:48.477285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e7f02-a47f-4a21-84cd-69d95fdc441c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:48.478138 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e7f02-a47f-4a21-84cd-69d95fdc441c admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:48.478851 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e7f02-a47f-4a21-84cd-69d95fdc441c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:48.481451 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e7f02-a47f-4a21-84cd-69d95fdc441c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:48.483579 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 924/1862] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:48 2022] PUT /identity/v3/projects/01070cb9907e49bfad98932e4afd3928/users/4b48ff00f6a4493d804d37f6f4f8949a/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:48.487451 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b0801-b0ba-4920-9d85-1ff4ef240115 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:48.570644 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 939/1863] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:48 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:48.572342 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e7f02-a47f-4a21-84cd-69d95fdc441c admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:48.574841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c16e7f02-a47f-4a21-84cd-69d95fdc441c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:48.585492 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b0801-b0ba-4920-9d85-1ff4ef240115 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:48.589754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e7f02-a47f-4a21-84cd-69d95fdc441c admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:48.591310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875a46a-9c59-4b37-af59-d71aaa183b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:48.592032 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875a46a-9c59-4b37-af59-d71aaa183b53 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:48.592388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875a46a-9c59-4b37-af59-d71aaa183b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:48.592830 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875a46a-9c59-4b37-af59-d71aaa183b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:48.593675 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875a46a-9c59-4b37-af59-d71aaa183b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:48.595424 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875a46a-9c59-4b37-af59-d71aaa183b53 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:48.596062 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a085f5-df29-4bbe-b4a6-f3bc2cc60152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:48.597204 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a085f5-df29-4bbe-b4a6-f3bc2cc60152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:48.597705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a085f5-df29-4bbe-b4a6-f3bc2cc60152 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:48.598799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a085f5-df29-4bbe-b4a6-f3bc2cc60152 admin admin] PATH_INFO: `/v3/projects/52b9acfe4c794dac9f25a6c360e9e5fb` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:48.600236 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a085f5-df29-4bbe-b4a6-f3bc2cc60152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b9acfe4c794dac9f25a6c360e9e5fb)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:48.603399 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a085f5-df29-4bbe-b4a6-f3bc2cc60152 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:48.607291 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 925/1864] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:48.608224 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875a46a-9c59-4b37-af59-d71aaa183b53 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:48.622678 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875a46a-9c59-4b37-af59-d71aaa183b53 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:48.627983 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247c478-2878-44fa-8b93-afff567da35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:48.628663 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247c478-2878-44fa-8b93-afff567da35c admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:48.628953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247c478-2878-44fa-8b93-afff567da35c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:48.629280 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247c478-2878-44fa-8b93-afff567da35c admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:48.630014 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247c478-2878-44fa-8b93-afff567da35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:48.631790 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247c478-2878-44fa-8b93-afff567da35c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:48.656980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 926/1865] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:48.657946 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247c478-2878-44fa-8b93-afff567da35c admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:48.678409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247c478-2878-44fa-8b93-afff567da35c admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:48.687946 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc9664-704e-422c-ba13-8f1669eee652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:48.688894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc9664-704e-422c-ba13-8f1669eee652 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:48.689155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc9664-704e-422c-ba13-8f1669eee652 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:48.689437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc9664-704e-422c-ba13-8f1669eee652 admin admin] PATH_INFO: `/v3/projects/01070cb9907e49bfad98932e4afd3928/users/4b48ff00f6a4493d804d37f6f4f8949a/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:48.691802 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc9664-704e-422c-ba13-8f1669eee652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01070cb9907e49bfad98932e4afd3928, user_id=4b48ff00f6a4493d804d37f6f4f8949a, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:48.695723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc9664-704e-422c-ba13-8f1669eee652 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:48.739045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 927/1866] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:48 2022] PUT /identity/v3/projects/01070cb9907e49bfad98932e4afd3928/users/4b48ff00f6a4493d804d37f6f4f8949a/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:48.739045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc9664-704e-422c-ba13-8f1669eee652 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:48.756113 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-72a085f5-df29-4bbe-b4a6-f3bc2cc60152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b9acfe4c794dac9f25a6c360e9e5fb', 'request_id': 'req-72a085f5-df29-4bbe-b4a6-f3bc2cc60152'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:48.778926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-72a085f5-df29-4bbe-b4a6-f3bc2cc60152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b9acfe4c794dac9f25a6c360e9e5fb', 'request_id': 'req-72a085f5-df29-4bbe-b4a6-f3bc2cc60152'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:48.817048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc9664-704e-422c-ba13-8f1669eee652 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:48.873875 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e5db5-482d-465a-8749-f4d548c3a4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:48.874599 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e5db5-482d-465a-8749-f4d548c3a4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:48.875248 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e5db5-482d-465a-8749-f4d548c3a4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:48.875248 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e5db5-482d-465a-8749-f4d548c3a4f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:48.875905 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e5db5-482d-465a-8749-f4d548c3a4f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:48.877501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e5db5-482d-465a-8749-f4d548c3a4f9 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:48.889946 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 928/1867] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:48.889946 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e5db5-482d-465a-8749-f4d548c3a4f9 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:48.892832 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-7e9e5db5-482d-465a-8749-f4d548c3a4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:48.898028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-72a085f5-df29-4bbe-b4a6-f3bc2cc60152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b9acfe4c794dac9f25a6c360e9e5fb', 'request_id': 'req-72a085f5-df29-4bbe-b4a6-f3bc2cc60152'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:48.905641 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e5db5-482d-465a-8749-f4d548c3a4f9 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:48.910564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c26ea-eadf-4f4b-b4cd-240f8f52eedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:48.911339 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-72a085f5-df29-4bbe-b4a6-f3bc2cc60152 admin admin] The token cache is being invalidate because project 52b9acfe4c794dac9f25a6c360e9e5fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:48.911581 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c26ea-eadf-4f4b-b4cd-240f8f52eedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:48.911706 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-72a085f5-df29-4bbe-b4a6-f3bc2cc60152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:48.911865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c26ea-eadf-4f4b-b4cd-240f8f52eedb admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:48.912144 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c26ea-eadf-4f4b-b4cd-240f8f52eedb admin admin] PATH_INFO: `/v3/users/45770b9d477447a2995e832052e9fa23` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:48.912380 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-72a085f5-df29-4bbe-b4a6-f3bc2cc60152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:48.913369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c26ea-eadf-4f4b-b4cd-240f8f52eedb admin admin] RBAC: Authorizing `identity:delete_user(user_id=45770b9d477447a2995e832052e9fa23)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:48.914313 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 940/1868] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:48 2022] DELETE /identity/v3/projects/52b9acfe4c794dac9f25a6c360e9e5fb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:48.916116 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b4185-ea2a-4505-bd43-890677b32f24 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:48.916416 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b4185-ea2a-4505-bd43-890677b32f24 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:48.918050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b4185-ea2a-4505-bd43-890677b32f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:48.919705 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c26ea-eadf-4f4b-b4cd-240f8f52eedb admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:48.948939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c04b4185-ea2a-4505-bd43-890677b32f24 None None] MFA Rules not processed for user `4b48ff00f6a4493d804d37f6f4f8949a`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:48.950273 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c04b4185-ea2a-4505-bd43-890677b32f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:49.030381 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 941/1869] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:49.031439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b4185-ea2a-4505-bd43-890677b32f24 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:49.032826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c04b4185-ea2a-4505-bd43-890677b32f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:49.048438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b4185-ea2a-4505-bd43-890677b32f24 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:49.053240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57111183-2fce-4789-84c2-8433d3f17e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:49.054210 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57111183-2fce-4789-84c2-8433d3f17e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:49.054408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57111183-2fce-4789-84c2-8433d3f17e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:49.054691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57111183-2fce-4789-84c2-8433d3f17e15 admin admin] PATH_INFO: `/v3/projects/aa74b29e5d4a4fe19382ca2a2294ef46/users/e7c4d46e697d48948ac8439d29dc8f71/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:49.071184 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57111183-2fce-4789-84c2-8433d3f17e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa74b29e5d4a4fe19382ca2a2294ef46, user_id=e7c4d46e697d48948ac8439d29dc8f71, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:49.075755 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57111183-2fce-4789-84c2-8433d3f17e15 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:49.175773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6b2c26ea-eadf-4f4b-b4cd-240f8f52eedb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45770b9d477447a2995e832052e9fa23'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:49.176453 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6b2c26ea-eadf-4f4b-b4cd-240f8f52eedb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45770b9d477447a2995e832052e9fa23'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:49.197172 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 942/1870] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:49 2022] PUT /identity/v3/projects/aa74b29e5d4a4fe19382ca2a2294ef46/users/e7c4d46e697d48948ac8439d29dc8f71/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:49.198861 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2a9ce-11a9-4850-a63e-0c4663639adb None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:49.198861 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2a9ce-11a9-4850-a63e-0c4663639adb None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:49.199101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2a9ce-11a9-4850-a63e-0c4663639adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:49.217429 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-efd2a9ce-11a9-4850-a63e-0c4663639adb None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:49.218785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-efd2a9ce-11a9-4850-a63e-0c4663639adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:49.249197 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6b2c26ea-eadf-4f4b-b4cd-240f8f52eedb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45770b9d477447a2995e832052e9fa23'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:49.263409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6b2c26ea-eadf-4f4b-b4cd-240f8f52eedb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45770b9d477447a2995e832052e9fa23'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:49.271033 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6b2c26ea-eadf-4f4b-b4cd-240f8f52eedb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45770b9d477447a2995e832052e9fa23'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:49.277919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 929/1871] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:48 2022] DELETE /identity/v3/users/45770b9d477447a2995e832052e9fa23 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:49.278868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c26ea-eadf-4f4b-b4cd-240f8f52eedb admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:49.282033 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-6b2c26ea-eadf-4f4b-b4cd-240f8f52eedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:49.283258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 943/1872] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:49.285472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27c010-94dc-4441-89a4-756cb4708570 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:49.285864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27c010-94dc-4441-89a4-756cb4708570 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:49.286338 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27c010-94dc-4441-89a4-756cb4708570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:49.314394 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-da27c010-94dc-4441-89a4-756cb4708570 None None] MFA Rules not processed for user `e7c4d46e697d48948ac8439d29dc8f71`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:49.315643 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-da27c010-94dc-4441-89a4-756cb4708570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:49.348497 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c26ea-eadf-4f4b-b4cd-240f8f52eedb admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:49.354311 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc195b-3a52-4f4f-afed-903ea10acdf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:49.354977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc195b-3a52-4f4f-afed-903ea10acdf2 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:49.355263 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc195b-3a52-4f4f-afed-903ea10acdf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:49.355566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc195b-3a52-4f4f-afed-903ea10acdf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:49.358887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f0fc195b-3a52-4f4f-afed-903ea10acdf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:49.396728 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 944/1873] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:49.398094 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2316fe-ed2b-4ab2-bdf5-1e3cdf82153b None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:49.399974 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2316fe-ed2b-4ab2-bdf5-1e3cdf82153b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:49.399974 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2316fe-ed2b-4ab2-bdf5-1e3cdf82153b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:49.424652 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-ba2316fe-ed2b-4ab2-bdf5-1e3cdf82153b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:49.427189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-ba2316fe-ed2b-4ab2-bdf5-1e3cdf82153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:49.444120 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc195b-3a52-4f4f-afed-903ea10acdf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:49.445551 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc195b-3a52-4f4f-afed-903ea10acdf2 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:49.455771 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 930/1874] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:49.457327 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3828d1d-0891-4d42-b04a-e80bacf83cd6 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:49.457906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3828d1d-0891-4d42-b04a-e80bacf83cd6 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:49.458291 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3828d1d-0891-4d42-b04a-e80bacf83cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:49.478172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-d3828d1d-0891-4d42-b04a-e80bacf83cd6 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:49.479796 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d3828d1d-0891-4d42-b04a-e80bacf83cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:49.493600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 945/1875] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:49.494599 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2316fe-ed2b-4ab2-bdf5-1e3cdf82153b None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:49.496115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-ba2316fe-ed2b-4ab2-bdf5-1e3cdf82153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:49.510259 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2316fe-ed2b-4ab2-bdf5-1e3cdf82153b None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:49.521701 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b1e85-63f0-4f79-97da-ea48ea303064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:49.522562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b1e85-63f0-4f79-97da-ea48ea303064 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:49.522844 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b1e85-63f0-4f79-97da-ea48ea303064 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:49.523108 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b1e85-63f0-4f79-97da-ea48ea303064 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:49.526346 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b1e85-63f0-4f79-97da-ea48ea303064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:49.535973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b1e85-63f0-4f79-97da-ea48ea303064 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:49.574141 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 931/1876] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:49.575364 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3828d1d-0891-4d42-b04a-e80bacf83cd6 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:49.576674 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d3828d1d-0891-4d42-b04a-e80bacf83cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:49.636995 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3828d1d-0891-4d42-b04a-e80bacf83cd6 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:49.640787 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45840445-e86b-4477-a2a4-0e4d45255b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:49.641503 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45840445-e86b-4477-a2a4-0e4d45255b4b service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:49.641803 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45840445-e86b-4477-a2a4-0e4d45255b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:49.644884 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45840445-e86b-4477-a2a4-0e4d45255b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:49.652444 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45840445-e86b-4477-a2a4-0e4d45255b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:49.653895 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45840445-e86b-4477-a2a4-0e4d45255b4b service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:49.663821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 932/1877] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:49.664717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45840445-e86b-4477-a2a4-0e4d45255b4b service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:49.671920 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 946/1878] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:49 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:49.672671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b1e85-63f0-4f79-97da-ea48ea303064 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:49.677476 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45840445-e86b-4477-a2a4-0e4d45255b4b service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:49.730453 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd77bba-29b1-4dda-bb54-05103e4eb5ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:49.731242 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd77bba-29b1-4dda-bb54-05103e4eb5ee service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:49.731441 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd77bba-29b1-4dda-bb54-05103e4eb5ee service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:49.731729 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd77bba-29b1-4dda-bb54-05103e4eb5ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:49.733808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ffd77bba-29b1-4dda-bb54-05103e4eb5ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:49.738733 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b1e85-63f0-4f79-97da-ea48ea303064 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:49.743688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099725a3-8ef9-4ace-9d4b-40080c3687a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:49.744997 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099725a3-8ef9-4ace-9d4b-40080c3687a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:49.744997 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099725a3-8ef9-4ace-9d4b-40080c3687a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:49.744997 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099725a3-8ef9-4ace-9d4b-40080c3687a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:49.745615 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099725a3-8ef9-4ace-9d4b-40080c3687a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:49.745926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099725a3-8ef9-4ace-9d4b-40080c3687a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:49.747598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099725a3-8ef9-4ace-9d4b-40080c3687a2 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:49.759957 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 947/1879] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:49.760669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099725a3-8ef9-4ace-9d4b-40080c3687a2 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:49.770338 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099725a3-8ef9-4ace-9d4b-40080c3687a2 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:49.775935 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044930f9-40df-4dfc-bf30-8bd9fb53edf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:49.776605 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044930f9-40df-4dfc-bf30-8bd9fb53edf0 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:49.776887 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044930f9-40df-4dfc-bf30-8bd9fb53edf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:49.777161 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044930f9-40df-4dfc-bf30-8bd9fb53edf0 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:49.777875 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044930f9-40df-4dfc-bf30-8bd9fb53edf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:49.779864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044930f9-40df-4dfc-bf30-8bd9fb53edf0 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:49.799282 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd77bba-29b1-4dda-bb54-05103e4eb5ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:49.800869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd77bba-29b1-4dda-bb54-05103e4eb5ee service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:49.810534 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 933/1880] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:49.811374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd77bba-29b1-4dda-bb54-05103e4eb5ee service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:49.823172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd77bba-29b1-4dda-bb54-05103e4eb5ee service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:49.831364 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc845d-cd98-4524-a31e-6704c30abc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:49.832135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc845d-cd98-4524-a31e-6704c30abc3d admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:49.832479 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc845d-cd98-4524-a31e-6704c30abc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:49.832820 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc845d-cd98-4524-a31e-6704c30abc3d admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:49.833607 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc845d-cd98-4524-a31e-6704c30abc3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:49.835717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc845d-cd98-4524-a31e-6704c30abc3d admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:49.860660 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 948/1881] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:49 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:49.864456 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044930f9-40df-4dfc-bf30-8bd9fb53edf0 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:49.877906 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044930f9-40df-4dfc-bf30-8bd9fb53edf0 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:49.883094 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56695a0-4b8c-4a64-93f5-e4bb435eadb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:49.884430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56695a0-4b8c-4a64-93f5-e4bb435eadb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:49.885022 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56695a0-4b8c-4a64-93f5-e4bb435eadb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:49.885022 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56695a0-4b8c-4a64-93f5-e4bb435eadb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:49.885836 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56695a0-4b8c-4a64-93f5-e4bb435eadb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:49.887439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56695a0-4b8c-4a64-93f5-e4bb435eadb9 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:49.922965 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 949/1882] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:00:49.923794 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56695a0-4b8c-4a64-93f5-e4bb435eadb9 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:49.939299 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 934/1883] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:49 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:49.944004 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56695a0-4b8c-4a64-93f5-e4bb435eadb9 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:49.954962 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc845d-cd98-4524-a31e-6704c30abc3d admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:50.031416 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f33bf-1bfd-423c-817b-644dbc237352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:50.032467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f33bf-1bfd-423c-817b-644dbc237352 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:50.033523 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f33bf-1bfd-423c-817b-644dbc237352 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:50.034128 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f33bf-1bfd-423c-817b-644dbc237352 admin admin] PATH_INFO: `/v3/projects/9cf542efb37649af86f1831f6274f094/users/29968b3bd55e4fb8a59e1bd92743eecf/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:50.057819 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f33bf-1bfd-423c-817b-644dbc237352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf542efb37649af86f1831f6274f094, user_id=29968b3bd55e4fb8a59e1bd92743eecf, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:50.060694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f33bf-1bfd-423c-817b-644dbc237352 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:50.070085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc845d-cd98-4524-a31e-6704c30abc3d admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:50.076552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4c1ce-53d7-496b-a116-2b409fdc9bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:50.077308 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4c1ce-53d7-496b-a116-2b409fdc9bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:50.077659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4c1ce-53d7-496b-a116-2b409fdc9bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:50.078025 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4c1ce-53d7-496b-a116-2b409fdc9bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:50.078789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4c1ce-53d7-496b-a116-2b409fdc9bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:50.081148 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4c1ce-53d7-496b-a116-2b409fdc9bb3 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:50.143539 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 950/1884] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:49 2022] PUT /identity/v3/projects/9cf542efb37649af86f1831f6274f094/users/29968b3bd55e4fb8a59e1bd92743eecf/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:50.147159 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f33bf-1bfd-423c-817b-644dbc237352 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:50.200742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 935/1885] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:49 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:50.204481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4c1ce-53d7-496b-a116-2b409fdc9bb3 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:50.224610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4c1ce-53d7-496b-a116-2b409fdc9bb3 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:50.240226 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f33bf-1bfd-423c-817b-644dbc237352 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:50.252941 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c0f0c-7b80-43a4-9f2b-bb2ebef7dfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:50.253758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0f0c-7b80-43a4-9f2b-bb2ebef7dfdf admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:50.254072 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0f0c-7b80-43a4-9f2b-bb2ebef7dfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:50.254348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0f0c-7b80-43a4-9f2b-bb2ebef7dfdf admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:50.255136 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c0f0c-7b80-43a4-9f2b-bb2ebef7dfdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:50.256916 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c0f0c-7b80-43a4-9f2b-bb2ebef7dfdf admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:50.270504 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 951/1886] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:00:50.271499 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c0f0c-7b80-43a4-9f2b-bb2ebef7dfdf admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:50.275043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3b2c0f0c-7b80-43a4-9f2b-bb2ebef7dfdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:50.294538 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c0f0c-7b80-43a4-9f2b-bb2ebef7dfdf admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:50.299336 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211975d-b1bd-48c7-babc-4962de109d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:50.300147 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211975d-b1bd-48c7-babc-4962de109d15 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:50.300439 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211975d-b1bd-48c7-babc-4962de109d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:50.300712 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211975d-b1bd-48c7-babc-4962de109d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:50.300919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:50.302018 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211975d-b1bd-48c7-babc-4962de109d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:50.303724 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211975d-b1bd-48c7-babc-4962de109d15 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:50.304485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:50.304994 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:50.305257 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2 admin admin] PATH_INFO: `/v3/projects/19bd35e2fcc24b2983b30d85b718cf46` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:50.307568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19bd35e2fcc24b2983b30d85b718cf46)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:50.310173 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:50.319557 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 936/1887] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:50.319557 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211975d-b1bd-48c7-babc-4962de109d15 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:50.332082 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211975d-b1bd-48c7-babc-4962de109d15 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:50.338022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd319326-e1a4-412c-8401-8d1acd381887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:50.338022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd319326-e1a4-412c-8401-8d1acd381887 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:50.338235 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd319326-e1a4-412c-8401-8d1acd381887 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:50.338521 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd319326-e1a4-412c-8401-8d1acd381887 admin admin] PATH_INFO: `/v3/projects/9cf542efb37649af86f1831f6274f094/users/29968b3bd55e4fb8a59e1bd92743eecf/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:50.340651 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd319326-e1a4-412c-8401-8d1acd381887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf542efb37649af86f1831f6274f094, user_id=29968b3bd55e4fb8a59e1bd92743eecf, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:50.343450 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd319326-e1a4-412c-8401-8d1acd381887 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:50.356084 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 937/1888] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:50 2022] PUT /identity/v3/projects/9cf542efb37649af86f1831f6274f094/users/29968b3bd55e4fb8a59e1bd92743eecf/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:50.356880 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd319326-e1a4-412c-8401-8d1acd381887 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:50.427964 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd319326-e1a4-412c-8401-8d1acd381887 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:50.433406 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f842ecb-87c0-4844-9ed1-66549dbdb080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:50.434083 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f842ecb-87c0-4844-9ed1-66549dbdb080 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:50.434363 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f842ecb-87c0-4844-9ed1-66549dbdb080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:50.434639 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f842ecb-87c0-4844-9ed1-66549dbdb080 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:50.435368 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f842ecb-87c0-4844-9ed1-66549dbdb080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:50.437127 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f842ecb-87c0-4844-9ed1-66549dbdb080 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:50.447242 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 938/1889] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:50.448447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4faf-75fb-4137-a3b1-00f5aa12be40 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:50.448734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4faf-75fb-4137-a3b1-00f5aa12be40 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:50.449012 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c4faf-75fb-4137-a3b1-00f5aa12be40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:50.473988 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-407c4faf-75fb-4137-a3b1-00f5aa12be40 None None] MFA Rules not processed for user `29968b3bd55e4fb8a59e1bd92743eecf`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:50.475193 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-407c4faf-75fb-4137-a3b1-00f5aa12be40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:50.476631 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19bd35e2fcc24b2983b30d85b718cf46', 'request_id': 'req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:50.483895 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19bd35e2fcc24b2983b30d85b718cf46', 'request_id': 'req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:50.550920 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 939/1890] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:50.551848 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c4faf-75fb-4137-a3b1-00f5aa12be40 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:50.563971 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19bd35e2fcc24b2983b30d85b718cf46', 'request_id': 'req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:50.579573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2 admin admin] The token cache is being invalidate because project 19bd35e2fcc24b2983b30d85b718cf46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:50.579896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:50.580617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:50.582469 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 952/1891] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:50 2022] DELETE /identity/v3/projects/19bd35e2fcc24b2983b30d85b718cf46 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:50.586639 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:50.588281 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:50.637394 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c4faf-75fb-4137-a3b1-00f5aa12be40 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:50.642144 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4a624-194e-4a91-9b01-395335192e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:50.643087 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4a624-194e-4a91-9b01-395335192e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:50.643369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4a624-194e-4a91-9b01-395335192e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:50.643674 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4a624-194e-4a91-9b01-395335192e3f admin admin] PATH_INFO: `/v3/projects/bf52673cd17044d7a2087b757d0c631e/users/65a1500774e44fffa6ae90e0d37aa067/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:50.659422 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4a624-194e-4a91-9b01-395335192e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf52673cd17044d7a2087b757d0c631e, user_id=65a1500774e44fffa6ae90e0d37aa067, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:50.662182 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4a624-194e-4a91-9b01-395335192e3f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:50.666065 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1a965-3dc6-42b0-9e69-5e962cb1f5d2 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:50.671026 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c2c5-7cbd-417a-bb6f-c0519faab9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:50.671966 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c2c5-7cbd-417a-bb6f-c0519faab9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:50.672240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c2c5-7cbd-417a-bb6f-c0519faab9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:50.672510 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c2c5-7cbd-417a-bb6f-c0519faab9f0 admin admin] PATH_INFO: `/v3/users/b6f188789358401f996f36985863a373` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:50.673727 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3c2c5-7cbd-417a-bb6f-c0519faab9f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f188789358401f996f36985863a373)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:50.675764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3c2c5-7cbd-417a-bb6f-c0519faab9f0 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:50.796797 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 940/1892] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:50 2022] PUT /identity/v3/projects/bf52673cd17044d7a2087b757d0c631e/users/65a1500774e44fffa6ae90e0d37aa067/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:50.797549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4a624-194e-4a91-9b01-395335192e3f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:50.799125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f3f4a624-194e-4a91-9b01-395335192e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:50.858658 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4a624-194e-4a91-9b01-395335192e3f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:50.862640 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4818d8-7990-46d6-bb41-87d5b843330d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:50.863295 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4818d8-7990-46d6-bb41-87d5b843330d service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:50.863622 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4818d8-7990-46d6-bb41-87d5b843330d service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:50.863884 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4818d8-7990-46d6-bb41-87d5b843330d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:50.867175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-7a4818d8-7990-46d6-bb41-87d5b843330d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:50.923453 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4818d8-7990-46d6-bb41-87d5b843330d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:50.924913 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4818d8-7990-46d6-bb41-87d5b843330d service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:50.933473 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 941/1893] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:50.934711 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7191d0-56ac-4b3e-9f16-bdede8933caf None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:50.935000 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7191d0-56ac-4b3e-9f16-bdede8933caf None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:50.935276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7191d0-56ac-4b3e-9f16-bdede8933caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:50.950360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-d4f3c2c5-7cbd-417a-bb6f-c0519faab9f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f188789358401f996f36985863a373'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:50.951114 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-d4f3c2c5-7cbd-417a-bb6f-c0519faab9f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f188789358401f996f36985863a373'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:50.957980 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-d4f3c2c5-7cbd-417a-bb6f-c0519faab9f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f188789358401f996f36985863a373'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:50.963016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-dd7191d0-56ac-4b3e-9f16-bdede8933caf None None] MFA Rules not processed for user `65a1500774e44fffa6ae90e0d37aa067`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:50.964415 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-dd7191d0-56ac-4b3e-9f16-bdede8933caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:51.029715 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 942/1894] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:51.031545 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-d4f3c2c5-7cbd-417a-bb6f-c0519faab9f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f188789358401f996f36985863a373'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:51.042179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7191d0-56ac-4b3e-9f16-bdede8933caf None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:51.043574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-dd7191d0-56ac-4b3e-9f16-bdede8933caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:51.047865 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-d4f3c2c5-7cbd-417a-bb6f-c0519faab9f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f188789358401f996f36985863a373'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:51.061034 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 953/1895] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:50 2022] DELETE /identity/v3/users/b6f188789358401f996f36985863a373 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:51.069187 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7191d0-56ac-4b3e-9f16-bdede8933caf None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:51.132162 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddc86c-bddb-48ef-9a1f-78d7e814ea6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:51.132823 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddc86c-bddb-48ef-9a1f-78d7e814ea6f service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:51.133158 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddc86c-bddb-48ef-9a1f-78d7e814ea6f service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:51.133438 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddc86c-bddb-48ef-9a1f-78d7e814ea6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:51.197391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddc86c-bddb-48ef-9a1f-78d7e814ea6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:51.198945 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddc86c-bddb-48ef-9a1f-78d7e814ea6f service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:51.209564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 943/1896] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:00:51.638739 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c2c5-7cbd-417a-bb6f-c0519faab9f0 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:51.640758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d4f3c2c5-7cbd-417a-bb6f-c0519faab9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:51.720001 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c2c5-7cbd-417a-bb6f-c0519faab9f0 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:51.729522 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b3515-fbc7-43db-8054-2e785052e1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:51.731303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3515-fbc7-43db-8054-2e785052e1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:51.731885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3515-fbc7-43db-8054-2e785052e1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:51.732315 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3515-fbc7-43db-8054-2e785052e1bf admin admin] PATH_INFO: `/v3/projects/6363311d9c5548cf8f3af3a1dbb1a73f` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:51.734281 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b3515-fbc7-43db-8054-2e785052e1bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6363311d9c5548cf8f3af3a1dbb1a73f)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:51.736336 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b3515-fbc7-43db-8054-2e785052e1bf admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:51.893701 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-bf4b3515-fbc7-43db-8054-2e785052e1bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6363311d9c5548cf8f3af3a1dbb1a73f', 'request_id': 'req-bf4b3515-fbc7-43db-8054-2e785052e1bf'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:51.900175 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-bf4b3515-fbc7-43db-8054-2e785052e1bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6363311d9c5548cf8f3af3a1dbb1a73f', 'request_id': 'req-bf4b3515-fbc7-43db-8054-2e785052e1bf'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:52.002656 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-bf4b3515-fbc7-43db-8054-2e785052e1bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6363311d9c5548cf8f3af3a1dbb1a73f', 'request_id': 'req-bf4b3515-fbc7-43db-8054-2e785052e1bf'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:52.014528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-bf4b3515-fbc7-43db-8054-2e785052e1bf admin admin] The token cache is being invalidate because project 6363311d9c5548cf8f3af3a1dbb1a73f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:52.014874 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-bf4b3515-fbc7-43db-8054-2e785052e1bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:52.015612 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-bf4b3515-fbc7-43db-8054-2e785052e1bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:52.017165 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 954/1897] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:51 2022] DELETE /identity/v3/projects/6363311d9c5548cf8f3af3a1dbb1a73f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:52.022970 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324d577-334b-44f6-9617-c2049e59e264 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:52.023435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324d577-334b-44f6-9617-c2049e59e264 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:52.023544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324d577-334b-44f6-9617-c2049e59e264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:52.042165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-7324d577-334b-44f6-9617-c2049e59e264 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:52.043414 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-7324d577-334b-44f6-9617-c2049e59e264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:52.110138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 944/1898] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:52.111433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb2b1-615f-4ca5-89d2-9fdbaecb4c4c None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:52.111789 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb2b1-615f-4ca5-89d2-9fdbaecb4c4c None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:52.112112 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb2b1-615f-4ca5-89d2-9fdbaecb4c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:52.133011 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-567bb2b1-615f-4ca5-89d2-9fdbaecb4c4c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:52.134440 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-567bb2b1-615f-4ca5-89d2-9fdbaecb4c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:52.142483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 955/1899] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:52.146816 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324d577-334b-44f6-9617-c2049e59e264 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:52.156725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324d577-334b-44f6-9617-c2049e59e264 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:52.161462 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e94f7-53a4-4aa4-b0be-37e928b6f13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:52.162128 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e94f7-53a4-4aa4-b0be-37e928b6f13b admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:52.162410 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e94f7-53a4-4aa4-b0be-37e928b6f13b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:52.162684 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e94f7-53a4-4aa4-b0be-37e928b6f13b admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:52.163404 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e94f7-53a4-4aa4-b0be-37e928b6f13b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:52.163766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e94f7-53a4-4aa4-b0be-37e928b6f13b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:52.165940 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e94f7-53a4-4aa4-b0be-37e928b6f13b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:52.177409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 945/1900] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:52.182669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb2b1-615f-4ca5-89d2-9fdbaecb4c4c None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:52.192478 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb2b1-615f-4ca5-89d2-9fdbaecb4c4c None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:52.199966 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df976780-e5de-4730-a556-85ef361bb265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:52.200616 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df976780-e5de-4730-a556-85ef361bb265 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:52.200902 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df976780-e5de-4730-a556-85ef361bb265 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:52.201181 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df976780-e5de-4730-a556-85ef361bb265 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:52.201877 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df976780-e5de-4730-a556-85ef361bb265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:52.204038 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df976780-e5de-4730-a556-85ef361bb265 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:52.302472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 956/1901] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:52 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:00:52.306471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e94f7-53a4-4aa4-b0be-37e928b6f13b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:52.319560 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e94f7-53a4-4aa4-b0be-37e928b6f13b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:52.388345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ae590-753e-4702-b17c-d5439a11f849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:52.388345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ae590-753e-4702-b17c-d5439a11f849 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:52.388345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ae590-753e-4702-b17c-d5439a11f849 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:52.388345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ae590-753e-4702-b17c-d5439a11f849 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:52.388673 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ae590-753e-4702-b17c-d5439a11f849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:52.389590 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ae590-753e-4702-b17c-d5439a11f849 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:52.495189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 946/1902] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:52 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:00:52.505741 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df976780-e5de-4730-a556-85ef361bb265 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:52.516137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df976780-e5de-4730-a556-85ef361bb265 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:52.520785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3324d-e56d-4e88-885b-20627274456b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:52.521471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3324d-e56d-4e88-885b-20627274456b admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:52.521750 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3324d-e56d-4e88-885b-20627274456b admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:52.522025 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3324d-e56d-4e88-885b-20627274456b admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:52.522739 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3324d-e56d-4e88-885b-20627274456b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:52.524910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3324d-e56d-4e88-885b-20627274456b admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:52.536067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 957/1903] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:52.547743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ae590-753e-4702-b17c-d5439a11f849 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:52.558108 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ae590-753e-4702-b17c-d5439a11f849 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:52.563083 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a32aca-840f-414a-b770-b1b14116a337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:52.563770 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a32aca-840f-414a-b770-b1b14116a337 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:52.564053 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a32aca-840f-414a-b770-b1b14116a337 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:52.564331 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a32aca-840f-414a-b770-b1b14116a337 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:52.565053 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a32aca-840f-414a-b770-b1b14116a337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:52.566634 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a32aca-840f-414a-b770-b1b14116a337 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:52.577940 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 947/1904] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:52.582176 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3324d-e56d-4e88-885b-20627274456b admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:52.593784 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3324d-e56d-4e88-885b-20627274456b admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:52.598506 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31d818-9a06-4c50-aa6f-d4e5ce49cd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:52.599570 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31d818-9a06-4c50-aa6f-d4e5ce49cd66 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:52.599855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31d818-9a06-4c50-aa6f-d4e5ce49cd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:52.600127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31d818-9a06-4c50-aa6f-d4e5ce49cd66 admin admin] PATH_INFO: `/v3/projects/5b8c884d38fa444f812f67ba99b546e4/users/4017789b8fe848efbf850174c07caf1c/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:52.617409 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31d818-9a06-4c50-aa6f-d4e5ce49cd66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8c884d38fa444f812f67ba99b546e4, user_id=4017789b8fe848efbf850174c07caf1c, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:52.620157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31d818-9a06-4c50-aa6f-d4e5ce49cd66 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:52.683376 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 958/1905] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:52 2022] PUT /identity/v3/projects/5b8c884d38fa444f812f67ba99b546e4/users/4017789b8fe848efbf850174c07caf1c/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:52.693659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe5f2e-5cf8-4215-969b-4fb8466a1dfa None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:52.693945 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe5f2e-5cf8-4215-969b-4fb8466a1dfa None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:52.694224 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe5f2e-5cf8-4215-969b-4fb8466a1dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:52.722323 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-6fbe5f2e-5cf8-4215-969b-4fb8466a1dfa None None] MFA Rules not processed for user `4017789b8fe848efbf850174c07caf1c`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:52.723624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-6fbe5f2e-5cf8-4215-969b-4fb8466a1dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:52.793607 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 948/1906] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:52.799567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31d818-9a06-4c50-aa6f-d4e5ce49cd66 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:52.863560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31d818-9a06-4c50-aa6f-d4e5ce49cd66 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:52.868753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25d29e-e608-4e94-95f0-b7e618732b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:52.869368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25d29e-e608-4e94-95f0-b7e618732b66 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:52.869651 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25d29e-e608-4e94-95f0-b7e618732b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:52.870062 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25d29e-e608-4e94-95f0-b7e618732b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:52.870775 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25d29e-e608-4e94-95f0-b7e618732b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:52.872709 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25d29e-e608-4e94-95f0-b7e618732b66 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:52.970354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 959/1907] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:52 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:52.974408 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe5f2e-5cf8-4215-969b-4fb8466a1dfa None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:52.985545 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe5f2e-5cf8-4215-969b-4fb8466a1dfa None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:53.042179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e594d-0529-44f4-a25d-0361c1b78cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:53.042877 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e594d-0529-44f4-a25d-0361c1b78cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:53.043121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e594d-0529-44f4-a25d-0361c1b78cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:53.043392 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e594d-0529-44f4-a25d-0361c1b78cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:53.044099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e594d-0529-44f4-a25d-0361c1b78cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:53.046066 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e594d-0529-44f4-a25d-0361c1b78cb9 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:53.122684 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 949/1908] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:52 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:53.126645 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25d29e-e608-4e94-95f0-b7e618732b66 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:53.137753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25d29e-e608-4e94-95f0-b7e618732b66 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:53.142559 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc9911-74ce-476a-a1c7-109295f388ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:53.143217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc9911-74ce-476a-a1c7-109295f388ee admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:53.143497 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc9911-74ce-476a-a1c7-109295f388ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:53.143880 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc9911-74ce-476a-a1c7-109295f388ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:53.144596 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc9911-74ce-476a-a1c7-109295f388ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:53.146187 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc9911-74ce-476a-a1c7-109295f388ee admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:53.156551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 960/1909] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:53.160808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e594d-0529-44f4-a25d-0361c1b78cb9 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:53.171432 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e594d-0529-44f4-a25d-0361c1b78cb9 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:53.176387 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a03cc-4fd3-4ba1-9278-b70edc5f1d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:53.177275 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a03cc-4fd3-4ba1-9278-b70edc5f1d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:53.177558 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a03cc-4fd3-4ba1-9278-b70edc5f1d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:53.177836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a03cc-4fd3-4ba1-9278-b70edc5f1d5d admin admin] PATH_INFO: `/v3/projects/29fbf6132bf84ed0a4295a6567dac124/users/b1fd6b133e0b4203b2c89318dacdbd0e/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:53.193595 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a03cc-4fd3-4ba1-9278-b70edc5f1d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29fbf6132bf84ed0a4295a6567dac124, user_id=b1fd6b133e0b4203b2c89318dacdbd0e, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:53.197199 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a03cc-4fd3-4ba1-9278-b70edc5f1d5d admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:53.271405 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 950/1910] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:53 2022] PUT /identity/v3/projects/29fbf6132bf84ed0a4295a6567dac124/users/b1fd6b133e0b4203b2c89318dacdbd0e/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:53.275194 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc9911-74ce-476a-a1c7-109295f388ee admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:53.285112 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc9911-74ce-476a-a1c7-109295f388ee admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:53.339313 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5d73b-a95f-4889-b201-2f3501db0a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:53.340003 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5d73b-a95f-4889-b201-2f3501db0a8f admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:53.340289 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5d73b-a95f-4889-b201-2f3501db0a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:53.340561 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5d73b-a95f-4889-b201-2f3501db0a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:53.341277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5d73b-a95f-4889-b201-2f3501db0a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:53.342933 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5d73b-a95f-4889-b201-2f3501db0a8f admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:53.352698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 961/1911] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:53.356912 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a03cc-4fd3-4ba1-9278-b70edc5f1d5d admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:53.367104 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a03cc-4fd3-4ba1-9278-b70edc5f1d5d admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:53.372325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bb67f-814f-4df0-97d0-f5ae42c47fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:53.373204 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bb67f-814f-4df0-97d0-f5ae42c47fec admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:53.373495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bb67f-814f-4df0-97d0-f5ae42c47fec admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:53.373754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bb67f-814f-4df0-97d0-f5ae42c47fec admin admin] PATH_INFO: `/v3/projects/29fbf6132bf84ed0a4295a6567dac124/users/b1fd6b133e0b4203b2c89318dacdbd0e/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:53.375733 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bb67f-814f-4df0-97d0-f5ae42c47fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=29fbf6132bf84ed0a4295a6567dac124, user_id=b1fd6b133e0b4203b2c89318dacdbd0e, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:53.378406 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bb67f-814f-4df0-97d0-f5ae42c47fec admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:53.388989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 951/1912] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:53 2022] PUT /identity/v3/projects/29fbf6132bf84ed0a4295a6567dac124/users/b1fd6b133e0b4203b2c89318dacdbd0e/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:53.401684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a691056-24b8-42d8-a2cc-f6c930b00da1 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:53.401969 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a691056-24b8-42d8-a2cc-f6c930b00da1 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:53.402250 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a691056-24b8-42d8-a2cc-f6c930b00da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:53.427435 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-8a691056-24b8-42d8-a2cc-f6c930b00da1 None None] MFA Rules not processed for user `b1fd6b133e0b4203b2c89318dacdbd0e`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:53.428666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-8a691056-24b8-42d8-a2cc-f6c930b00da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:53.494803 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 962/1913] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:53.505823 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bb67f-814f-4df0-97d0-f5ae42c47fec admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:53.507495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-727bb67f-814f-4df0-97d0-f5ae42c47fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:53.565254 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bb67f-814f-4df0-97d0-f5ae42c47fec admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:53.569189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf049c1-462f-4977-a99c-3b59a099dbf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:53.569912 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf049c1-462f-4977-a99c-3b59a099dbf8 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:53.570265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf049c1-462f-4977-a99c-3b59a099dbf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:53.570612 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf049c1-462f-4977-a99c-3b59a099dbf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:53.581079 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf049c1-462f-4977-a99c-3b59a099dbf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:53.583661 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf049c1-462f-4977-a99c-3b59a099dbf8 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:53.598671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 952/1914] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:53.627418 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a691056-24b8-42d8-a2cc-f6c930b00da1 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:53.691451 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a691056-24b8-42d8-a2cc-f6c930b00da1 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:53.696576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826cd6f-7947-4ee0-95dc-911b531d70e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:53.697453 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826cd6f-7947-4ee0-95dc-911b531d70e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:53.697755 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826cd6f-7947-4ee0-95dc-911b531d70e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:53.698028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826cd6f-7947-4ee0-95dc-911b531d70e8 admin admin] PATH_INFO: `/v3/users/4017789b8fe848efbf850174c07caf1c` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:53.699239 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826cd6f-7947-4ee0-95dc-911b531d70e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4017789b8fe848efbf850174c07caf1c)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:53.701179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826cd6f-7947-4ee0-95dc-911b531d70e8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:53.941703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6826cd6f-7947-4ee0-95dc-911b531d70e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4017789b8fe848efbf850174c07caf1c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:53.941703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6826cd6f-7947-4ee0-95dc-911b531d70e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4017789b8fe848efbf850174c07caf1c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:53.945544 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6826cd6f-7947-4ee0-95dc-911b531d70e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4017789b8fe848efbf850174c07caf1c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:54.011926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6826cd6f-7947-4ee0-95dc-911b531d70e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4017789b8fe848efbf850174c07caf1c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:54.023779 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6826cd6f-7947-4ee0-95dc-911b531d70e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4017789b8fe848efbf850174c07caf1c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:54.030532 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 963/1915] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:53 2022] DELETE /identity/v3/users/4017789b8fe848efbf850174c07caf1c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:54.035565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51dcc2-5bb9-41b2-a2c1-1b6b30b4fa80 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:54.035859 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51dcc2-5bb9-41b2-a2c1-1b6b30b4fa80 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:54.036132 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51dcc2-5bb9-41b2-a2c1-1b6b30b4fa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:54.053992 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-4b51dcc2-5bb9-41b2-a2c1-1b6b30b4fa80 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:54.055111 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-4b51dcc2-5bb9-41b2-a2c1-1b6b30b4fa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:54.112261 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 953/1916] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:00:54.122101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826cd6f-7947-4ee0-95dc-911b531d70e8 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:54.123684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-6826cd6f-7947-4ee0-95dc-911b531d70e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:54.179147 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826cd6f-7947-4ee0-95dc-911b531d70e8 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:54.183924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c5588-cfe2-4c40-884b-c7eeb3684221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:54.184605 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c5588-cfe2-4c40-884b-c7eeb3684221 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:54.184887 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c5588-cfe2-4c40-884b-c7eeb3684221 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:54.185163 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c5588-cfe2-4c40-884b-c7eeb3684221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:54.199913 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c5588-cfe2-4c40-884b-c7eeb3684221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:54.201409 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c5588-cfe2-4c40-884b-c7eeb3684221 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:54.211126 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 964/1917] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:54.953446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51dcc2-5bb9-41b2-a2c1-1b6b30b4fa80 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:54.959271 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-4b51dcc2-5bb9-41b2-a2c1-1b6b30b4fa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:55.020466 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51dcc2-5bb9-41b2-a2c1-1b6b30b4fa80 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:55.031138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:55.033144 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:55.033437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:55.033710 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5 admin admin] PATH_INFO: `/v3/projects/5b8c884d38fa444f812f67ba99b546e4` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:55.035049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b8c884d38fa444f812f67ba99b546e4)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:55.037063 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:55.176016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b8c884d38fa444f812f67ba99b546e4', 'request_id': 'req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:55.265696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b8c884d38fa444f812f67ba99b546e4', 'request_id': 'req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:55.273317 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b8c884d38fa444f812f67ba99b546e4', 'request_id': 'req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:55.294721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5 admin admin] The token cache is being invalidate because project 5b8c884d38fa444f812f67ba99b546e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:55.295086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:55.295822 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:55.308656 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 954/1918] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:54 2022] DELETE /identity/v3/projects/5b8c884d38fa444f812f67ba99b546e4 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:55.313325 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c5588-cfe2-4c40-884b-c7eeb3684221 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:55.324855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c5588-cfe2-4c40-884b-c7eeb3684221 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:55.397154 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db1144-b5b5-4460-8e02-ef8b11da45f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:55.398046 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db1144-b5b5-4460-8e02-ef8b11da45f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:55.398326 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db1144-b5b5-4460-8e02-ef8b11da45f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:55.398601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db1144-b5b5-4460-8e02-ef8b11da45f7 admin admin] PATH_INFO: `/v3/users/b1fd6b133e0b4203b2c89318dacdbd0e` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:55.400449 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db1144-b5b5-4460-8e02-ef8b11da45f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1fd6b133e0b4203b2c89318dacdbd0e)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:55.402400 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db1144-b5b5-4460-8e02-ef8b11da45f7 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:55.576133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-27db1144-b5b5-4460-8e02-ef8b11da45f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1fd6b133e0b4203b2c89318dacdbd0e'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:55.576892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-27db1144-b5b5-4460-8e02-ef8b11da45f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1fd6b133e0b4203b2c89318dacdbd0e'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:55.583705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-27db1144-b5b5-4460-8e02-ef8b11da45f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1fd6b133e0b4203b2c89318dacdbd0e'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:55.670890 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-27db1144-b5b5-4460-8e02-ef8b11da45f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1fd6b133e0b4203b2c89318dacdbd0e'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:55.683107 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-27db1144-b5b5-4460-8e02-ef8b11da45f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1fd6b133e0b4203b2c89318dacdbd0e'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:55.689114 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 965/1919] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:00:55 2022] DELETE /identity/v3/users/b1fd6b133e0b4203b2c89318dacdbd0e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:56.140363 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:56.141854 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:56.156682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe4029-5bfd-4cbc-9cea-45f997be52b5 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:56.224170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc1bd0-e11d-40b2-becd-07702b28cb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:56.225171 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc1bd0-e11d-40b2-becd-07702b28cb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:56.225522 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc1bd0-e11d-40b2-becd-07702b28cb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:56.226022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc1bd0-e11d-40b2-becd-07702b28cb16 admin admin] PATH_INFO: `/v3/projects/29fbf6132bf84ed0a4295a6567dac124` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:56.227351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc1bd0-e11d-40b2-becd-07702b28cb16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29fbf6132bf84ed0a4295a6567dac124)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:56.229806 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc1bd0-e11d-40b2-becd-07702b28cb16 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:56.382763 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f9dc1bd0-e11d-40b2-becd-07702b28cb16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29fbf6132bf84ed0a4295a6567dac124', 'request_id': 'req-f9dc1bd0-e11d-40b2-becd-07702b28cb16'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:56.444564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f9dc1bd0-e11d-40b2-becd-07702b28cb16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29fbf6132bf84ed0a4295a6567dac124', 'request_id': 'req-f9dc1bd0-e11d-40b2-becd-07702b28cb16'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:56.456163 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f9dc1bd0-e11d-40b2-becd-07702b28cb16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29fbf6132bf84ed0a4295a6567dac124', 'request_id': 'req-f9dc1bd0-e11d-40b2-becd-07702b28cb16'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:56.470686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f9dc1bd0-e11d-40b2-becd-07702b28cb16 admin admin] The token cache is being invalidate because project 29fbf6132bf84ed0a4295a6567dac124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:00:56.471056 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f9dc1bd0-e11d-40b2-becd-07702b28cb16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:56.471816 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f9dc1bd0-e11d-40b2-becd-07702b28cb16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:00:56.474158 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 955/1920] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:00:56 2022] DELETE /identity/v3/projects/29fbf6132bf84ed0a4295a6567dac124 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:56.480399 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df60a3-f5d3-4f86-adce-120cfa34b6b9 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:56.481347 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df60a3-f5d3-4f86-adce-120cfa34b6b9 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:56.481787 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df60a3-f5d3-4f86-adce-120cfa34b6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:56.509343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-d8df60a3-f5d3-4f86-adce-120cfa34b6b9 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:56.509526 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d8df60a3-f5d3-4f86-adce-120cfa34b6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:56.589169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 966/1921] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:56.597376 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b244b-5281-4ee0-a35f-dfc55509ab54 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:56.597668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b244b-5281-4ee0-a35f-dfc55509ab54 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:56.598217 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b244b-5281-4ee0-a35f-dfc55509ab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:56.620762 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-cb2b244b-5281-4ee0-a35f-dfc55509ab54 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:56.626696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-cb2b244b-5281-4ee0-a35f-dfc55509ab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:56.632513 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 956/1922] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:56.637311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df60a3-f5d3-4f86-adce-120cfa34b6b9 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:56.648031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df60a3-f5d3-4f86-adce-120cfa34b6b9 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:56.654005 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778e5b5-bd9e-4b92-aa60-18366b694162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:56.654748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778e5b5-bd9e-4b92-aa60-18366b694162 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:56.655112 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778e5b5-bd9e-4b92-aa60-18366b694162 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:56.655458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778e5b5-bd9e-4b92-aa60-18366b694162 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:56.656288 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778e5b5-bd9e-4b92-aa60-18366b694162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:00:56.656665 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778e5b5-bd9e-4b92-aa60-18366b694162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:56.658591 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778e5b5-bd9e-4b92-aa60-18366b694162 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:56.676679 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 967/1923] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:00:56.682035 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b244b-5281-4ee0-a35f-dfc55509ab54 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:56.691461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b244b-5281-4ee0-a35f-dfc55509ab54 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:56.697016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e110340-acc9-4bff-9ad0-e0dfca650145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:56.698026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e110340-acc9-4bff-9ad0-e0dfca650145 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:56.698026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e110340-acc9-4bff-9ad0-e0dfca650145 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:56.700804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e110340-acc9-4bff-9ad0-e0dfca650145 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:56.700804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e110340-acc9-4bff-9ad0-e0dfca650145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:56.700962 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e110340-acc9-4bff-9ad0-e0dfca650145 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:56.818783 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 957/1924] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:56 2022] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:56.822044 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778e5b5-bd9e-4b92-aa60-18366b694162 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:56.832737 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778e5b5-bd9e-4b92-aa60-18366b694162 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:56.933990 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8051dc8-dbea-4f87-85b9-d2ca6520afc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:56.935238 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8051dc8-dbea-4f87-85b9-d2ca6520afc9 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:56.935786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8051dc8-dbea-4f87-85b9-d2ca6520afc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:56.936304 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8051dc8-dbea-4f87-85b9-d2ca6520afc9 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:56.937711 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8051dc8-dbea-4f87-85b9-d2ca6520afc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:56.941355 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8051dc8-dbea-4f87-85b9-d2ca6520afc9 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:57.070710 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 968/1925] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:56 2022] POST /identity/v3/users => generated 300 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:57.071148 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e110340-acc9-4bff-9ad0-e0dfca650145 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:57.087839 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e110340-acc9-4bff-9ad0-e0dfca650145 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:57.096209 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693497a-40b1-4946-a0ed-5502370eaa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:57.096902 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693497a-40b1-4946-a0ed-5502370eaa2e admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:57.097239 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693497a-40b1-4946-a0ed-5502370eaa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:57.097528 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693497a-40b1-4946-a0ed-5502370eaa2e admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:57.098774 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693497a-40b1-4946-a0ed-5502370eaa2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:57.101619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693497a-40b1-4946-a0ed-5502370eaa2e admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:57.130920 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8051dc8-dbea-4f87-85b9-d2ca6520afc9 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:57.131362 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 958/1926] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:00:57.142845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8051dc8-dbea-4f87-85b9-d2ca6520afc9 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:57.149906 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8c92e-8738-4f45-893b-d07a6f4b9537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:57.150594 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8c92e-8738-4f45-893b-d07a6f4b9537 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:57.151072 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8c92e-8738-4f45-893b-d07a6f4b9537 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:57.151248 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8c92e-8738-4f45-893b-d07a6f4b9537 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:57.152064 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8c92e-8738-4f45-893b-d07a6f4b9537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:57.155243 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8c92e-8738-4f45-893b-d07a6f4b9537 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:57.172345 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 969/1927] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:57.178782 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693497a-40b1-4946-a0ed-5502370eaa2e admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:57.183931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693497a-40b1-4946-a0ed-5502370eaa2e admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:57.188572 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332ebbf-ae72-45da-a520-760e5817ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:57.189521 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332ebbf-ae72-45da-a520-760e5817ea6f admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:57.189770 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332ebbf-ae72-45da-a520-760e5817ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:57.190048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332ebbf-ae72-45da-a520-760e5817ea6f admin admin] PATH_INFO: `/v3/projects/31e57ff44e364e63afcb2b9a516f0576/users/57173519bc3a4569863b8c07ce0393bd/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:57.209672 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332ebbf-ae72-45da-a520-760e5817ea6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e57ff44e364e63afcb2b9a516f0576, user_id=57173519bc3a4569863b8c07ce0393bd, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:57.213400 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332ebbf-ae72-45da-a520-760e5817ea6f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:57.317941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 959/1928] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:57 2022] PUT /identity/v3/projects/31e57ff44e364e63afcb2b9a516f0576/users/57173519bc3a4569863b8c07ce0393bd/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:57.331841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084657de-944f-4413-9d53-cf2301fb2a99 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:57.332843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084657de-944f-4413-9d53-cf2301fb2a99 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:57.333272 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084657de-944f-4413-9d53-cf2301fb2a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:57.412810 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-084657de-944f-4413-9d53-cf2301fb2a99 None None] MFA Rules not processed for user `57173519bc3a4569863b8c07ce0393bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:57.414222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-084657de-944f-4413-9d53-cf2301fb2a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:57.497068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 970/1929] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:57.502189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332ebbf-ae72-45da-a520-760e5817ea6f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:57.595414 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332ebbf-ae72-45da-a520-760e5817ea6f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:57.600247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36499bb6-2934-45ed-b98f-25a5ddae70d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:57.600912 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36499bb6-2934-45ed-b98f-25a5ddae70d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:57.601202 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36499bb6-2934-45ed-b98f-25a5ddae70d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:57.601486 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36499bb6-2934-45ed-b98f-25a5ddae70d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:57.602407 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36499bb6-2934-45ed-b98f-25a5ddae70d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:57.604495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36499bb6-2934-45ed-b98f-25a5ddae70d0 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:57.787107 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 960/1930] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:00:57 2022] POST /identity/v3/projects => generated 399 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:57.791796 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084657de-944f-4413-9d53-cf2301fb2a99 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:57.804838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084657de-944f-4413-9d53-cf2301fb2a99 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:57.888029 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5f980-689c-4813-8bd7-36f7b588de4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:57.888768 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5f980-689c-4813-8bd7-36f7b588de4a admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:57.889053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5f980-689c-4813-8bd7-36f7b588de4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:57.889330 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5f980-689c-4813-8bd7-36f7b588de4a admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:57.890099 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5f980-689c-4813-8bd7-36f7b588de4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:57.892068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5f980-689c-4813-8bd7-36f7b588de4a admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:57.999414 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 971/1931] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:00:57 2022] POST /identity/v3/users => generated 306 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:00:58.003852 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36499bb6-2934-45ed-b98f-25a5ddae70d0 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:58.015654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36499bb6-2934-45ed-b98f-25a5ddae70d0 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:58.021840 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5b78e-7d4c-4493-aa9e-871ea14a071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:58.022593 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5b78e-7d4c-4493-aa9e-871ea14a071a admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:58.022873 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5b78e-7d4c-4493-aa9e-871ea14a071a admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:58.023170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5b78e-7d4c-4493-aa9e-871ea14a071a admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:58.024991 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5b78e-7d4c-4493-aa9e-871ea14a071a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:58.026624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5b78e-7d4c-4493-aa9e-871ea14a071a admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:58.043612 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 961/1932] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:58.048062 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5f980-689c-4813-8bd7-36f7b588de4a admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:58.059138 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5f980-689c-4813-8bd7-36f7b588de4a admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:58.063963 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b11ba-aadc-4fe1-8e11-7ad6a8af77ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:58.064914 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b11ba-aadc-4fe1-8e11-7ad6a8af77ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:58.065191 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b11ba-aadc-4fe1-8e11-7ad6a8af77ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:58.065464 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b11ba-aadc-4fe1-8e11-7ad6a8af77ce admin admin] PATH_INFO: `/v3/projects/67d64220b88c4d84bc764ebf9d29111e/users/e64fc60ab72e497e828602968f4f2d07/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:58.083748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b11ba-aadc-4fe1-8e11-7ad6a8af77ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d64220b88c4d84bc764ebf9d29111e, user_id=e64fc60ab72e497e828602968f4f2d07, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:58.083748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b11ba-aadc-4fe1-8e11-7ad6a8af77ce admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:58.210011 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 972/1933] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:58 2022] PUT /identity/v3/projects/67d64220b88c4d84bc764ebf9d29111e/users/e64fc60ab72e497e828602968f4f2d07/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:58.215655 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5b78e-7d4c-4493-aa9e-871ea14a071a admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:58.226138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5b78e-7d4c-4493-aa9e-871ea14a071a admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:58.285083 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04117fc-deb8-4962-90fd-bbd27cbfcce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:58.285755 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04117fc-deb8-4962-90fd-bbd27cbfcce8 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:58.286043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04117fc-deb8-4962-90fd-bbd27cbfcce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:58.286319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04117fc-deb8-4962-90fd-bbd27cbfcce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:58.287033 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04117fc-deb8-4962-90fd-bbd27cbfcce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:58.288671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04117fc-deb8-4962-90fd-bbd27cbfcce8 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:58.299111 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 962/1934] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:00:58.303385 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b11ba-aadc-4fe1-8e11-7ad6a8af77ce admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:58.314800 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b11ba-aadc-4fe1-8e11-7ad6a8af77ce admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:58.320059 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67629300-5e00-4117-846e-30596972682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:58.320983 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629300-5e00-4117-846e-30596972682d admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:58.321272 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629300-5e00-4117-846e-30596972682d admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:58.321549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629300-5e00-4117-846e-30596972682d admin admin] PATH_INFO: `/v3/projects/67d64220b88c4d84bc764ebf9d29111e/users/e64fc60ab72e497e828602968f4f2d07/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:58.323586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67629300-5e00-4117-846e-30596972682d admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d64220b88c4d84bc764ebf9d29111e, user_id=e64fc60ab72e497e828602968f4f2d07, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:58.326310 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67629300-5e00-4117-846e-30596972682d admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:58.337617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 973/1935] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:00:58 2022] PUT /identity/v3/projects/67d64220b88c4d84bc764ebf9d29111e/users/e64fc60ab72e497e828602968f4f2d07/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:00:58.348963 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75528dd3-b297-445a-8839-5d358c0030a2 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:58.349466 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75528dd3-b297-445a-8839-5d358c0030a2 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:58.349553 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75528dd3-b297-445a-8839-5d358c0030a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:58.377143 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-75528dd3-b297-445a-8839-5d358c0030a2 None None] MFA Rules not processed for user `e64fc60ab72e497e828602968f4f2d07`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:00:58.378402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-75528dd3-b297-445a-8839-5d358c0030a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:58.447664 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 963/1936] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:00:58 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:00:58.458473 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67629300-5e00-4117-846e-30596972682d admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:58.460349 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-67629300-5e00-4117-846e-30596972682d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:00:58.525418 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67629300-5e00-4117-846e-30596972682d admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:58.529198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fad795-a1ed-4568-aff9-9dc82a548d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:58.529899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fad795-a1ed-4568-aff9-9dc82a548d2d service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:58.530188 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fad795-a1ed-4568-aff9-9dc82a548d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:58.530598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fad795-a1ed-4568-aff9-9dc82a548d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:58.541003 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fad795-a1ed-4568-aff9-9dc82a548d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:58.542523 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fad795-a1ed-4568-aff9-9dc82a548d2d service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:58.561713 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 974/1937] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:58 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:00:58.885644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75528dd3-b297-445a-8839-5d358c0030a2 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:00:58.895941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75528dd3-b297-445a-8839-5d358c0030a2 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:00:58.901113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356878fa-ae95-4e56-a105-acac00bdeb9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:00:58.901801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356878fa-ae95-4e56-a105-acac00bdeb9d service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:00:58.902425 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356878fa-ae95-4e56-a105-acac00bdeb9d service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:00:58.902847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356878fa-ae95-4e56-a105-acac00bdeb9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:00:58.964694 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356878fa-ae95-4e56-a105-acac00bdeb9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:00:58.966247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356878fa-ae95-4e56-a105-acac00bdeb9d service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:00:58.975753 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 964/1938] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:00:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:01.342701 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fad795-a1ed-4568-aff9-9dc82a548d2d service cinder] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:01.344781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-b5fad795-a1ed-4568-aff9-9dc82a548d2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:01.414634 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fad795-a1ed-4568-aff9-9dc82a548d2d service cinder] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:01.420679 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c47af0-24d5-4f5b-98ae-fc917dda2d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:01.421793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c47af0-24d5-4f5b-98ae-fc917dda2d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:01.422364 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c47af0-24d5-4f5b-98ae-fc917dda2d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:01.422808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c47af0-24d5-4f5b-98ae-fc917dda2d3e admin admin] PATH_INFO: `/v3/users/7a0bcc85892444fe91a09a1b0e0ff798` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:01.424410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c47af0-24d5-4f5b-98ae-fc917dda2d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a0bcc85892444fe91a09a1b0e0ff798)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:01.426650 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c47af0-24d5-4f5b-98ae-fc917dda2d3e admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:01.647514 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-76c47af0-24d5-4f5b-98ae-fc917dda2d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a0bcc85892444fe91a09a1b0e0ff798'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:01.648247 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-76c47af0-24d5-4f5b-98ae-fc917dda2d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a0bcc85892444fe91a09a1b0e0ff798'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:01.655915 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-76c47af0-24d5-4f5b-98ae-fc917dda2d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a0bcc85892444fe91a09a1b0e0ff798'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:01.679069 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356878fa-ae95-4e56-a105-acac00bdeb9d service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:01.681310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-356878fa-ae95-4e56-a105-acac00bdeb9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:01.692974 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356878fa-ae95-4e56-a105-acac00bdeb9d service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:01.698540 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dff2be-c909-4313-beb0-e6b7bd735a9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:01.699317 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dff2be-c909-4313-beb0-e6b7bd735a9a service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:01.699647 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dff2be-c909-4313-beb0-e6b7bd735a9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:01.699922 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dff2be-c909-4313-beb0-e6b7bd735a9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:01.701785 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-93dff2be-c909-4313-beb0-e6b7bd735a9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:01.739358 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-76c47af0-24d5-4f5b-98ae-fc917dda2d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a0bcc85892444fe91a09a1b0e0ff798'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:01.774586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-76c47af0-24d5-4f5b-98ae-fc917dda2d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a0bcc85892444fe91a09a1b0e0ff798'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:01.788137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 975/1939] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:01 2022] DELETE /identity/v3/users/7a0bcc85892444fe91a09a1b0e0ff798 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:01.790213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209e8cf-2d71-41fe-a927-8d296699229a None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:01.790479 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dff2be-c909-4313-beb0-e6b7bd735a9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:01.790684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209e8cf-2d71-41fe-a927-8d296699229a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:01.791075 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209e8cf-2d71-41fe-a927-8d296699229a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:01.792268 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dff2be-c909-4313-beb0-e6b7bd735a9a service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:01.805474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 965/1940] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:01.810119 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-a209e8cf-2d71-41fe-a927-8d296699229a None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:01.811739 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a209e8cf-2d71-41fe-a927-8d296699229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:01.880903 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 976/1941] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:01.892497 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dff2be-c909-4313-beb0-e6b7bd735a9a service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:01.894152 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-93dff2be-c909-4313-beb0-e6b7bd735a9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:01.968157 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dff2be-c909-4313-beb0-e6b7bd735a9a service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:02.032435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d7d75-575d-4e7c-a32b-56d1015c07ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:02.033221 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d7d75-575d-4e7c-a32b-56d1015c07ec service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:02.033671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d7d75-575d-4e7c-a32b-56d1015c07ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:02.034014 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d7d75-575d-4e7c-a32b-56d1015c07ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:02.044016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d7d75-575d-4e7c-a32b-56d1015c07ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:02.045468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d7d75-575d-4e7c-a32b-56d1015c07ec service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:02.057519 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 966/1942] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:02.524676 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209e8cf-2d71-41fe-a927-8d296699229a None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:02.526405 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a209e8cf-2d71-41fe-a927-8d296699229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:02.538790 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209e8cf-2d71-41fe-a927-8d296699229a None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:02.547543 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27c559-d4f3-4d41-b236-49dae388cf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:02.548769 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27c559-d4f3-4d41-b236-49dae388cf44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:02.549203 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27c559-d4f3-4d41-b236-49dae388cf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:02.549617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27c559-d4f3-4d41-b236-49dae388cf44 admin admin] PATH_INFO: `/v3/projects/e07aae2254984877a60d46bdcf5e8c64` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:02.551133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27c559-d4f3-4d41-b236-49dae388cf44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07aae2254984877a60d46bdcf5e8c64)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:02.553138 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27c559-d4f3-4d41-b236-49dae388cf44 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:02.724711 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-eb27c559-d4f3-4d41-b236-49dae388cf44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07aae2254984877a60d46bdcf5e8c64', 'request_id': 'req-eb27c559-d4f3-4d41-b236-49dae388cf44'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:02.731073 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-eb27c559-d4f3-4d41-b236-49dae388cf44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07aae2254984877a60d46bdcf5e8c64', 'request_id': 'req-eb27c559-d4f3-4d41-b236-49dae388cf44'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:02.813385 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-eb27c559-d4f3-4d41-b236-49dae388cf44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07aae2254984877a60d46bdcf5e8c64', 'request_id': 'req-eb27c559-d4f3-4d41-b236-49dae388cf44'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:02.831006 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-eb27c559-d4f3-4d41-b236-49dae388cf44 admin admin] The token cache is being invalidate because project e07aae2254984877a60d46bdcf5e8c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:02.831455 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-eb27c559-d4f3-4d41-b236-49dae388cf44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:02.832169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-eb27c559-d4f3-4d41-b236-49dae388cf44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:02.837253 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 977/1943] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:02 2022] DELETE /identity/v3/projects/e07aae2254984877a60d46bdcf5e8c64 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:02.838423 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d7d75-575d-4e7c-a32b-56d1015c07ec service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:02.848635 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d7d75-575d-4e7c-a32b-56d1015c07ec service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:02.937831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faeb944-b5ea-465b-b6d8-80451bd4f725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:02.938805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeb944-b5ea-465b-b6d8-80451bd4f725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:02.939186 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeb944-b5ea-465b-b6d8-80451bd4f725 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:02.939593 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeb944-b5ea-465b-b6d8-80451bd4f725 admin admin] PATH_INFO: `/v3/users/4b48ff00f6a4493d804d37f6f4f8949a` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:02.940950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faeb944-b5ea-465b-b6d8-80451bd4f725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b48ff00f6a4493d804d37f6f4f8949a)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:02.943153 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faeb944-b5ea-465b-b6d8-80451bd4f725 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:03.222469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-4faeb944-b5ea-465b-b6d8-80451bd4f725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b48ff00f6a4493d804d37f6f4f8949a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:03.223252 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-4faeb944-b5ea-465b-b6d8-80451bd4f725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b48ff00f6a4493d804d37f6f4f8949a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:03.299004 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-4faeb944-b5ea-465b-b6d8-80451bd4f725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b48ff00f6a4493d804d37f6f4f8949a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:03.312189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-4faeb944-b5ea-465b-b6d8-80451bd4f725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b48ff00f6a4493d804d37f6f4f8949a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:03.318721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-4faeb944-b5ea-465b-b6d8-80451bd4f725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b48ff00f6a4493d804d37f6f4f8949a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:03.324652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 967/1944] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:02 2022] DELETE /identity/v3/users/4b48ff00f6a4493d804d37f6f4f8949a => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:03.787709 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27c559-d4f3-4d41-b236-49dae388cf44 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:03.790128 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-eb27c559-d4f3-4d41-b236-49dae388cf44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:03.821439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27c559-d4f3-4d41-b236-49dae388cf44 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:03.900081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b7d44-9ddf-47be-ab42-7f4795668cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:03.900081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b7d44-9ddf-47be-ab42-7f4795668cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:03.900081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b7d44-9ddf-47be-ab42-7f4795668cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:03.900081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b7d44-9ddf-47be-ab42-7f4795668cc6 admin admin] PATH_INFO: `/v3/projects/01070cb9907e49bfad98932e4afd3928` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:03.900390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b7d44-9ddf-47be-ab42-7f4795668cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01070cb9907e49bfad98932e4afd3928)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:03.900390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b7d44-9ddf-47be-ab42-7f4795668cc6 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:03.999889 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-871b7d44-9ddf-47be-ab42-7f4795668cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01070cb9907e49bfad98932e4afd3928', 'request_id': 'req-871b7d44-9ddf-47be-ab42-7f4795668cc6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:04.006973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-871b7d44-9ddf-47be-ab42-7f4795668cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01070cb9907e49bfad98932e4afd3928', 'request_id': 'req-871b7d44-9ddf-47be-ab42-7f4795668cc6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:04.110528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-871b7d44-9ddf-47be-ab42-7f4795668cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01070cb9907e49bfad98932e4afd3928', 'request_id': 'req-871b7d44-9ddf-47be-ab42-7f4795668cc6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:04.122447 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-871b7d44-9ddf-47be-ab42-7f4795668cc6 admin admin] The token cache is being invalidate because project 01070cb9907e49bfad98932e4afd3928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:04.122756 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-871b7d44-9ddf-47be-ab42-7f4795668cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:04.123813 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-871b7d44-9ddf-47be-ab42-7f4795668cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:04.126453 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 978/1945] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:03 2022] DELETE /identity/v3/projects/01070cb9907e49bfad98932e4afd3928 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:04.135326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65b81-cb24-4195-87ba-de09ade0b268 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:04.135882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65b81-cb24-4195-87ba-de09ade0b268 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:04.136334 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65b81-cb24-4195-87ba-de09ade0b268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:04.158782 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-faf65b81-cb24-4195-87ba-de09ade0b268 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:04.160020 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-faf65b81-cb24-4195-87ba-de09ade0b268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:04.237447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 968/1946] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:04.248444 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886be9-1bdf-43f8-ac20-76290d929ed7 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:04.248762 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886be9-1bdf-43f8-ac20-76290d929ed7 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:04.249006 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886be9-1bdf-43f8-ac20-76290d929ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:04.272483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-69886be9-1bdf-43f8-ac20-76290d929ed7 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:04.274453 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-69886be9-1bdf-43f8-ac20-76290d929ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:04.282683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 979/1947] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:04.287020 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65b81-cb24-4195-87ba-de09ade0b268 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:04.298283 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65b81-cb24-4195-87ba-de09ade0b268 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:04.307957 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e278699-4c61-44c0-af03-17deafc4bf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:04.307957 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e278699-4c61-44c0-af03-17deafc4bf47 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:04.307957 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e278699-4c61-44c0-af03-17deafc4bf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:04.307957 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e278699-4c61-44c0-af03-17deafc4bf47 admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:04.308446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e278699-4c61-44c0-af03-17deafc4bf47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:01:04.308772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e278699-4c61-44c0-af03-17deafc4bf47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:04.310422 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e278699-4c61-44c0-af03-17deafc4bf47 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:04.326873 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 969/1948] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:01:04.330917 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69886be9-1bdf-43f8-ac20-76290d929ed7 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:04.340684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69886be9-1bdf-43f8-ac20-76290d929ed7 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:04.347686 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4d1bc-7b20-4c52-a63c-5628957450bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:04.348583 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4d1bc-7b20-4c52-a63c-5628957450bd admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:04.348970 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4d1bc-7b20-4c52-a63c-5628957450bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:04.349430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4d1bc-7b20-4c52-a63c-5628957450bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:04.350241 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4d1bc-7b20-4c52-a63c-5628957450bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:04.352420 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4d1bc-7b20-4c52-a63c-5628957450bd admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:04.521240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 980/1949] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:01:04 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:04.522584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e278699-4c61-44c0-af03-17deafc4bf47 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:04.533265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e278699-4c61-44c0-af03-17deafc4bf47 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:04.591487 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff80788-201f-47f3-bb88-0e81f90504bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:04.592400 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff80788-201f-47f3-bb88-0e81f90504bc admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:04.592806 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff80788-201f-47f3-bb88-0e81f90504bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:04.593189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff80788-201f-47f3-bb88-0e81f90504bc admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:04.594192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff80788-201f-47f3-bb88-0e81f90504bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:04.597205 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff80788-201f-47f3-bb88-0e81f90504bc admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:04.678194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 970/1950] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:01:04 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:04.687273 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4d1bc-7b20-4c52-a63c-5628957450bd admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:04.702688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4d1bc-7b20-4c52-a63c-5628957450bd admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:04.707414 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f9302-7da5-4bca-b0da-473fb79340e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:04.708118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f9302-7da5-4bca-b0da-473fb79340e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:04.708402 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f9302-7da5-4bca-b0da-473fb79340e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:04.708684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f9302-7da5-4bca-b0da-473fb79340e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:04.709408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f9302-7da5-4bca-b0da-473fb79340e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:04.711358 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f9302-7da5-4bca-b0da-473fb79340e5 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:04.722330 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 981/1951] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:04.726194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff80788-201f-47f3-bb88-0e81f90504bc admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:04.737956 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff80788-201f-47f3-bb88-0e81f90504bc admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:04.745118 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f41d3-7504-4028-8fa5-50af8328255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:04.745118 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f41d3-7504-4028-8fa5-50af8328255c admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:04.745118 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f41d3-7504-4028-8fa5-50af8328255c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:04.745118 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f41d3-7504-4028-8fa5-50af8328255c admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:04.745613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f41d3-7504-4028-8fa5-50af8328255c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:04.747212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f41d3-7504-4028-8fa5-50af8328255c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:04.759750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 971/1952] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:04.762142 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f9302-7da5-4bca-b0da-473fb79340e5 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:04.772744 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f9302-7da5-4bca-b0da-473fb79340e5 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:04.777692 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69c89b-8f7c-4190-ad12-56ff6f75d976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:04.778623 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69c89b-8f7c-4190-ad12-56ff6f75d976 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:04.778856 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69c89b-8f7c-4190-ad12-56ff6f75d976 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:04.779138 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69c89b-8f7c-4190-ad12-56ff6f75d976 admin admin] PATH_INFO: `/v3/projects/af8a06cffbad4366987c151979d70784/users/4d0a622895ed4c608b089f55fd9d6890/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:04.794644 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69c89b-8f7c-4190-ad12-56ff6f75d976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8a06cffbad4366987c151979d70784, user_id=4d0a622895ed4c608b089f55fd9d6890, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:04.797409 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69c89b-8f7c-4190-ad12-56ff6f75d976 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:04.882394 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 982/1953] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:04 2022] PUT /identity/v3/projects/af8a06cffbad4366987c151979d70784/users/4d0a622895ed4c608b089f55fd9d6890/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:01:04.907781 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1b557-98df-4f37-926b-22b80ce808ed None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:04.908148 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1b557-98df-4f37-926b-22b80ce808ed None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:04.908499 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1b557-98df-4f37-926b-22b80ce808ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:04.947382 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-ceb1b557-98df-4f37-926b-22b80ce808ed None None] MFA Rules not processed for user `4d0a622895ed4c608b089f55fd9d6890`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:04.948797 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ceb1b557-98df-4f37-926b-22b80ce808ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:05.019814 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 972/1954] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:05.076577 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69c89b-8f7c-4190-ad12-56ff6f75d976 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:05.076577 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-4a69c89b-8f7c-4190-ad12-56ff6f75d976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:05.130979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69c89b-8f7c-4190-ad12-56ff6f75d976 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:05.135008 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd60f0-937d-41aa-b4b7-949c60a64c7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:05.135716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd60f0-937d-41aa-b4b7-949c60a64c7c service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:05.136004 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd60f0-937d-41aa-b4b7-949c60a64c7c service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:05.136282 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd60f0-937d-41aa-b4b7-949c60a64c7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:05.146144 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd60f0-937d-41aa-b4b7-949c60a64c7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:05.147635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd60f0-937d-41aa-b4b7-949c60a64c7c service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:05.158405 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 983/1955] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:08.262297 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1b557-98df-4f37-926b-22b80ce808ed None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:08.264032 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ceb1b557-98df-4f37-926b-22b80ce808ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:08.331415 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1b557-98df-4f37-926b-22b80ce808ed None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:08.336011 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ae69c-b543-4e0a-be9d-ef5fa5c13ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:08.337045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ae69c-b543-4e0a-be9d-ef5fa5c13ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:08.337424 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ae69c-b543-4e0a-be9d-ef5fa5c13ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:08.337709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ae69c-b543-4e0a-be9d-ef5fa5c13ed2 admin admin] PATH_INFO: `/v3/users/57173519bc3a4569863b8c07ce0393bd` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:08.338909 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ae69c-b543-4e0a-be9d-ef5fa5c13ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57173519bc3a4569863b8c07ce0393bd)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:08.340859 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ae69c-b543-4e0a-be9d-ef5fa5c13ed2 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:08.581571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-110ae69c-b543-4e0a-be9d-ef5fa5c13ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57173519bc3a4569863b8c07ce0393bd'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:08.582235 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-110ae69c-b543-4e0a-be9d-ef5fa5c13ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57173519bc3a4569863b8c07ce0393bd'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:08.658372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-110ae69c-b543-4e0a-be9d-ef5fa5c13ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57173519bc3a4569863b8c07ce0393bd'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:08.671893 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-110ae69c-b543-4e0a-be9d-ef5fa5c13ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57173519bc3a4569863b8c07ce0393bd'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:08.678583 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-110ae69c-b543-4e0a-be9d-ef5fa5c13ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57173519bc3a4569863b8c07ce0393bd'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:08.685374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 973/1956] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:08 2022] DELETE /identity/v3/users/57173519bc3a4569863b8c07ce0393bd => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:08.689842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82ebab-faf6-4e33-ac90-215bd3bac5c1 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:08.690364 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82ebab-faf6-4e33-ac90-215bd3bac5c1 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:08.690562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82ebab-faf6-4e33-ac90-215bd3bac5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:08.708141 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-db82ebab-faf6-4e33-ac90-215bd3bac5c1 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:08.709441 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-db82ebab-faf6-4e33-ac90-215bd3bac5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:08.780128 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 984/1957] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:08.789521 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ae69c-b543-4e0a-be9d-ef5fa5c13ed2 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:08.791016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-110ae69c-b543-4e0a-be9d-ef5fa5c13ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:08.864860 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ae69c-b543-4e0a-be9d-ef5fa5c13ed2 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:08.869382 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa518b-3cd9-4861-abde-0c1548e739d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:08.878345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa518b-3cd9-4861-abde-0c1548e739d4 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:08.878345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa518b-3cd9-4861-abde-0c1548e739d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:08.878345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa518b-3cd9-4861-abde-0c1548e739d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:08.881177 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa518b-3cd9-4861-abde-0c1548e739d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:08.882564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa518b-3cd9-4861-abde-0c1548e739d4 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:08.906660 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 974/1958] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:09.456282 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82ebab-faf6-4e33-ac90-215bd3bac5c1 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:09.457944 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-db82ebab-faf6-4e33-ac90-215bd3bac5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:09.470426 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82ebab-faf6-4e33-ac90-215bd3bac5c1 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:09.475206 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d52e28-a049-4e5a-a267-7cbb42c250c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:09.476107 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d52e28-a049-4e5a-a267-7cbb42c250c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:09.476444 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d52e28-a049-4e5a-a267-7cbb42c250c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:09.476736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d52e28-a049-4e5a-a267-7cbb42c250c8 admin admin] PATH_INFO: `/v3/projects/31e57ff44e364e63afcb2b9a516f0576` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:09.478386 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d52e28-a049-4e5a-a267-7cbb42c250c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e57ff44e364e63afcb2b9a516f0576)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:09.480317 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d52e28-a049-4e5a-a267-7cbb42c250c8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:09.951646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b7d52e28-a049-4e5a-a267-7cbb42c250c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e57ff44e364e63afcb2b9a516f0576', 'request_id': 'req-b7d52e28-a049-4e5a-a267-7cbb42c250c8'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:09.960021 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b7d52e28-a049-4e5a-a267-7cbb42c250c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e57ff44e364e63afcb2b9a516f0576', 'request_id': 'req-b7d52e28-a049-4e5a-a267-7cbb42c250c8'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:10.025240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b7d52e28-a049-4e5a-a267-7cbb42c250c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e57ff44e364e63afcb2b9a516f0576', 'request_id': 'req-b7d52e28-a049-4e5a-a267-7cbb42c250c8'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:10.036193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b7d52e28-a049-4e5a-a267-7cbb42c250c8 admin admin] The token cache is being invalidate because project 31e57ff44e364e63afcb2b9a516f0576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:10.036420 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b7d52e28-a049-4e5a-a267-7cbb42c250c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:10.037163 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b7d52e28-a049-4e5a-a267-7cbb42c250c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:10.038705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 985/1959] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:09 2022] DELETE /identity/v3/projects/31e57ff44e364e63afcb2b9a516f0576 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:10.042662 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa518b-3cd9-4861-abde-0c1548e739d4 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:10.052159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa518b-3cd9-4861-abde-0c1548e739d4 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:10.106637 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a0a0c-8d67-45ef-90f5-a73354a840a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:10.107509 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a0a0c-8d67-45ef-90f5-a73354a840a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:10.107823 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a0a0c-8d67-45ef-90f5-a73354a840a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:10.108101 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a0a0c-8d67-45ef-90f5-a73354a840a7 admin admin] PATH_INFO: `/v3/users/e64fc60ab72e497e828602968f4f2d07` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:10.109296 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a0a0c-8d67-45ef-90f5-a73354a840a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64fc60ab72e497e828602968f4f2d07)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:10.111208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a0a0c-8d67-45ef-90f5-a73354a840a7 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:10.322220 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c60a0a0c-8d67-45ef-90f5-a73354a840a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64fc60ab72e497e828602968f4f2d07'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:10.330408 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c60a0a0c-8d67-45ef-90f5-a73354a840a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64fc60ab72e497e828602968f4f2d07'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:10.406839 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c60a0a0c-8d67-45ef-90f5-a73354a840a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64fc60ab72e497e828602968f4f2d07'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:10.420211 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c60a0a0c-8d67-45ef-90f5-a73354a840a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64fc60ab72e497e828602968f4f2d07'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:10.430907 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c60a0a0c-8d67-45ef-90f5-a73354a840a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64fc60ab72e497e828602968f4f2d07'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:10.440841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 975/1960] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:10 2022] DELETE /identity/v3/users/e64fc60ab72e497e828602968f4f2d07 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:10.831050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d52e28-a049-4e5a-a267-7cbb42c250c8 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:10.832607 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-b7d52e28-a049-4e5a-a267-7cbb42c250c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:10.845654 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d52e28-a049-4e5a-a267-7cbb42c250c8 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:10.902544 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b98be-88da-4b1d-80fc-2a26e6ded8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:10.903404 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b98be-88da-4b1d-80fc-2a26e6ded8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:10.903721 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b98be-88da-4b1d-80fc-2a26e6ded8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:10.904000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b98be-88da-4b1d-80fc-2a26e6ded8b3 admin admin] PATH_INFO: `/v3/projects/67d64220b88c4d84bc764ebf9d29111e` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:10.905176 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b98be-88da-4b1d-80fc-2a26e6ded8b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67d64220b88c4d84bc764ebf9d29111e)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:10.907133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b98be-88da-4b1d-80fc-2a26e6ded8b3 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:10.978855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a0a0c-8d67-45ef-90f5-a73354a840a7 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:10.980739 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c60a0a0c-8d67-45ef-90f5-a73354a840a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:10.993952 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a0a0c-8d67-45ef-90f5-a73354a840a7 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:10.998759 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af381a2f-2430-453a-9c9f-256a88e69319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:10.999667 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af381a2f-2430-453a-9c9f-256a88e69319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:11.003734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af381a2f-2430-453a-9c9f-256a88e69319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:11.003734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af381a2f-2430-453a-9c9f-256a88e69319 admin admin] PATH_INFO: `/v3/users/4d0a622895ed4c608b089f55fd9d6890` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:11.003734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af381a2f-2430-453a-9c9f-256a88e69319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0a622895ed4c608b089f55fd9d6890)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:11.003734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af381a2f-2430-453a-9c9f-256a88e69319 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:11.018764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-979b98be-88da-4b1d-80fc-2a26e6ded8b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67d64220b88c4d84bc764ebf9d29111e', 'request_id': 'req-979b98be-88da-4b1d-80fc-2a26e6ded8b3'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:11.025487 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-979b98be-88da-4b1d-80fc-2a26e6ded8b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67d64220b88c4d84bc764ebf9d29111e', 'request_id': 'req-979b98be-88da-4b1d-80fc-2a26e6ded8b3'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:11.104369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-979b98be-88da-4b1d-80fc-2a26e6ded8b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67d64220b88c4d84bc764ebf9d29111e', 'request_id': 'req-979b98be-88da-4b1d-80fc-2a26e6ded8b3'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:11.115444 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-979b98be-88da-4b1d-80fc-2a26e6ded8b3 admin admin] The token cache is being invalidate because project 67d64220b88c4d84bc764ebf9d29111e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:11.115764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-979b98be-88da-4b1d-80fc-2a26e6ded8b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:11.116381 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-979b98be-88da-4b1d-80fc-2a26e6ded8b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:11.118012 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 986/1961] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:10 2022] DELETE /identity/v3/projects/67d64220b88c4d84bc764ebf9d29111e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:11.122814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f9d28-bf8e-472b-b206-dce412d6a6bb None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:11.123096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f9d28-bf8e-472b-b206-dce412d6a6bb None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:11.123373 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f9d28-bf8e-472b-b206-dce412d6a6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:11.140842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-d19f9d28-bf8e-472b-b206-dce412d6a6bb None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:11.142045 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d19f9d28-bf8e-472b-b206-dce412d6a6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:11.180712 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-af381a2f-2430-453a-9c9f-256a88e69319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0a622895ed4c608b089f55fd9d6890'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:11.181385 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-af381a2f-2430-453a-9c9f-256a88e69319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0a622895ed4c608b089f55fd9d6890'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:11.202331 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 987/1962] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:01:11.207262 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5f1f2-6823-4690-8db2-4accd8ecbf1f None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:11.207594 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5f1f2-6823-4690-8db2-4accd8ecbf1f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:11.207899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5f1f2-6823-4690-8db2-4accd8ecbf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:11.225920 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-52c5f1f2-6823-4690-8db2-4accd8ecbf1f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:11.227111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-52c5f1f2-6823-4690-8db2-4accd8ecbf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:11.235323 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-af381a2f-2430-453a-9c9f-256a88e69319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0a622895ed4c608b089f55fd9d6890'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:11.239272 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 988/1963] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:01:11.240350 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5f1f2-6823-4690-8db2-4accd8ecbf1f None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:11.247906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-af381a2f-2430-453a-9c9f-256a88e69319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0a622895ed4c608b089f55fd9d6890'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:11.249285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5f1f2-6823-4690-8db2-4accd8ecbf1f None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:11.253836 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b37ad7-df38-4672-8f4b-aeacd1c36790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:11.254467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b37ad7-df38-4672-8f4b-aeacd1c36790 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:11.254584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-af381a2f-2430-453a-9c9f-256a88e69319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0a622895ed4c608b089f55fd9d6890'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:11.254748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b37ad7-df38-4672-8f4b-aeacd1c36790 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:11.255025 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b37ad7-df38-4672-8f4b-aeacd1c36790 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:11.255789 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b37ad7-df38-4672-8f4b-aeacd1c36790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:01:11.256094 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b37ad7-df38-4672-8f4b-aeacd1c36790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:11.257732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b37ad7-df38-4672-8f4b-aeacd1c36790 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:11.261281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 976/1964] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:10 2022] DELETE /identity/v3/users/4d0a622895ed4c608b089f55fd9d6890 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:01:11.265820 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac7b19-748a-4a90-a6fa-7e6e12955843 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:11.266113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac7b19-748a-4a90-a6fa-7e6e12955843 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:11.266394 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac7b19-748a-4a90-a6fa-7e6e12955843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:11.269490 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 989/1965] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:01:11.273615 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b37ad7-df38-4672-8f4b-aeacd1c36790 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:11.284809 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b37ad7-df38-4672-8f4b-aeacd1c36790 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:11.288164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-22ac7b19-748a-4a90-a6fa-7e6e12955843 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:11.288925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-22ac7b19-748a-4a90-a6fa-7e6e12955843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:11.342988 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155c2f3-ce44-467e-a57f-394f454c5d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:11.343677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155c2f3-ce44-467e-a57f-394f454c5d68 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:11.343961 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155c2f3-ce44-467e-a57f-394f454c5d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:11.344237 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155c2f3-ce44-467e-a57f-394f454c5d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:11.344918 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155c2f3-ce44-467e-a57f-394f454c5d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:11.346818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155c2f3-ce44-467e-a57f-394f454c5d68 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:11.348958 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 977/1966] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:01:11.359887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac7b19-748a-4a90-a6fa-7e6e12955843 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:11.361203 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-22ac7b19-748a-4a90-a6fa-7e6e12955843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:11.416559 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac7b19-748a-4a90-a6fa-7e6e12955843 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:11.420420 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e507f0-97e4-4cb1-8f52-22fef4c4907c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:11.421074 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e507f0-97e4-4cb1-8f52-22fef4c4907c service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:11.421429 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e507f0-97e4-4cb1-8f52-22fef4c4907c service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:11.421711 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e507f0-97e4-4cb1-8f52-22fef4c4907c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:11.431777 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e507f0-97e4-4cb1-8f52-22fef4c4907c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:11.433548 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e507f0-97e4-4cb1-8f52-22fef4c4907c service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:11.439931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 990/1967] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:01:11 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:11.441180 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155c2f3-ce44-467e-a57f-394f454c5d68 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:11.444716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 978/1968] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:01:11.530461 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155c2f3-ce44-467e-a57f-394f454c5d68 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:11.535628 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8563d-cdc6-4dd9-acda-628290e7deac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:11.536704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8563d-cdc6-4dd9-acda-628290e7deac admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:11.537633 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8563d-cdc6-4dd9-acda-628290e7deac admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:11.541322 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8563d-cdc6-4dd9-acda-628290e7deac admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:11.541322 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8563d-cdc6-4dd9-acda-628290e7deac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:11.541322 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8563d-cdc6-4dd9-acda-628290e7deac admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:11.641584 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 991/1969] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:01:11 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:01:11.645961 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e507f0-97e4-4cb1-8f52-22fef4c4907c service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:11.657146 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e507f0-97e4-4cb1-8f52-22fef4c4907c service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:11.661781 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022c9b4-0878-44c1-9701-5759e5b21b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:11.662493 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022c9b4-0878-44c1-9701-5759e5b21b2c admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:11.662947 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022c9b4-0878-44c1-9701-5759e5b21b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:11.663226 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022c9b4-0878-44c1-9701-5759e5b21b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:11.664020 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022c9b4-0878-44c1-9701-5759e5b21b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:11.666115 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022c9b4-0878-44c1-9701-5759e5b21b2c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:11.676308 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 979/1970] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:11.680299 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8563d-cdc6-4dd9-acda-628290e7deac admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:11.690609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8563d-cdc6-4dd9-acda-628290e7deac admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:11.695360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674564b-d574-4b6e-bbae-e3ac51dbc2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:11.696640 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674564b-d574-4b6e-bbae-e3ac51dbc2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:11.697086 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674564b-d574-4b6e-bbae-e3ac51dbc2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:11.697428 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674564b-d574-4b6e-bbae-e3ac51dbc2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:11.698223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674564b-d574-4b6e-bbae-e3ac51dbc2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:11.699916 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674564b-d574-4b6e-bbae-e3ac51dbc2c9 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:11.710023 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 992/1971] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:11.715015 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022c9b4-0878-44c1-9701-5759e5b21b2c admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:11.724786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022c9b4-0878-44c1-9701-5759e5b21b2c admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:11.729566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78db5d-41eb-4199-8615-37491d9c062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:11.730456 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78db5d-41eb-4199-8615-37491d9c062e admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:11.730733 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78db5d-41eb-4199-8615-37491d9c062e admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:11.731004 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78db5d-41eb-4199-8615-37491d9c062e admin admin] PATH_INFO: `/v3/projects/e42b7af66e954df7b6408a7227041e23/users/98110c37bfb54918a878cc8b3ecc80b4/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:11.745942 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78db5d-41eb-4199-8615-37491d9c062e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42b7af66e954df7b6408a7227041e23, user_id=98110c37bfb54918a878cc8b3ecc80b4, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:11.748627 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78db5d-41eb-4199-8615-37491d9c062e admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:11.818227 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 980/1972] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:11 2022] PUT /identity/v3/projects/e42b7af66e954df7b6408a7227041e23/users/98110c37bfb54918a878cc8b3ecc80b4/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:11.829218 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf960dfd-71fd-4c56-8d14-462426716b6a None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:11.829507 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf960dfd-71fd-4c56-8d14-462426716b6a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:11.829806 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf960dfd-71fd-4c56-8d14-462426716b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:11.840528 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78db5d-41eb-4199-8615-37491d9c062e admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:11.843188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ee78db5d-41eb-4199-8615-37491d9c062e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:11.858773 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-bf960dfd-71fd-4c56-8d14-462426716b6a None None] MFA Rules not processed for user `98110c37bfb54918a878cc8b3ecc80b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:11.860044 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-bf960dfd-71fd-4c56-8d14-462426716b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:11.913165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78db5d-41eb-4199-8615-37491d9c062e admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:11.918096 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d734b-7767-41d7-ae28-46f5593aff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:11.918961 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d734b-7767-41d7-ae28-46f5593aff3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:11.919252 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d734b-7767-41d7-ae28-46f5593aff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:11.919546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d734b-7767-41d7-ae28-46f5593aff3c admin admin] PATH_INFO: `/v3/projects/af8a06cffbad4366987c151979d70784` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:11.920776 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d734b-7767-41d7-ae28-46f5593aff3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8a06cffbad4366987c151979d70784)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:11.922712 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d734b-7767-41d7-ae28-46f5593aff3c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:11.925051 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 993/1973] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:11.936861 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf960dfd-71fd-4c56-8d14-462426716b6a None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:11.938355 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-bf960dfd-71fd-4c56-8d14-462426716b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:11.992180 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf960dfd-71fd-4c56-8d14-462426716b6a None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:11.996471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9483e-31a7-4570-ac1e-0c9c7d440639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:11.997118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9483e-31a7-4570-ac1e-0c9c7d440639 service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:11.997407 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9483e-31a7-4570-ac1e-0c9c7d440639 service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:11.997686 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9483e-31a7-4570-ac1e-0c9c7d440639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:12.005864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9483e-31a7-4570-ac1e-0c9c7d440639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:12.007299 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9483e-31a7-4570-ac1e-0c9c7d440639 service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:12.017433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 994/1974] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:01:12.036155 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9483e-31a7-4570-ac1e-0c9c7d440639 service cinder] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:12.036746 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-fd2d734b-7767-41d7-ae28-46f5593aff3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8a06cffbad4366987c151979d70784', 'request_id': 'req-fd2d734b-7767-41d7-ae28-46f5593aff3c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:12.047256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9483e-31a7-4570-ac1e-0c9c7d440639 service cinder] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:12.102730 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23c836-c92a-43e1-9646-9762d3df1f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:12.103644 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23c836-c92a-43e1-9646-9762d3df1f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:12.103929 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23c836-c92a-43e1-9646-9762d3df1f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:12.104223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23c836-c92a-43e1-9646-9762d3df1f25 admin admin] PATH_INFO: `/v3/users/98110c37bfb54918a878cc8b3ecc80b4` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:12.105404 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23c836-c92a-43e1-9646-9762d3df1f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98110c37bfb54918a878cc8b3ecc80b4)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:12.107607 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23c836-c92a-43e1-9646-9762d3df1f25 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:12.109864 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-fd2d734b-7767-41d7-ae28-46f5593aff3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8a06cffbad4366987c151979d70784', 'request_id': 'req-fd2d734b-7767-41d7-ae28-46f5593aff3c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:12.116805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-fd2d734b-7767-41d7-ae28-46f5593aff3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8a06cffbad4366987c151979d70784', 'request_id': 'req-fd2d734b-7767-41d7-ae28-46f5593aff3c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:12.128507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-fd2d734b-7767-41d7-ae28-46f5593aff3c admin admin] The token cache is being invalidate because project af8a06cffbad4366987c151979d70784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:12.128841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-fd2d734b-7767-41d7-ae28-46f5593aff3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:12.129655 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-fd2d734b-7767-41d7-ae28-46f5593aff3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:12.131423 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 981/1975] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:11 2022] DELETE /identity/v3/projects/af8a06cffbad4366987c151979d70784 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:01:12.137488 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5b2e6-64f7-4a20-9aa9-117cf96f81d3 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:12.137972 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5b2e6-64f7-4a20-9aa9-117cf96f81d3 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:12.138831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5b2e6-64f7-4a20-9aa9-117cf96f81d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:12.157706 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-d1c5b2e6-64f7-4a20-9aa9-117cf96f81d3 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:12.158895 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d1c5b2e6-64f7-4a20-9aa9-117cf96f81d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:12.168043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 982/1976] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:01:12.176591 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f897423-b30e-4f8e-849f-336f1a88012b None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:12.176879 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f897423-b30e-4f8e-849f-336f1a88012b None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:12.177178 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f897423-b30e-4f8e-849f-336f1a88012b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:12.195404 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-7f897423-b30e-4f8e-849f-336f1a88012b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:12.197132 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-7f897423-b30e-4f8e-849f-336f1a88012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:12.204484 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 983/1977] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:01:12.208607 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f897423-b30e-4f8e-849f-336f1a88012b None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:12.218058 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f897423-b30e-4f8e-849f-336f1a88012b None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:12.223458 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30443fcd-a94e-45bd-8428-0d5f7fe2acee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:12.223458 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30443fcd-a94e-45bd-8428-0d5f7fe2acee admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:12.223688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30443fcd-a94e-45bd-8428-0d5f7fe2acee admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:12.223860 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30443fcd-a94e-45bd-8428-0d5f7fe2acee admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:12.224584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30443fcd-a94e-45bd-8428-0d5f7fe2acee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:01:12.224892 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30443fcd-a94e-45bd-8428-0d5f7fe2acee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:12.226545 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30443fcd-a94e-45bd-8428-0d5f7fe2acee admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:12.238477 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 984/1978] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:01:12.243556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30443fcd-a94e-45bd-8428-0d5f7fe2acee admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:12.249580 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ff23c836-c92a-43e1-9646-9762d3df1f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98110c37bfb54918a878cc8b3ecc80b4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:12.250245 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ff23c836-c92a-43e1-9646-9762d3df1f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98110c37bfb54918a878cc8b3ecc80b4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:12.253065 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30443fcd-a94e-45bd-8428-0d5f7fe2acee admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:12.256833 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ff23c836-c92a-43e1-9646-9762d3df1f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98110c37bfb54918a878cc8b3ecc80b4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:12.257665 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11372a15-16a0-4c4e-a4c2-92903556ba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:12.258300 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11372a15-16a0-4c4e-a4c2-92903556ba45 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:12.258653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11372a15-16a0-4c4e-a4c2-92903556ba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:12.258928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11372a15-16a0-4c4e-a4c2-92903556ba45 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:12.259645 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11372a15-16a0-4c4e-a4c2-92903556ba45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:12.261537 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11372a15-16a0-4c4e-a4c2-92903556ba45 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:12.364928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ff23c836-c92a-43e1-9646-9762d3df1f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98110c37bfb54918a878cc8b3ecc80b4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:12.382552 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ff23c836-c92a-43e1-9646-9762d3df1f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98110c37bfb54918a878cc8b3ecc80b4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:12.389791 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 995/1979] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:12 2022] DELETE /identity/v3/users/98110c37bfb54918a878cc8b3ecc80b4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:01:12.395735 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8222c-f4b9-418f-9343-da51d637b0f6 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:12.396226 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8222c-f4b9-418f-9343-da51d637b0f6 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:12.396687 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8222c-f4b9-418f-9343-da51d637b0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:12.408824 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 985/1980] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:01:12 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:01:12.410518 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11372a15-16a0-4c4e-a4c2-92903556ba45 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:12.412908 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-11372a15-16a0-4c4e-a4c2-92903556ba45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:12.422076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-95b8222c-f4b9-418f-9343-da51d637b0f6 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:12.423316 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-95b8222c-f4b9-418f-9343-da51d637b0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:12.475021 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11372a15-16a0-4c4e-a4c2-92903556ba45 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:12.480016 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 996/1981] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:01:12.480165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafc13d-afb1-4ab8-941e-96605cf21941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:12.480835 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafc13d-afb1-4ab8-941e-96605cf21941 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:12.481365 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafc13d-afb1-4ab8-941e-96605cf21941 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:12.481670 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafc13d-afb1-4ab8-941e-96605cf21941 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:12.482412 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafc13d-afb1-4ab8-941e-96605cf21941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:12.485878 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafc13d-afb1-4ab8-941e-96605cf21941 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:12.490171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8222c-f4b9-418f-9343-da51d637b0f6 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:12.491754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-95b8222c-f4b9-418f-9343-da51d637b0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:12.547769 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8222c-f4b9-418f-9343-da51d637b0f6 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:12.551393 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651e80d-8958-41ee-b977-ca1bea13d640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:12.552096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651e80d-8958-41ee-b977-ca1bea13d640 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:12.552374 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651e80d-8958-41ee-b977-ca1bea13d640 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:12.552647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651e80d-8958-41ee-b977-ca1bea13d640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:12.562467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651e80d-8958-41ee-b977-ca1bea13d640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:12.563948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651e80d-8958-41ee-b977-ca1bea13d640 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:12.573881 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 997/1982] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:01:12.603378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 986/1983] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:01:12 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:01:12.605340 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651e80d-8958-41ee-b977-ca1bea13d640 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:12.615463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651e80d-8958-41ee-b977-ca1bea13d640 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:12.620431 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98294d-1cb9-4c90-8f43-6cef82d90a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:12.621097 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98294d-1cb9-4c90-8f43-6cef82d90a8e admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:12.621381 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98294d-1cb9-4c90-8f43-6cef82d90a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:12.621660 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98294d-1cb9-4c90-8f43-6cef82d90a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:12.622405 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98294d-1cb9-4c90-8f43-6cef82d90a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:12.624057 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98294d-1cb9-4c90-8f43-6cef82d90a8e admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:12.637799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 998/1984] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:12.638908 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafc13d-afb1-4ab8-941e-96605cf21941 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:12.649449 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafc13d-afb1-4ab8-941e-96605cf21941 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:12.654545 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67894c19-f137-4668-97c9-1aa7ece9c675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:12.655082 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67894c19-f137-4668-97c9-1aa7ece9c675 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:12.655360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67894c19-f137-4668-97c9-1aa7ece9c675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:12.655676 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67894c19-f137-4668-97c9-1aa7ece9c675 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:12.656405 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67894c19-f137-4668-97c9-1aa7ece9c675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:12.658034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67894c19-f137-4668-97c9-1aa7ece9c675 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:12.672487 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 987/1985] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:01:12.673676 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98294d-1cb9-4c90-8f43-6cef82d90a8e admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:12.683867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98294d-1cb9-4c90-8f43-6cef82d90a8e admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:12.688704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af25b8-2575-406c-b216-403cf8a77ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:12.689310 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af25b8-2575-406c-b216-403cf8a77ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:12.689591 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af25b8-2575-406c-b216-403cf8a77ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:12.689874 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af25b8-2575-406c-b216-403cf8a77ac4 admin admin] PATH_INFO: `/v3/projects/4b33a45757a84006a1a05085631b22c0/users/2d616b3ce8ee49f6bfca34111f3f2b63/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:12.704818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af25b8-2575-406c-b216-403cf8a77ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b33a45757a84006a1a05085631b22c0, user_id=2d616b3ce8ee49f6bfca34111f3f2b63, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:12.707478 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af25b8-2575-406c-b216-403cf8a77ac4 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:12.794430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 999/1986] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:12 2022] PUT /identity/v3/projects/4b33a45757a84006a1a05085631b22c0/users/2d616b3ce8ee49f6bfca34111f3f2b63/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:12.799496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a56f69-eb18-4146-b5f1-271d4e3ce417 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:12.799887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a56f69-eb18-4146-b5f1-271d4e3ce417 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:12.800175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a56f69-eb18-4146-b5f1-271d4e3ce417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:12.817990 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-93a56f69-eb18-4146-b5f1-271d4e3ce417 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:12.819207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-93a56f69-eb18-4146-b5f1-271d4e3ce417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:12.879831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 988/1987] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:12.896001 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af25b8-2575-406c-b216-403cf8a77ac4 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:12.944066 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af25b8-2575-406c-b216-403cf8a77ac4 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:12.948711 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7ceb6-97d1-431f-830e-e2c1801fac7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:12.949368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ceb6-97d1-431f-830e-e2c1801fac7d service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:12.949649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ceb6-97d1-431f-830e-e2c1801fac7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:12.949924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ceb6-97d1-431f-830e-e2c1801fac7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:12.959369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7ceb6-97d1-431f-830e-e2c1801fac7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:12.960971 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7ceb6-97d1-431f-830e-e2c1801fac7d service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:12.971492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1000/1988] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:13.063786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a56f69-eb18-4146-b5f1-271d4e3ce417 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:13.065192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-93a56f69-eb18-4146-b5f1-271d4e3ce417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:13.096441 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a56f69-eb18-4146-b5f1-271d4e3ce417 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:13.110426 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ea3a2-34aa-490a-aaa3-acae665e05cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:13.116403 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ea3a2-34aa-490a-aaa3-acae665e05cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:13.116878 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ea3a2-34aa-490a-aaa3-acae665e05cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:13.118315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ea3a2-34aa-490a-aaa3-acae665e05cd admin admin] PATH_INFO: `/v3/projects/e42b7af66e954df7b6408a7227041e23` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:13.130505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ea3a2-34aa-490a-aaa3-acae665e05cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42b7af66e954df7b6408a7227041e23)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:13.130505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ea3a2-34aa-490a-aaa3-acae665e05cd admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:13.278234 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e11ea3a2-34aa-490a-aaa3-acae665e05cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42b7af66e954df7b6408a7227041e23', 'request_id': 'req-e11ea3a2-34aa-490a-aaa3-acae665e05cd'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:13.349624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e11ea3a2-34aa-490a-aaa3-acae665e05cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42b7af66e954df7b6408a7227041e23', 'request_id': 'req-e11ea3a2-34aa-490a-aaa3-acae665e05cd'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:13.356637 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e11ea3a2-34aa-490a-aaa3-acae665e05cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42b7af66e954df7b6408a7227041e23', 'request_id': 'req-e11ea3a2-34aa-490a-aaa3-acae665e05cd'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:13.366786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e11ea3a2-34aa-490a-aaa3-acae665e05cd admin admin] The token cache is being invalidate because project e42b7af66e954df7b6408a7227041e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:13.367071 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e11ea3a2-34aa-490a-aaa3-acae665e05cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:13.368247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e11ea3a2-34aa-490a-aaa3-acae665e05cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:13.369789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 989/1989] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:13 2022] DELETE /identity/v3/projects/e42b7af66e954df7b6408a7227041e23 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:13.374647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548855e6-e2e6-4bbd-9e34-40356910f242 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:13.375119 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548855e6-e2e6-4bbd-9e34-40356910f242 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:13.375243 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548855e6-e2e6-4bbd-9e34-40356910f242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:13.405839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-548855e6-e2e6-4bbd-9e34-40356910f242 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:13.405839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-548855e6-e2e6-4bbd-9e34-40356910f242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:13.465522 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1001/1990] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:13.474248 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8345d-0821-4f8a-9817-fbaf13bcf37a None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:13.474601 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8345d-0821-4f8a-9817-fbaf13bcf37a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:13.474945 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8345d-0821-4f8a-9817-fbaf13bcf37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:13.494556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-54a8345d-0821-4f8a-9817-fbaf13bcf37a None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:13.495911 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-54a8345d-0821-4f8a-9817-fbaf13bcf37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:13.503874 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 990/1991] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:13.509031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548855e6-e2e6-4bbd-9e34-40356910f242 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:13.520552 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548855e6-e2e6-4bbd-9e34-40356910f242 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:13.526073 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9c89-618a-44cd-a397-1b334d5b76f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:13.526848 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9c89-618a-44cd-a397-1b334d5b76f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:13.527144 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9c89-618a-44cd-a397-1b334d5b76f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:13.527336 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9c89-618a-44cd-a397-1b334d5b76f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:13.528286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca9c89-618a-44cd-a397-1b334d5b76f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:01:13.528601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca9c89-618a-44cd-a397-1b334d5b76f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:13.530275 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca9c89-618a-44cd-a397-1b334d5b76f7 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:13.544425 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1002/1992] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:01:13.551051 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8345d-0821-4f8a-9817-fbaf13bcf37a None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:13.561126 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8345d-0821-4f8a-9817-fbaf13bcf37a None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:13.565814 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf8f5b-1734-4025-9007-7e15f5243f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:13.566478 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf8f5b-1734-4025-9007-7e15f5243f62 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:13.566756 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf8f5b-1734-4025-9007-7e15f5243f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:13.567027 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf8f5b-1734-4025-9007-7e15f5243f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:13.567751 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf8f5b-1734-4025-9007-7e15f5243f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:13.569866 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf8f5b-1734-4025-9007-7e15f5243f62 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:13.704284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 991/1993] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:01:13 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:13.708321 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9c89-618a-44cd-a397-1b334d5b76f7 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:13.718347 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9c89-618a-44cd-a397-1b334d5b76f7 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:13.773879 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cc872-b7e5-46bc-becb-df312fad20a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:13.774557 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cc872-b7e5-46bc-becb-df312fad20a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:13.774843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cc872-b7e5-46bc-becb-df312fad20a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:13.775118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cc872-b7e5-46bc-becb-df312fad20a2 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:13.775860 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cc872-b7e5-46bc-becb-df312fad20a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:13.780492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cc872-b7e5-46bc-becb-df312fad20a2 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:13.869338 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1003/1994] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:01:13 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:13.873471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf8f5b-1734-4025-9007-7e15f5243f62 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:13.883829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf8f5b-1734-4025-9007-7e15f5243f62 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:13.888815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a4774-25ae-4911-aec1-60edaa5c9a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:13.889483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a4774-25ae-4911-aec1-60edaa5c9a27 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:13.889765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a4774-25ae-4911-aec1-60edaa5c9a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:13.890069 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a4774-25ae-4911-aec1-60edaa5c9a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:13.890808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a4774-25ae-4911-aec1-60edaa5c9a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:13.892975 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a4774-25ae-4911-aec1-60edaa5c9a27 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:13.906733 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 992/1995] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:01:13.908006 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cc872-b7e5-46bc-becb-df312fad20a2 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:13.919327 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cc872-b7e5-46bc-becb-df312fad20a2 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:13.924074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500d56-9408-434d-b1ba-7aa98b45efe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:13.924745 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500d56-9408-434d-b1ba-7aa98b45efe8 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:13.925033 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500d56-9408-434d-b1ba-7aa98b45efe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:13.925311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500d56-9408-434d-b1ba-7aa98b45efe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:13.926085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d500d56-9408-434d-b1ba-7aa98b45efe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:13.927719 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d500d56-9408-434d-b1ba-7aa98b45efe8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:13.938626 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1004/1996] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:13.943062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a4774-25ae-4911-aec1-60edaa5c9a27 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:13.953004 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a4774-25ae-4911-aec1-60edaa5c9a27 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:13.957709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357ade2-55f2-4952-9642-b5e84398d82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:13.958636 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357ade2-55f2-4952-9642-b5e84398d82c admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:13.958909 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357ade2-55f2-4952-9642-b5e84398d82c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:13.959182 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357ade2-55f2-4952-9642-b5e84398d82c admin admin] PATH_INFO: `/v3/projects/b3b253ce26894c16afcf6552e3642755/users/4099d802862340b081102c66d6e83d30/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:13.977443 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357ade2-55f2-4952-9642-b5e84398d82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b253ce26894c16afcf6552e3642755, user_id=4099d802862340b081102c66d6e83d30, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:13.980414 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357ade2-55f2-4952-9642-b5e84398d82c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:14.076230 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 993/1997] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:13 2022] PUT /identity/v3/projects/b3b253ce26894c16afcf6552e3642755/users/4099d802862340b081102c66d6e83d30/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:14.087157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e803cd9-37df-466d-9dcd-5d1ba1292f46 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:14.087455 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e803cd9-37df-466d-9dcd-5d1ba1292f46 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:14.087812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e803cd9-37df-466d-9dcd-5d1ba1292f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:14.114292 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-6e803cd9-37df-466d-9dcd-5d1ba1292f46 None None] MFA Rules not processed for user `4099d802862340b081102c66d6e83d30`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:14.115553 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-6e803cd9-37df-466d-9dcd-5d1ba1292f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:14.183294 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1005/1998] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:14.198784 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357ade2-55f2-4952-9642-b5e84398d82c admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:14.200583 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-2357ade2-55f2-4952-9642-b5e84398d82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:14.263411 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357ade2-55f2-4952-9642-b5e84398d82c admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:14.267240 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fee9f7-d0c4-495f-92f6-6ce564577eed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:14.268007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fee9f7-d0c4-495f-92f6-6ce564577eed service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:14.272922 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fee9f7-d0c4-495f-92f6-6ce564577eed service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:14.272922 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fee9f7-d0c4-495f-92f6-6ce564577eed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:14.277592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fee9f7-d0c4-495f-92f6-6ce564577eed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:14.279033 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fee9f7-d0c4-495f-92f6-6ce564577eed service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:14.288178 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 994/1999] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:14.327507 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b812a-c2e1-49f4-9013-4b122fe8b8a5 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:14.327886 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b812a-c2e1-49f4-9013-4b122fe8b8a5 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:14.328175 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b812a-c2e1-49f4-9013-4b122fe8b8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:14.357508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c64b812a-c2e1-49f4-9013-4b122fe8b8a5 None None] MFA Rules not processed for user `2d616b3ce8ee49f6bfca34111f3f2b63`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:14.358827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c64b812a-c2e1-49f4-9013-4b122fe8b8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:14.432096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1006/2000] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:14.451577 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fee9f7-d0c4-495f-92f6-6ce564577eed service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:14.454986 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b812a-c2e1-49f4-9013-4b122fe8b8a5 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:14.456238 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-99fee9f7-d0c4-495f-92f6-6ce564577eed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:14.456482 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c64b812a-c2e1-49f4-9013-4b122fe8b8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:14.471213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b812a-c2e1-49f4-9013-4b122fe8b8a5 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:14.475071 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715ab50-8576-481b-b551-93669394860e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:14.475771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715ab50-8576-481b-b551-93669394860e service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:14.476052 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715ab50-8576-481b-b551-93669394860e service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:14.476324 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715ab50-8576-481b-b551-93669394860e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:14.485528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715ab50-8576-481b-b551-93669394860e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:14.486979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715ab50-8576-481b-b551-93669394860e service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:14.496599 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1007/2001] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:01:14.522332 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fee9f7-d0c4-495f-92f6-6ce564577eed service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:14.527831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1caee7-06d8-4b3c-ad3e-2db862571c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:14.542388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1caee7-06d8-4b3c-ad3e-2db862571c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:14.542388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1caee7-06d8-4b3c-ad3e-2db862571c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:14.542388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1caee7-06d8-4b3c-ad3e-2db862571c83 admin admin] PATH_INFO: `/v3/users/65a1500774e44fffa6ae90e0d37aa067` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:14.542388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1caee7-06d8-4b3c-ad3e-2db862571c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a1500774e44fffa6ae90e0d37aa067)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:14.542388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1caee7-06d8-4b3c-ad3e-2db862571c83 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:14.738840 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-ba1caee7-06d8-4b3c-ad3e-2db862571c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a1500774e44fffa6ae90e0d37aa067'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:14.739126 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-ba1caee7-06d8-4b3c-ad3e-2db862571c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a1500774e44fffa6ae90e0d37aa067'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:14.810398 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-ba1caee7-06d8-4b3c-ad3e-2db862571c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a1500774e44fffa6ae90e0d37aa067'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:14.824105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-ba1caee7-06d8-4b3c-ad3e-2db862571c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a1500774e44fffa6ae90e0d37aa067'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:14.830834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-ba1caee7-06d8-4b3c-ad3e-2db862571c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a1500774e44fffa6ae90e0d37aa067'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:14.837645 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 995/2002] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:14 2022] DELETE /identity/v3/users/65a1500774e44fffa6ae90e0d37aa067 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:14.842259 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8090d9a-8adb-4839-83f7-70b6eb6bbc40 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:14.842893 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8090d9a-8adb-4839-83f7-70b6eb6bbc40 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:14.843008 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8090d9a-8adb-4839-83f7-70b6eb6bbc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:14.861225 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-b8090d9a-8adb-4839-83f7-70b6eb6bbc40 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:14.862441 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-b8090d9a-8adb-4839-83f7-70b6eb6bbc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:14.920191 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1008/2003] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:01:14.929421 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1caee7-06d8-4b3c-ad3e-2db862571c83 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:14.931647 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ba1caee7-06d8-4b3c-ad3e-2db862571c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:14.987084 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1caee7-06d8-4b3c-ad3e-2db862571c83 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:14.990736 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffaeedb-e9a8-4d54-b29e-7e8a68a0904e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:14.991393 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffaeedb-e9a8-4d54-b29e-7e8a68a0904e service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:14.991707 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffaeedb-e9a8-4d54-b29e-7e8a68a0904e service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:14.991986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffaeedb-e9a8-4d54-b29e-7e8a68a0904e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:15.002566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffaeedb-e9a8-4d54-b29e-7e8a68a0904e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:15.004826 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffaeedb-e9a8-4d54-b29e-7e8a68a0904e service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:15.024247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 996/2004] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:15.500268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8090d9a-8adb-4839-83f7-70b6eb6bbc40 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:15.501801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-b8090d9a-8adb-4839-83f7-70b6eb6bbc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:15.514825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8090d9a-8adb-4839-83f7-70b6eb6bbc40 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:15.519774 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cb22b-3008-4004-a6f1-d0b5b6a774e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:15.521133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cb22b-3008-4004-a6f1-d0b5b6a774e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:15.521422 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cb22b-3008-4004-a6f1-d0b5b6a774e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:15.521729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cb22b-3008-4004-a6f1-d0b5b6a774e7 admin admin] PATH_INFO: `/v3/projects/bf52673cd17044d7a2087b757d0c631e` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:15.523360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cb22b-3008-4004-a6f1-d0b5b6a774e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf52673cd17044d7a2087b757d0c631e)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:15.525841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cb22b-3008-4004-a6f1-d0b5b6a774e7 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:15.670065 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a14cb22b-3008-4004-a6f1-d0b5b6a774e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf52673cd17044d7a2087b757d0c631e', 'request_id': 'req-a14cb22b-3008-4004-a6f1-d0b5b6a774e7'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:15.676412 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a14cb22b-3008-4004-a6f1-d0b5b6a774e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf52673cd17044d7a2087b757d0c631e', 'request_id': 'req-a14cb22b-3008-4004-a6f1-d0b5b6a774e7'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:15.761621 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a14cb22b-3008-4004-a6f1-d0b5b6a774e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf52673cd17044d7a2087b757d0c631e', 'request_id': 'req-a14cb22b-3008-4004-a6f1-d0b5b6a774e7'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:15.772914 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a14cb22b-3008-4004-a6f1-d0b5b6a774e7 admin admin] The token cache is being invalidate because project bf52673cd17044d7a2087b757d0c631e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:15.773203 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a14cb22b-3008-4004-a6f1-d0b5b6a774e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:15.774519 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a14cb22b-3008-4004-a6f1-d0b5b6a774e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:15.776198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1009/2005] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:15 2022] DELETE /identity/v3/projects/bf52673cd17044d7a2087b757d0c631e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:15.781012 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f0346-0b62-46c3-9b88-0aeadaca43ed None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:15.781500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f0346-0b62-46c3-9b88-0aeadaca43ed None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:15.781633 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f0346-0b62-46c3-9b88-0aeadaca43ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:15.800326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-d82f0346-0b62-46c3-9b88-0aeadaca43ed None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:15.805430 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d82f0346-0b62-46c3-9b88-0aeadaca43ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:15.862260 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 997/2006] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:15.870320 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ff1a0-e404-4f92-aad3-40a043b1fa7c None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:15.870617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ff1a0-e404-4f92-aad3-40a043b1fa7c None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:15.870895 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ff1a0-e404-4f92-aad3-40a043b1fa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:15.890432 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-990ff1a0-e404-4f92-aad3-40a043b1fa7c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:15.893037 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-990ff1a0-e404-4f92-aad3-40a043b1fa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:15.904443 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1010/2007] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:15.905386 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f0346-0b62-46c3-9b88-0aeadaca43ed None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:15.917281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f0346-0b62-46c3-9b88-0aeadaca43ed None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:15.922402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4c7ea-262b-4723-a7b3-25af15f62da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:15.923245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4c7ea-262b-4723-a7b3-25af15f62da9 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:15.923336 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4c7ea-262b-4723-a7b3-25af15f62da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:15.923661 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4c7ea-262b-4723-a7b3-25af15f62da9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:15.924399 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4c7ea-262b-4723-a7b3-25af15f62da9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:01:15.924715 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4c7ea-262b-4723-a7b3-25af15f62da9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:15.926601 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4c7ea-262b-4723-a7b3-25af15f62da9 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:15.940516 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 998/2008] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:01:15.944998 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ff1a0-e404-4f92-aad3-40a043b1fa7c None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:15.955208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ff1a0-e404-4f92-aad3-40a043b1fa7c None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:15.960482 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb75fa-2c2e-4e53-8aa6-a1f7f01e5c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:15.961156 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb75fa-2c2e-4e53-8aa6-a1f7f01e5c6f admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:15.962596 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb75fa-2c2e-4e53-8aa6-a1f7f01e5c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:15.962596 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb75fa-2c2e-4e53-8aa6-a1f7f01e5c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:15.963333 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb75fa-2c2e-4e53-8aa6-a1f7f01e5c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:15.969680 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb75fa-2c2e-4e53-8aa6-a1f7f01e5c6f admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:16.078268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1011/2009] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:01:15 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:16.084162 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4c7ea-262b-4723-a7b3-25af15f62da9 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:16.096150 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4c7ea-262b-4723-a7b3-25af15f62da9 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:16.161769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f79033-8aa2-41fb-8207-430d0bb5f164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:16.162477 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f79033-8aa2-41fb-8207-430d0bb5f164 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:16.162740 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f79033-8aa2-41fb-8207-430d0bb5f164 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:16.163015 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f79033-8aa2-41fb-8207-430d0bb5f164 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:16.163749 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f79033-8aa2-41fb-8207-430d0bb5f164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:16.165745 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f79033-8aa2-41fb-8207-430d0bb5f164 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:16.284485 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 999/2010] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:01:16 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:01:16.286560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb75fa-2c2e-4e53-8aa6-a1f7f01e5c6f admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:16.297343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb75fa-2c2e-4e53-8aa6-a1f7f01e5c6f admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:16.302125 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e00e58-661c-4e16-9638-a13ac33abebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:16.302778 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e00e58-661c-4e16-9638-a13ac33abebe admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:16.303051 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e00e58-661c-4e16-9638-a13ac33abebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:16.303330 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e00e58-661c-4e16-9638-a13ac33abebe admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:16.304107 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e00e58-661c-4e16-9638-a13ac33abebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:16.306216 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e00e58-661c-4e16-9638-a13ac33abebe admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:16.318150 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1012/2011] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:16.323447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f79033-8aa2-41fb-8207-430d0bb5f164 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:16.337760 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f79033-8aa2-41fb-8207-430d0bb5f164 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:16.342954 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786a8e2-e43f-4162-8608-c3c5c3639e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:16.349578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786a8e2-e43f-4162-8608-c3c5c3639e02 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:16.350007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786a8e2-e43f-4162-8608-c3c5c3639e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:16.350404 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786a8e2-e43f-4162-8608-c3c5c3639e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:16.351377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786a8e2-e43f-4162-8608-c3c5c3639e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:16.354190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786a8e2-e43f-4162-8608-c3c5c3639e02 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:16.375185 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1000/2012] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:16.378014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e00e58-661c-4e16-9638-a13ac33abebe admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:16.392061 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e00e58-661c-4e16-9638-a13ac33abebe admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:16.397565 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1570eca-9345-4a49-ada8-d4d344fbe009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:16.409656 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1570eca-9345-4a49-ada8-d4d344fbe009 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:16.409807 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1570eca-9345-4a49-ada8-d4d344fbe009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:16.410086 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1570eca-9345-4a49-ada8-d4d344fbe009 admin admin] PATH_INFO: `/v3/projects/149f308259a840469dbeaee05e828ae4/users/ff1dfe51ba0d4b0d938d7fa10e154eb4/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:16.429220 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1570eca-9345-4a49-ada8-d4d344fbe009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=149f308259a840469dbeaee05e828ae4, user_id=ff1dfe51ba0d4b0d938d7fa10e154eb4, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:16.434192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1570eca-9345-4a49-ada8-d4d344fbe009 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:16.529765 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1013/2013] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:16 2022] PUT /identity/v3/projects/149f308259a840469dbeaee05e828ae4/users/ff1dfe51ba0d4b0d938d7fa10e154eb4/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:01:16.532378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36487f6-7b9b-4cd3-862f-2f0060ae04d9 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:16.532746 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36487f6-7b9b-4cd3-862f-2f0060ae04d9 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:16.533103 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36487f6-7b9b-4cd3-862f-2f0060ae04d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:16.551586 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-b36487f6-7b9b-4cd3-862f-2f0060ae04d9 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:16.552905 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b36487f6-7b9b-4cd3-862f-2f0060ae04d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:16.612391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1001/2014] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:16.622905 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1570eca-9345-4a49-ada8-d4d344fbe009 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:16.624698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d1570eca-9345-4a49-ada8-d4d344fbe009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:16.690135 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1570eca-9345-4a49-ada8-d4d344fbe009 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:16.693764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c945aa5-545b-4d6c-84f5-270acbd71c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:16.694405 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c945aa5-545b-4d6c-84f5-270acbd71c93 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:16.694686 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c945aa5-545b-4d6c-84f5-270acbd71c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:16.694960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c945aa5-545b-4d6c-84f5-270acbd71c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:16.704391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c945aa5-545b-4d6c-84f5-270acbd71c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:16.705944 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c945aa5-545b-4d6c-84f5-270acbd71c93 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:16.715838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1014/2015] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:17.660831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b6cc3-504f-4b9a-8e8c-047f591facb6 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:17.662045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b6cc3-504f-4b9a-8e8c-047f591facb6 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:17.662496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b6cc3-504f-4b9a-8e8c-047f591facb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:17.696439 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-b63b6cc3-504f-4b9a-8e8c-047f591facb6 None None] MFA Rules not processed for user `2d616b3ce8ee49f6bfca34111f3f2b63`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:17.697852 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b63b6cc3-504f-4b9a-8e8c-047f591facb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:17.757060 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1002/2016] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:18.123331 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d527178-8df1-4b30-98b9-c166a8607158 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:18.123889 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d527178-8df1-4b30-98b9-c166a8607158 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:18.124308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d527178-8df1-4b30-98b9-c166a8607158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:18.160841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-1d527178-8df1-4b30-98b9-c166a8607158 None None] MFA Rules not processed for user `ff1dfe51ba0d4b0d938d7fa10e154eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:18.162721 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-1d527178-8df1-4b30-98b9-c166a8607158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:18.265102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1015/2017] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:01:18.277203 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b6cc3-504f-4b9a-8e8c-047f591facb6 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:18.278714 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b63b6cc3-504f-4b9a-8e8c-047f591facb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:18.336085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b6cc3-504f-4b9a-8e8c-047f591facb6 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:18.340344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf0c9b-da75-42ab-bda5-e92d82e48795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:18.340997 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf0c9b-da75-42ab-bda5-e92d82e48795 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:18.341279 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf0c9b-da75-42ab-bda5-e92d82e48795 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:18.341555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf0c9b-da75-42ab-bda5-e92d82e48795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:18.351915 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf0c9b-da75-42ab-bda5-e92d82e48795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:18.351915 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf0c9b-da75-42ab-bda5-e92d82e48795 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:18.360696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1003/2018] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:28.556176 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24011b80-690a-4979-9dda-061b211ecc53 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:28.556700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24011b80-690a-4979-9dda-061b211ecc53 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:28.556816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24011b80-690a-4979-9dda-061b211ecc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:28.575604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-24011b80-690a-4979-9dda-061b211ecc53 None None] MFA Rules not processed for user `ff1dfe51ba0d4b0d938d7fa10e154eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:28.576821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-24011b80-690a-4979-9dda-061b211ecc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:28.583970 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1016/2019] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:29.534431 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf0c9b-da75-42ab-bda5-e92d82e48795 service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:29.537047 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-9dbf0c9b-da75-42ab-bda5-e92d82e48795 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:29.555191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf0c9b-da75-42ab-bda5-e92d82e48795 service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:29.560882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0416918-9950-441f-9c09-ef57f95ecd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:29.562069 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0416918-9950-441f-9c09-ef57f95ecd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:29.562565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0416918-9950-441f-9c09-ef57f95ecd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:29.563044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0416918-9950-441f-9c09-ef57f95ecd63 admin admin] PATH_INFO: `/v3/users/4099d802862340b081102c66d6e83d30` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:29.564523 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0416918-9950-441f-9c09-ef57f95ecd63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4099d802862340b081102c66d6e83d30)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:29.567448 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0416918-9950-441f-9c09-ef57f95ecd63 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:29.785642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-a0416918-9950-441f-9c09-ef57f95ecd63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4099d802862340b081102c66d6e83d30'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:29.786474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-a0416918-9950-441f-9c09-ef57f95ecd63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4099d802862340b081102c66d6e83d30'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:29.921184 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-a0416918-9950-441f-9c09-ef57f95ecd63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4099d802862340b081102c66d6e83d30'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:29.938237 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-a0416918-9950-441f-9c09-ef57f95ecd63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4099d802862340b081102c66d6e83d30'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:29.947714 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-a0416918-9950-441f-9c09-ef57f95ecd63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4099d802862340b081102c66d6e83d30'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:29.955754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1004/2020] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:29 2022] DELETE /identity/v3/users/4099d802862340b081102c66d6e83d30 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:29.961466 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ba080-dbfd-4a41-858e-69a06ce935b9 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:29.963575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ba080-dbfd-4a41-858e-69a06ce935b9 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:29.963968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ba080-dbfd-4a41-858e-69a06ce935b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:29.985613 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-0d7ba080-dbfd-4a41-858e-69a06ce935b9 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:29.987187 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-0d7ba080-dbfd-4a41-858e-69a06ce935b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:30.078582 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1017/2021] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:30.102179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0416918-9950-441f-9c09-ef57f95ecd63 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:30.103805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a0416918-9950-441f-9c09-ef57f95ecd63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:30.200347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0416918-9950-441f-9c09-ef57f95ecd63 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:30.204699 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61705e-9df5-47b2-a2e1-dd1f17c303fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:30.205587 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61705e-9df5-47b2-a2e1-dd1f17c303fd service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:30.206180 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61705e-9df5-47b2-a2e1-dd1f17c303fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:30.206607 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61705e-9df5-47b2-a2e1-dd1f17c303fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:30.218918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61705e-9df5-47b2-a2e1-dd1f17c303fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:30.220436 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61705e-9df5-47b2-a2e1-dd1f17c303fd service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:30.242792 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1005/2022] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:30.721587 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ba080-dbfd-4a41-858e-69a06ce935b9 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:30.723041 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-0d7ba080-dbfd-4a41-858e-69a06ce935b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:30.752625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ba080-dbfd-4a41-858e-69a06ce935b9 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:30.779102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02de1f7-ccab-422f-8aca-9eb80ab3cd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:30.780379 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de1f7-ccab-422f-8aca-9eb80ab3cd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:30.780856 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de1f7-ccab-422f-8aca-9eb80ab3cd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:30.781289 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de1f7-ccab-422f-8aca-9eb80ab3cd29 admin admin] PATH_INFO: `/v3/projects/b3b253ce26894c16afcf6552e3642755` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:30.782871 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02de1f7-ccab-422f-8aca-9eb80ab3cd29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b253ce26894c16afcf6552e3642755)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:30.785030 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02de1f7-ccab-422f-8aca-9eb80ab3cd29 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:30.920669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-f02de1f7-ccab-422f-8aca-9eb80ab3cd29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b253ce26894c16afcf6552e3642755', 'request_id': 'req-f02de1f7-ccab-422f-8aca-9eb80ab3cd29'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:30.927194 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-f02de1f7-ccab-422f-8aca-9eb80ab3cd29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b253ce26894c16afcf6552e3642755', 'request_id': 'req-f02de1f7-ccab-422f-8aca-9eb80ab3cd29'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:31.003887 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-f02de1f7-ccab-422f-8aca-9eb80ab3cd29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b253ce26894c16afcf6552e3642755', 'request_id': 'req-f02de1f7-ccab-422f-8aca-9eb80ab3cd29'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:31.044097 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-f02de1f7-ccab-422f-8aca-9eb80ab3cd29 admin admin] The token cache is being invalidate because project b3b253ce26894c16afcf6552e3642755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:31.044914 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-f02de1f7-ccab-422f-8aca-9eb80ab3cd29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:31.045825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-f02de1f7-ccab-422f-8aca-9eb80ab3cd29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:31.048265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1018/2023] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:30 2022] DELETE /identity/v3/projects/b3b253ce26894c16afcf6552e3642755 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:31.053508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec42ed-a97d-4c48-ae91-ce3e9de84f9f None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:31.054089 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec42ed-a97d-4c48-ae91-ce3e9de84f9f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:31.054367 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec42ed-a97d-4c48-ae91-ce3e9de84f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:31.073068 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-34ec42ed-a97d-4c48-ae91-ce3e9de84f9f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:31.074519 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-34ec42ed-a97d-4c48-ae91-ce3e9de84f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:31.136340 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1006/2024] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:31.151486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6af4dd-5b03-4b19-8f20-c9de535bbb42 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:31.153682 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6af4dd-5b03-4b19-8f20-c9de535bbb42 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:31.153682 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6af4dd-5b03-4b19-8f20-c9de535bbb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:31.165191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec42ed-a97d-4c48-ae91-ce3e9de84f9f None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:31.166600 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-34ec42ed-a97d-4c48-ae91-ce3e9de84f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:31.175368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-0a6af4dd-5b03-4b19-8f20-c9de535bbb42 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:31.176585 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-0a6af4dd-5b03-4b19-8f20-c9de535bbb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:31.179240 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec42ed-a97d-4c48-ae91-ce3e9de84f9f None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:31.183984 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139d7b2-2a0b-44c9-af59-273b7ffe29e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:31.184900 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139d7b2-2a0b-44c9-af59-273b7ffe29e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:31.185037 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1019/2025] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:31.185180 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139d7b2-2a0b-44c9-af59-273b7ffe29e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:31.185535 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139d7b2-2a0b-44c9-af59-273b7ffe29e4 admin admin] PATH_INFO: `/v3/users/c973c34b0d934c9c88f198de32c54337` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:31.186834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139d7b2-2a0b-44c9-af59-273b7ffe29e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c973c34b0d934c9c88f198de32c54337)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:31.188918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139d7b2-2a0b-44c9-af59-273b7ffe29e4 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:31.189306 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6af4dd-5b03-4b19-8f20-c9de535bbb42 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:31.199807 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6af4dd-5b03-4b19-8f20-c9de535bbb42 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:31.204861 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bd12b-55b3-44a8-b4c4-e7dc9852c9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:31.206009 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bd12b-55b3-44a8-b4c4-e7dc9852c9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:31.206910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bd12b-55b3-44a8-b4c4-e7dc9852c9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:31.206910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bd12b-55b3-44a8-b4c4-e7dc9852c9e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:31.207301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bd12b-55b3-44a8-b4c4-e7dc9852c9e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:01:31.207659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bd12b-55b3-44a8-b4c4-e7dc9852c9e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:31.209454 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bd12b-55b3-44a8-b4c4-e7dc9852c9e3 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:31.222468 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1020/2026] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:01:31.226908 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bd12b-55b3-44a8-b4c4-e7dc9852c9e3 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:31.236549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bd12b-55b3-44a8-b4c4-e7dc9852c9e3 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:31.241094 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fef74-ae39-48b6-b1d2-5058fc0e8e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:31.241731 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fef74-ae39-48b6-b1d2-5058fc0e8e9b admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:31.242006 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fef74-ae39-48b6-b1d2-5058fc0e8e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:31.242281 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fef74-ae39-48b6-b1d2-5058fc0e8e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:31.243414 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fef74-ae39-48b6-b1d2-5058fc0e8e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:31.244878 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fef74-ae39-48b6-b1d2-5058fc0e8e9b admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:31.327834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1021/2027] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:01:31 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:01:31.332127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fef74-ae39-48b6-b1d2-5058fc0e8e9b admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:31.393063 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fef74-ae39-48b6-b1d2-5058fc0e8e9b admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:31.397688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b279fc-a3ce-47fd-bd46-fb23be1b44d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:31.398349 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b279fc-a3ce-47fd-bd46-fb23be1b44d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:31.398623 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b279fc-a3ce-47fd-bd46-fb23be1b44d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:31.398896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b279fc-a3ce-47fd-bd46-fb23be1b44d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:31.399602 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b279fc-a3ce-47fd-bd46-fb23be1b44d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:31.401517 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b279fc-a3ce-47fd-bd46-fb23be1b44d2 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:31.412865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b139d7b2-2a0b-44c9-af59-273b7ffe29e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c973c34b0d934c9c88f198de32c54337'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:31.414228 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b139d7b2-2a0b-44c9-af59-273b7ffe29e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c973c34b0d934c9c88f198de32c54337'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:31.485853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1022/2028] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:01:31 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:01:31.490232 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b279fc-a3ce-47fd-bd46-fb23be1b44d2 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:31.492251 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b139d7b2-2a0b-44c9-af59-273b7ffe29e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c973c34b0d934c9c88f198de32c54337'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:31.492520 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-89b279fc-a3ce-47fd-bd46-fb23be1b44d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:31.504868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b139d7b2-2a0b-44c9-af59-273b7ffe29e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c973c34b0d934c9c88f198de32c54337'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:31.508396 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b279fc-a3ce-47fd-bd46-fb23be1b44d2 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:31.513191 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39789ab8-a8b2-4d72-9655-4e7da52721b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:31.517873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39789ab8-a8b2-4d72-9655-4e7da52721b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:31.517873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39789ab8-a8b2-4d72-9655-4e7da52721b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:31.517873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39789ab8-a8b2-4d72-9655-4e7da52721b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:31.517873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39789ab8-a8b2-4d72-9655-4e7da52721b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:31.518204 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b139d7b2-2a0b-44c9-af59-273b7ffe29e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c973c34b0d934c9c88f198de32c54337'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:31.518296 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39789ab8-a8b2-4d72-9655-4e7da52721b9 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:31.522219 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1007/2029] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:31 2022] DELETE /identity/v3/users/c973c34b0d934c9c88f198de32c54337 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:01:31.526602 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d009d-4a22-4008-9221-da4666324d1b None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:31.526887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d009d-4a22-4008-9221-da4666324d1b None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:31.527159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d009d-4a22-4008-9221-da4666324d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:31.530670 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1023/2030] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:01:31.534530 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39789ab8-a8b2-4d72-9655-4e7da52721b9 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:31.544001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-ae2d009d-4a22-4008-9221-da4666324d1b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:31.544134 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39789ab8-a8b2-4d72-9655-4e7da52721b9 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:31.545191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ae2d009d-4a22-4008-9221-da4666324d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:31.598176 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c76862-e1ea-4090-b268-9d9ea8785a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:31.598846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c76862-e1ea-4090-b268-9d9ea8785a17 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:31.599124 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c76862-e1ea-4090-b268-9d9ea8785a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:31.599399 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c76862-e1ea-4090-b268-9d9ea8785a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:31.600143 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c76862-e1ea-4090-b268-9d9ea8785a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:31.601777 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c76862-e1ea-4090-b268-9d9ea8785a17 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:31.601875 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1008/2031] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:01:31.611438 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d009d-4a22-4008-9221-da4666324d1b None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:31.614869 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1024/2032] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:01:31.615017 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ae2d009d-4a22-4008-9221-da4666324d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:31.615685 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c76862-e1ea-4090-b268-9d9ea8785a17 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:31.625897 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c76862-e1ea-4090-b268-9d9ea8785a17 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:31.630748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f1428-9523-4cb2-bb66-50eba4576218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:31.631646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f1428-9523-4cb2-bb66-50eba4576218 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:31.632510 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f1428-9523-4cb2-bb66-50eba4576218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:31.632985 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f1428-9523-4cb2-bb66-50eba4576218 admin admin] PATH_INFO: `/v3/projects/339b183a249e4ebe91fa3245f5473a9e/users/4890bc0a17ea4518bc9276cc08357537/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:31.647051 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f1428-9523-4cb2-bb66-50eba4576218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339b183a249e4ebe91fa3245f5473a9e, user_id=4890bc0a17ea4518bc9276cc08357537, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:31.649770 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f1428-9523-4cb2-bb66-50eba4576218 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:31.669086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d009d-4a22-4008-9221-da4666324d1b None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:31.672737 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535196b-9471-4ea2-9b87-9fba12844215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:31.673384 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535196b-9471-4ea2-9b87-9fba12844215 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:31.673664 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535196b-9471-4ea2-9b87-9fba12844215 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:31.673962 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535196b-9471-4ea2-9b87-9fba12844215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:31.684266 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535196b-9471-4ea2-9b87-9fba12844215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:31.685696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535196b-9471-4ea2-9b87-9fba12844215 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:31.700129 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1009/2033] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:01:31.719895 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1025/2034] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:31 2022] PUT /identity/v3/projects/339b183a249e4ebe91fa3245f5473a9e/users/4890bc0a17ea4518bc9276cc08357537/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:01:31.734036 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eb42b-3b70-46f0-84ba-e8e30ba21604 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:31.734319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eb42b-3b70-46f0-84ba-e8e30ba21604 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:31.734594 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eb42b-3b70-46f0-84ba-e8e30ba21604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:31.765477 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-833eb42b-3b70-46f0-84ba-e8e30ba21604 None None] MFA Rules not processed for user `4890bc0a17ea4518bc9276cc08357537`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:31.766681 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-833eb42b-3b70-46f0-84ba-e8e30ba21604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:31.833532 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1010/2035] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:31.845759 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f1428-9523-4cb2-bb66-50eba4576218 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:31.847449 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-972f1428-9523-4cb2-bb66-50eba4576218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:31.903709 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f1428-9523-4cb2-bb66-50eba4576218 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:31.907390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220ba05-2980-4e89-9228-5e0ab3525eff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65583446d2e40a69dff534b73e8fa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:31.908064 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220ba05-2980-4e89-9228-5e0ab3525eff service glance] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:31.908348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220ba05-2980-4e89-9228-5e0ab3525eff service glance] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:31.908624 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220ba05-2980-4e89-9228-5e0ab3525eff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:31.918094 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220ba05-2980-4e89-9228-5e0ab3525eff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:31.919560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220ba05-2980-4e89-9228-5e0ab3525eff service glance] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:31.940623 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1026/2036] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:32.145045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eb42b-3b70-46f0-84ba-e8e30ba21604 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:32.147076 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-833eb42b-3b70-46f0-84ba-e8e30ba21604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:32.228157 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eb42b-3b70-46f0-84ba-e8e30ba21604 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:32.234480 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04483b-b3cf-4d2e-965d-aa37d793eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:32.236063 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04483b-b3cf-4d2e-965d-aa37d793eeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:32.236394 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04483b-b3cf-4d2e-965d-aa37d793eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:32.236846 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04483b-b3cf-4d2e-965d-aa37d793eeae admin admin] PATH_INFO: `/v3/projects/b1448ba6682f467e81d56376b11b7b50` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:32.238584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04483b-b3cf-4d2e-965d-aa37d793eeae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1448ba6682f467e81d56376b11b7b50)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:32.240918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04483b-b3cf-4d2e-965d-aa37d793eeae admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:32.433638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2d04483b-b3cf-4d2e-965d-aa37d793eeae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1448ba6682f467e81d56376b11b7b50', 'request_id': 'req-2d04483b-b3cf-4d2e-965d-aa37d793eeae'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:32.511862 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2d04483b-b3cf-4d2e-965d-aa37d793eeae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1448ba6682f467e81d56376b11b7b50', 'request_id': 'req-2d04483b-b3cf-4d2e-965d-aa37d793eeae'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:32.518398 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2d04483b-b3cf-4d2e-965d-aa37d793eeae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1448ba6682f467e81d56376b11b7b50', 'request_id': 'req-2d04483b-b3cf-4d2e-965d-aa37d793eeae'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:32.529276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2d04483b-b3cf-4d2e-965d-aa37d793eeae admin admin] The token cache is being invalidate because project b1448ba6682f467e81d56376b11b7b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:32.529565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2d04483b-b3cf-4d2e-965d-aa37d793eeae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:32.530205 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2d04483b-b3cf-4d2e-965d-aa37d793eeae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:32.531792 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1011/2037] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:32 2022] DELETE /identity/v3/projects/b1448ba6682f467e81d56376b11b7b50 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:32.535910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220ba05-2980-4e89-9228-5e0ab3525eff service glance] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:32.547190 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220ba05-2980-4e89-9228-5e0ab3525eff service glance] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:32.602125 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20af603-1292-4a5e-a306-73df14d24fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:32.603081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20af603-1292-4a5e-a306-73df14d24fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:32.603367 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20af603-1292-4a5e-a306-73df14d24fad admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:32.603680 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20af603-1292-4a5e-a306-73df14d24fad admin admin] PATH_INFO: `/v3/users/58e4931a116a4046a454501264e53f53` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:32.605126 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20af603-1292-4a5e-a306-73df14d24fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e4931a116a4046a454501264e53f53)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:32.607046 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20af603-1292-4a5e-a306-73df14d24fad admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:32.785554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-e20af603-1292-4a5e-a306-73df14d24fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e4931a116a4046a454501264e53f53'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:32.786199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-e20af603-1292-4a5e-a306-73df14d24fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e4931a116a4046a454501264e53f53'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:32.793189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-e20af603-1292-4a5e-a306-73df14d24fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e4931a116a4046a454501264e53f53'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:32.851372 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-e20af603-1292-4a5e-a306-73df14d24fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e4931a116a4046a454501264e53f53'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:32.870651 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-e20af603-1292-4a5e-a306-73df14d24fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e4931a116a4046a454501264e53f53'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:32.876593 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1027/2038] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:32 2022] DELETE /identity/v3/users/58e4931a116a4046a454501264e53f53 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:33.241696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04483b-b3cf-4d2e-965d-aa37d793eeae admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:33.243172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-2d04483b-b3cf-4d2e-965d-aa37d793eeae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:33.258409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04483b-b3cf-4d2e-965d-aa37d793eeae admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:33.320565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a926c-1680-4ff2-8b86-eceeb72c0576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:33.321348 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a926c-1680-4ff2-8b86-eceeb72c0576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:33.321630 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a926c-1680-4ff2-8b86-eceeb72c0576 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:33.321901 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a926c-1680-4ff2-8b86-eceeb72c0576 admin admin] PATH_INFO: `/v3/projects/d676af96e9744733b409b8b360c476bd` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:33.323105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a926c-1680-4ff2-8b86-eceeb72c0576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d676af96e9744733b409b8b360c476bd)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:33.325137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a926c-1680-4ff2-8b86-eceeb72c0576 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:33.425348 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-be6a926c-1680-4ff2-8b86-eceeb72c0576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd676af96e9744733b409b8b360c476bd', 'request_id': 'req-be6a926c-1680-4ff2-8b86-eceeb72c0576'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:33.491946 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-be6a926c-1680-4ff2-8b86-eceeb72c0576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd676af96e9744733b409b8b360c476bd', 'request_id': 'req-be6a926c-1680-4ff2-8b86-eceeb72c0576'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:33.499177 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-be6a926c-1680-4ff2-8b86-eceeb72c0576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd676af96e9744733b409b8b360c476bd', 'request_id': 'req-be6a926c-1680-4ff2-8b86-eceeb72c0576'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:33.510471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-be6a926c-1680-4ff2-8b86-eceeb72c0576 admin admin] The token cache is being invalidate because project d676af96e9744733b409b8b360c476bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:33.510766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-be6a926c-1680-4ff2-8b86-eceeb72c0576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:33.511474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-be6a926c-1680-4ff2-8b86-eceeb72c0576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:33.513037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1012/2039] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:33 2022] DELETE /identity/v3/projects/d676af96e9744733b409b8b360c476bd => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:33.518117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe6c3b-d87e-4698-8bba-f00e59ce2c5a None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:33.520814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe6c3b-d87e-4698-8bba-f00e59ce2c5a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:33.520814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe6c3b-d87e-4698-8bba-f00e59ce2c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:33.539233 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-f4fe6c3b-d87e-4698-8bba-f00e59ce2c5a None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:33.540474 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f4fe6c3b-d87e-4698-8bba-f00e59ce2c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:33.596188 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1028/2040] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:33.606154 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7c7c0-a851-4918-8dd7-23b45af204d0 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:33.606526 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7c7c0-a851-4918-8dd7-23b45af204d0 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:33.606805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7c7c0-a851-4918-8dd7-23b45af204d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:33.626294 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-08c7c7c0-a851-4918-8dd7-23b45af204d0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:33.632863 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-08c7c7c0-a851-4918-8dd7-23b45af204d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:33.635580 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1013/2041] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:33.639938 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe6c3b-d87e-4698-8bba-f00e59ce2c5a None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:33.650553 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe6c3b-d87e-4698-8bba-f00e59ce2c5a None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:33.655134 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9cbfc-44a7-4926-98e0-24502e53f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:33.655866 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9cbfc-44a7-4926-98e0-24502e53f3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:33.661575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9cbfc-44a7-4926-98e0-24502e53f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:33.661575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9cbfc-44a7-4926-98e0-24502e53f3a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:33.661575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9cbfc-44a7-4926-98e0-24502e53f3a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:01:33.661575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9cbfc-44a7-4926-98e0-24502e53f3a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:33.661575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9cbfc-44a7-4926-98e0-24502e53f3a8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:33.671286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1029/2042] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:01:33.675568 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7c7c0-a851-4918-8dd7-23b45af204d0 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:33.685896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7c7c0-a851-4918-8dd7-23b45af204d0 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:33.690727 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdb61f-f264-40fa-899e-ac82541d78a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:33.691385 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdb61f-f264-40fa-899e-ac82541d78a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:33.692491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdb61f-f264-40fa-899e-ac82541d78a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:33.692491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdb61f-f264-40fa-899e-ac82541d78a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:33.692769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdb61f-f264-40fa-899e-ac82541d78a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:33.694783 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdb61f-f264-40fa-899e-ac82541d78a5 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:33.776851 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1014/2043] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:01:33 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:33.785802 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9cbfc-44a7-4926-98e0-24502e53f3a8 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:33.796272 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9cbfc-44a7-4926-98e0-24502e53f3a8 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:33.858507 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba422c30-5567-424b-85ec-4228c46aa5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:33.859475 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba422c30-5567-424b-85ec-4228c46aa5ae admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:33.859941 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba422c30-5567-424b-85ec-4228c46aa5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:33.860381 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba422c30-5567-424b-85ec-4228c46aa5ae admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:33.861415 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba422c30-5567-424b-85ec-4228c46aa5ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:33.863568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba422c30-5567-424b-85ec-4228c46aa5ae admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:33.946978 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1030/2044] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:01:33 2022] POST /identity/v3/users => generated 282 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:33.953940 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdb61f-f264-40fa-899e-ac82541d78a5 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:33.965000 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdb61f-f264-40fa-899e-ac82541d78a5 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:33.969750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec99cd-b44c-4c36-b96c-f1ba35f12935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:33.970414 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec99cd-b44c-4c36-b96c-f1ba35f12935 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:33.970697 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec99cd-b44c-4c36-b96c-f1ba35f12935 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:33.970973 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec99cd-b44c-4c36-b96c-f1ba35f12935 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:33.971737 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec99cd-b44c-4c36-b96c-f1ba35f12935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:33.973328 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec99cd-b44c-4c36-b96c-f1ba35f12935 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:33.985571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1015/2045] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:33.993824 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba422c30-5567-424b-85ec-4228c46aa5ae admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:34.003993 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba422c30-5567-424b-85ec-4228c46aa5ae admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:34.013794 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50fd6e-4083-4c77-8647-7ca3c0b9476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:34.014463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50fd6e-4083-4c77-8647-7ca3c0b9476e admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:34.014744 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50fd6e-4083-4c77-8647-7ca3c0b9476e admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:34.015016 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50fd6e-4083-4c77-8647-7ca3c0b9476e admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:34.016030 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50fd6e-4083-4c77-8647-7ca3c0b9476e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:34.017633 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50fd6e-4083-4c77-8647-7ca3c0b9476e admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:34.029444 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1031/2046] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:34.033761 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec99cd-b44c-4c36-b96c-f1ba35f12935 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:34.046388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec99cd-b44c-4c36-b96c-f1ba35f12935 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:34.052313 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d935e-3c0a-4b86-948d-9e205846da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:34.053272 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d935e-3c0a-4b86-948d-9e205846da5c admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:34.057061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d935e-3c0a-4b86-948d-9e205846da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:34.057061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d935e-3c0a-4b86-948d-9e205846da5c admin admin] PATH_INFO: `/v3/projects/8728c4de8d314d878a74384760d9445b/users/44147787d6644392b5dd1b95679ee6c7/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:34.072973 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d935e-3c0a-4b86-948d-9e205846da5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8728c4de8d314d878a74384760d9445b, user_id=44147787d6644392b5dd1b95679ee6c7, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:34.075921 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d935e-3c0a-4b86-948d-9e205846da5c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:34.223410 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1016/2047] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:34 2022] PUT /identity/v3/projects/8728c4de8d314d878a74384760d9445b/users/44147787d6644392b5dd1b95679ee6c7/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:34.325780 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27101f36-5bca-4d24-81db-e8c56875930a None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:34.326072 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27101f36-5bca-4d24-81db-e8c56875930a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:34.326353 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27101f36-5bca-4d24-81db-e8c56875930a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:34.357234 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-27101f36-5bca-4d24-81db-e8c56875930a None None] MFA Rules not processed for user `44147787d6644392b5dd1b95679ee6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:34.361740 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-27101f36-5bca-4d24-81db-e8c56875930a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:34.425577 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1032/2048] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:34.431128 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d935e-3c0a-4b86-948d-9e205846da5c admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:34.499017 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d935e-3c0a-4b86-948d-9e205846da5c admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:34.503732 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd2cb4-9661-4488-a53a-8b5309688ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:34.504404 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd2cb4-9661-4488-a53a-8b5309688ddb admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:34.504688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd2cb4-9661-4488-a53a-8b5309688ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:34.504967 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd2cb4-9661-4488-a53a-8b5309688ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:34.505670 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd2cb4-9661-4488-a53a-8b5309688ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:34.508438 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd2cb4-9661-4488-a53a-8b5309688ddb admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:34.615687 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1017/2049] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:01:34 2022] POST /identity/v3/projects => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:34.626962 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27101f36-5bca-4d24-81db-e8c56875930a None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:34.638727 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27101f36-5bca-4d24-81db-e8c56875930a None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:34.697609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94eddc-a05a-4484-b5a8-1dbaf85f94a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:34.698299 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94eddc-a05a-4484-b5a8-1dbaf85f94a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:34.698576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94eddc-a05a-4484-b5a8-1dbaf85f94a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:34.698844 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94eddc-a05a-4484-b5a8-1dbaf85f94a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:34.699572 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94eddc-a05a-4484-b5a8-1dbaf85f94a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:34.701708 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94eddc-a05a-4484-b5a8-1dbaf85f94a3 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:34.801523 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1033/2050] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:01:34 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:01:34.806057 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd2cb4-9661-4488-a53a-8b5309688ddb admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:34.817750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd2cb4-9661-4488-a53a-8b5309688ddb admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:34.823388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16d96f-fe32-480c-bc0a-077128652bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:34.824763 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16d96f-fe32-480c-bc0a-077128652bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:34.824763 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16d96f-fe32-480c-bc0a-077128652bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:34.824763 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16d96f-fe32-480c-bc0a-077128652bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:34.825613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16d96f-fe32-480c-bc0a-077128652bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:34.827363 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16d96f-fe32-480c-bc0a-077128652bd8 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:34.840966 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1018/2051] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:34.845505 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94eddc-a05a-4484-b5a8-1dbaf85f94a3 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:34.857030 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94eddc-a05a-4484-b5a8-1dbaf85f94a3 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:34.863465 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f74d0-f7e7-463a-9ea0-4a3b2d1a9a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:34.864691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f74d0-f7e7-463a-9ea0-4a3b2d1a9a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:34.864972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f74d0-f7e7-463a-9ea0-4a3b2d1a9a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:34.865344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f74d0-f7e7-463a-9ea0-4a3b2d1a9a52 admin admin] PATH_INFO: `/v3/projects/3f64b4c7983647378a5b60fbf1e77240/users/1ddae43c696a434f856d68e341c6f752/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:34.889619 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f74d0-f7e7-463a-9ea0-4a3b2d1a9a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f64b4c7983647378a5b60fbf1e77240, user_id=1ddae43c696a434f856d68e341c6f752, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:34.893070 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f74d0-f7e7-463a-9ea0-4a3b2d1a9a52 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:34.971395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1034/2052] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:34 2022] PUT /identity/v3/projects/3f64b4c7983647378a5b60fbf1e77240/users/1ddae43c696a434f856d68e341c6f752/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:34.976127 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16d96f-fe32-480c-bc0a-077128652bd8 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:34.988945 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16d96f-fe32-480c-bc0a-077128652bd8 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:35.072521 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cdc06-b55f-4311-a5fc-f5ead5fcfd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:35.074056 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cdc06-b55f-4311-a5fc-f5ead5fcfd2b admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:35.074346 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cdc06-b55f-4311-a5fc-f5ead5fcfd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:35.074627 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cdc06-b55f-4311-a5fc-f5ead5fcfd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:35.075548 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6cdc06-b55f-4311-a5fc-f5ead5fcfd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:35.077434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6cdc06-b55f-4311-a5fc-f5ead5fcfd2b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:35.126661 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1019/2053] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:35.132036 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f74d0-f7e7-463a-9ea0-4a3b2d1a9a52 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:35.145442 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f74d0-f7e7-463a-9ea0-4a3b2d1a9a52 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:35.163807 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc72c5e-0fd6-4003-8f87-cdb536ebdd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:35.168190 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc72c5e-0fd6-4003-8f87-cdb536ebdd41 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:35.171385 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc72c5e-0fd6-4003-8f87-cdb536ebdd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:35.173101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc72c5e-0fd6-4003-8f87-cdb536ebdd41 admin admin] PATH_INFO: `/v3/projects/3f64b4c7983647378a5b60fbf1e77240/users/1ddae43c696a434f856d68e341c6f752/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:35.178336 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc72c5e-0fd6-4003-8f87-cdb536ebdd41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f64b4c7983647378a5b60fbf1e77240, user_id=1ddae43c696a434f856d68e341c6f752, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:35.184794 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc72c5e-0fd6-4003-8f87-cdb536ebdd41 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:35.224439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1035/2054] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:35 2022] PUT /identity/v3/projects/3f64b4c7983647378a5b60fbf1e77240/users/1ddae43c696a434f856d68e341c6f752/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:35.236969 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbdd2f-d538-488c-b015-0ee277eb1044 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:35.242370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbdd2f-d538-488c-b015-0ee277eb1044 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:35.242370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbdd2f-d538-488c-b015-0ee277eb1044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:35.284360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-d3fbdd2f-d538-488c-b015-0ee277eb1044 None None] MFA Rules not processed for user `1ddae43c696a434f856d68e341c6f752`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:35.284360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d3fbdd2f-d538-488c-b015-0ee277eb1044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:35.387169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1020/2055] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:35 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:35.399670 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc72c5e-0fd6-4003-8f87-cdb536ebdd41 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:35.401453 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-4cc72c5e-0fd6-4003-8f87-cdb536ebdd41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:35.474952 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc72c5e-0fd6-4003-8f87-cdb536ebdd41 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:35.481085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f83636-965e-4ef3-b08d-3abfdd4f6d8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:35.484729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f83636-965e-4ef3-b08d-3abfdd4f6d8f service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:35.484729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f83636-965e-4ef3-b08d-3abfdd4f6d8f service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:35.484729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f83636-965e-4ef3-b08d-3abfdd4f6d8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:35.498045 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f83636-965e-4ef3-b08d-3abfdd4f6d8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:35.500323 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f83636-965e-4ef3-b08d-3abfdd4f6d8f service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:35.514948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1036/2056] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:35 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:35.743943 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbdd2f-d538-488c-b015-0ee277eb1044 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:35.753232 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbdd2f-d538-488c-b015-0ee277eb1044 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:35.757454 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3161ae0-4c2a-4e84-96ad-ccfe6d1b583f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:35.758202 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3161ae0-4c2a-4e84-96ad-ccfe6d1b583f service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:35.758563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3161ae0-4c2a-4e84-96ad-ccfe6d1b583f service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:35.759045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3161ae0-4c2a-4e84-96ad-ccfe6d1b583f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:35.829206 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3161ae0-4c2a-4e84-96ad-ccfe6d1b583f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:35.830725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3161ae0-4c2a-4e84-96ad-ccfe6d1b583f service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:35.840893 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1021/2057] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:36.118947 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f83636-965e-4ef3-b08d-3abfdd4f6d8f service cinder] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:36.122114 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-63f83636-965e-4ef3-b08d-3abfdd4f6d8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:36.209287 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f83636-965e-4ef3-b08d-3abfdd4f6d8f service cinder] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:36.215501 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d7007-5803-40f6-8e85-4952b9341cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:36.216550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d7007-5803-40f6-8e85-4952b9341cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:36.216926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d7007-5803-40f6-8e85-4952b9341cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:36.217428 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d7007-5803-40f6-8e85-4952b9341cc5 admin admin] PATH_INFO: `/v3/users/abd58985a7e84aa7b084862024d6ee41` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:36.218921 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d7007-5803-40f6-8e85-4952b9341cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd58985a7e84aa7b084862024d6ee41)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:36.221103 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d7007-5803-40f6-8e85-4952b9341cc5 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:36.499206 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ae9d7007-5803-40f6-8e85-4952b9341cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd58985a7e84aa7b084862024d6ee41'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:36.499970 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ae9d7007-5803-40f6-8e85-4952b9341cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd58985a7e84aa7b084862024d6ee41'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:36.507773 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ae9d7007-5803-40f6-8e85-4952b9341cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd58985a7e84aa7b084862024d6ee41'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:36.599445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ae9d7007-5803-40f6-8e85-4952b9341cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd58985a7e84aa7b084862024d6ee41'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:36.612059 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ae9d7007-5803-40f6-8e85-4952b9341cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd58985a7e84aa7b084862024d6ee41'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:36.622092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1037/2058] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:36 2022] DELETE /identity/v3/users/abd58985a7e84aa7b084862024d6ee41 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:36.915882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3161ae0-4c2a-4e84-96ad-ccfe6d1b583f service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:36.929315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3161ae0-4c2a-4e84-96ad-ccfe6d1b583f service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:37.035710 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60657cd3-266f-48db-9a32-3141c0a3cb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:37.037089 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60657cd3-266f-48db-9a32-3141c0a3cb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:37.037262 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60657cd3-266f-48db-9a32-3141c0a3cb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:37.040006 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60657cd3-266f-48db-9a32-3141c0a3cb4f admin admin] PATH_INFO: `/v3/projects/3a975172f150436bb1a0fef5a805dabc` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:37.042180 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60657cd3-266f-48db-9a32-3141c0a3cb4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a975172f150436bb1a0fef5a805dabc)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:37.044496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60657cd3-266f-48db-9a32-3141c0a3cb4f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:37.205585 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-60657cd3-266f-48db-9a32-3141c0a3cb4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a975172f150436bb1a0fef5a805dabc', 'request_id': 'req-60657cd3-266f-48db-9a32-3141c0a3cb4f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:37.308134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-60657cd3-266f-48db-9a32-3141c0a3cb4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a975172f150436bb1a0fef5a805dabc', 'request_id': 'req-60657cd3-266f-48db-9a32-3141c0a3cb4f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:37.321363 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-60657cd3-266f-48db-9a32-3141c0a3cb4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a975172f150436bb1a0fef5a805dabc', 'request_id': 'req-60657cd3-266f-48db-9a32-3141c0a3cb4f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:37.332252 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-60657cd3-266f-48db-9a32-3141c0a3cb4f admin admin] The token cache is being invalidate because project 3a975172f150436bb1a0fef5a805dabc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:37.332629 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-60657cd3-266f-48db-9a32-3141c0a3cb4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:37.333336 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-60657cd3-266f-48db-9a32-3141c0a3cb4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:37.335588 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1022/2059] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:36 2022] DELETE /identity/v3/projects/3a975172f150436bb1a0fef5a805dabc => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:37.340633 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a3b5a-a53f-48fb-915d-0a4f05b9871a None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:37.341483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a3b5a-a53f-48fb-915d-0a4f05b9871a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:37.341483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a3b5a-a53f-48fb-915d-0a4f05b9871a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:37.361678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-f11a3b5a-a53f-48fb-915d-0a4f05b9871a None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:37.364647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f11a3b5a-a53f-48fb-915d-0a4f05b9871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:37.427029 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1038/2060] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:01:37.435203 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f363f7-ac6d-48d8-9557-e3b427ed320b None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:37.435437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f363f7-ac6d-48d8-9557-e3b427ed320b None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:37.435751 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f363f7-ac6d-48d8-9557-e3b427ed320b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:37.462815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-64f363f7-ac6d-48d8-9557-e3b427ed320b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:37.464088 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-64f363f7-ac6d-48d8-9557-e3b427ed320b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:37.473095 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1023/2061] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:37.478805 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a3b5a-a53f-48fb-915d-0a4f05b9871a None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:37.495437 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a3b5a-a53f-48fb-915d-0a4f05b9871a None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:37.498122 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5abe4-858d-4793-ad09-10c3af332996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:37.498786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5abe4-858d-4793-ad09-10c3af332996 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:37.499073 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5abe4-858d-4793-ad09-10c3af332996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:37.499349 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5abe4-858d-4793-ad09-10c3af332996 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:37.500137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5abe4-858d-4793-ad09-10c3af332996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:01:37.500451 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5abe4-858d-4793-ad09-10c3af332996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:37.502089 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5abe4-858d-4793-ad09-10c3af332996 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:37.514534 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1039/2062] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:01:37.519033 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f363f7-ac6d-48d8-9557-e3b427ed320b None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:37.529612 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f363f7-ac6d-48d8-9557-e3b427ed320b None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:37.535126 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795ca7f-2757-488b-8fdb-ca9d9fb21352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:37.535839 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795ca7f-2757-488b-8fdb-ca9d9fb21352 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:37.536123 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795ca7f-2757-488b-8fdb-ca9d9fb21352 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:37.536400 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795ca7f-2757-488b-8fdb-ca9d9fb21352 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:37.537150 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795ca7f-2757-488b-8fdb-ca9d9fb21352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:37.539654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795ca7f-2757-488b-8fdb-ca9d9fb21352 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:37.651893 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1024/2063] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:01:37 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:37.652813 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5abe4-858d-4793-ad09-10c3af332996 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:37.666488 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5abe4-858d-4793-ad09-10c3af332996 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:37.746722 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c80a8-1294-4f9d-ad96-b392cfc5cd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:37.747503 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c80a8-1294-4f9d-ad96-b392cfc5cd69 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:37.747894 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c80a8-1294-4f9d-ad96-b392cfc5cd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:37.748240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c80a8-1294-4f9d-ad96-b392cfc5cd69 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:37.749003 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c80a8-1294-4f9d-ad96-b392cfc5cd69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:37.751033 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c80a8-1294-4f9d-ad96-b392cfc5cd69 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:37.851394 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1040/2064] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:01:37 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:01:37.857855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795ca7f-2757-488b-8fdb-ca9d9fb21352 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:37.868310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795ca7f-2757-488b-8fdb-ca9d9fb21352 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:37.873012 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620ae3f-e635-4aec-b964-9d92ed1bb0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:37.873672 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620ae3f-e635-4aec-b964-9d92ed1bb0cb admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:37.873948 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620ae3f-e635-4aec-b964-9d92ed1bb0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:37.874217 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620ae3f-e635-4aec-b964-9d92ed1bb0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:37.874932 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620ae3f-e635-4aec-b964-9d92ed1bb0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:37.876550 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620ae3f-e635-4aec-b964-9d92ed1bb0cb admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:37.893046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1025/2065] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:37.894625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c80a8-1294-4f9d-ad96-b392cfc5cd69 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:37.909744 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c80a8-1294-4f9d-ad96-b392cfc5cd69 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:37.917085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3290e-c5d5-4cb4-8f95-0d9d6a3298b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:37.918249 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3290e-c5d5-4cb4-8f95-0d9d6a3298b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:37.918750 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3290e-c5d5-4cb4-8f95-0d9d6a3298b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:37.919253 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3290e-c5d5-4cb4-8f95-0d9d6a3298b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:37.920592 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3290e-c5d5-4cb4-8f95-0d9d6a3298b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:37.922232 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3290e-c5d5-4cb4-8f95-0d9d6a3298b8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:37.936252 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1041/2066] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:37.940867 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620ae3f-e635-4aec-b964-9d92ed1bb0cb admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:37.951852 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620ae3f-e635-4aec-b964-9d92ed1bb0cb admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:37.956511 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23607d0e-df52-4941-8629-2c09760e8246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:37.957393 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23607d0e-df52-4941-8629-2c09760e8246 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:37.957752 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23607d0e-df52-4941-8629-2c09760e8246 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:37.958044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23607d0e-df52-4941-8629-2c09760e8246 admin admin] PATH_INFO: `/v3/projects/c6b865e007434b11a5830b1279954322/users/420d44749c064fc883bc3aadd9d2e8cc/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:37.975435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23607d0e-df52-4941-8629-2c09760e8246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b865e007434b11a5830b1279954322, user_id=420d44749c064fc883bc3aadd9d2e8cc, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:37.978717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23607d0e-df52-4941-8629-2c09760e8246 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:38.062701 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1026/2067] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:37 2022] PUT /identity/v3/projects/c6b865e007434b11a5830b1279954322/users/420d44749c064fc883bc3aadd9d2e8cc/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:38.067862 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9add1-8b04-49b8-a669-e7acc40f8809 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:38.068157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9add1-8b04-49b8-a669-e7acc40f8809 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:38.068485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9add1-8b04-49b8-a669-e7acc40f8809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:38.090460 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-60a9add1-8b04-49b8-a669-e7acc40f8809 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:38.090460 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-60a9add1-8b04-49b8-a669-e7acc40f8809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:38.163376 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1042/2068] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:38.183424 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23607d0e-df52-4941-8629-2c09760e8246 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:38.185982 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-23607d0e-df52-4941-8629-2c09760e8246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:38.262972 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23607d0e-df52-4941-8629-2c09760e8246 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:38.266658 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6dc789-f9ff-450f-93de-4e71622d6f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:38.267318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dc789-f9ff-450f-93de-4e71622d6f92 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:38.267760 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dc789-f9ff-450f-93de-4e71622d6f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:38.268031 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dc789-f9ff-450f-93de-4e71622d6f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:38.278623 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6dc789-f9ff-450f-93de-4e71622d6f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:38.283058 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6dc789-f9ff-450f-93de-4e71622d6f92 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:38.301584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1027/2069] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:39.585772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9add1-8b04-49b8-a669-e7acc40f8809 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:39.587575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-60a9add1-8b04-49b8-a669-e7acc40f8809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:39.612158 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9add1-8b04-49b8-a669-e7acc40f8809 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:39.619073 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f088192-cc40-4401-a619-b41dd9249b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:39.621154 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f088192-cc40-4401-a619-b41dd9249b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:39.621601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f088192-cc40-4401-a619-b41dd9249b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:39.621882 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f088192-cc40-4401-a619-b41dd9249b56 admin admin] PATH_INFO: `/v3/users/e7c4d46e697d48948ac8439d29dc8f71` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:39.624275 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f088192-cc40-4401-a619-b41dd9249b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c4d46e697d48948ac8439d29dc8f71)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:39.626462 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f088192-cc40-4401-a619-b41dd9249b56 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:39.958006 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3f088192-cc40-4401-a619-b41dd9249b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c4d46e697d48948ac8439d29dc8f71'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:39.958768 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3f088192-cc40-4401-a619-b41dd9249b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c4d46e697d48948ac8439d29dc8f71'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:39.967587 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3f088192-cc40-4401-a619-b41dd9249b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c4d46e697d48948ac8439d29dc8f71'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:40.057586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3f088192-cc40-4401-a619-b41dd9249b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c4d46e697d48948ac8439d29dc8f71'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:40.073892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3f088192-cc40-4401-a619-b41dd9249b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c4d46e697d48948ac8439d29dc8f71'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:40.082182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1043/2070] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:39 2022] DELETE /identity/v3/users/e7c4d46e697d48948ac8439d29dc8f71 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:40.087973 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53776322-2d30-4736-ac45-d6d3a0c5bcfc None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:40.088845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53776322-2d30-4736-ac45-d6d3a0c5bcfc None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:40.090440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53776322-2d30-4736-ac45-d6d3a0c5bcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:40.109673 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-53776322-2d30-4736-ac45-d6d3a0c5bcfc None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:40.111070 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-53776322-2d30-4736-ac45-d6d3a0c5bcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:40.192345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1028/2071] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:40.204366 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f088192-cc40-4401-a619-b41dd9249b56 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:40.212103 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3f088192-cc40-4401-a619-b41dd9249b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:40.310954 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f088192-cc40-4401-a619-b41dd9249b56 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:40.315636 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcac872-9d81-48fa-9f11-506d8287168e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:40.316715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcac872-9d81-48fa-9f11-506d8287168e service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:40.317215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcac872-9d81-48fa-9f11-506d8287168e service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:40.317684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcac872-9d81-48fa-9f11-506d8287168e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:40.335580 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcac872-9d81-48fa-9f11-506d8287168e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:40.337527 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcac872-9d81-48fa-9f11-506d8287168e service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:40.349167 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1044/2072] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:01:40.940563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53776322-2d30-4736-ac45-d6d3a0c5bcfc None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:40.942037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-53776322-2d30-4736-ac45-d6d3a0c5bcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:40.969528 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53776322-2d30-4736-ac45-d6d3a0c5bcfc None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:40.999596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:41.000683 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:41.001119 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:41.001569 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0 admin admin] PATH_INFO: `/v3/projects/aa74b29e5d4a4fe19382ca2a2294ef46` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:41.003022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa74b29e5d4a4fe19382ca2a2294ef46)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:41.005404 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:41.181423 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa74b29e5d4a4fe19382ca2a2294ef46', 'request_id': 'req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:41.290899 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa74b29e5d4a4fe19382ca2a2294ef46', 'request_id': 'req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:41.302504 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa74b29e5d4a4fe19382ca2a2294ef46', 'request_id': 'req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:41.317657 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0 admin admin] The token cache is being invalidate because project aa74b29e5d4a4fe19382ca2a2294ef46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:41.318388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:41.321112 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:41.326909 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1029/2073] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:40 2022] DELETE /identity/v3/projects/aa74b29e5d4a4fe19382ca2a2294ef46 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:41.328851 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcac872-9d81-48fa-9f11-506d8287168e service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:41.341751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcac872-9d81-48fa-9f11-506d8287168e service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:41.418102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c66ae-b86d-4372-9d41-eaf4ad4fb119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:41.419964 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c66ae-b86d-4372-9d41-eaf4ad4fb119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:41.420246 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c66ae-b86d-4372-9d41-eaf4ad4fb119 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:41.420521 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c66ae-b86d-4372-9d41-eaf4ad4fb119 admin admin] PATH_INFO: `/v3/users/29968b3bd55e4fb8a59e1bd92743eecf` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:41.421892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c66ae-b86d-4372-9d41-eaf4ad4fb119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29968b3bd55e4fb8a59e1bd92743eecf)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:41.423939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c66ae-b86d-4372-9d41-eaf4ad4fb119 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:41.680973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5b8c66ae-b86d-4372-9d41-eaf4ad4fb119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29968b3bd55e4fb8a59e1bd92743eecf'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:41.680973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5b8c66ae-b86d-4372-9d41-eaf4ad4fb119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29968b3bd55e4fb8a59e1bd92743eecf'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:41.687809 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5b8c66ae-b86d-4372-9d41-eaf4ad4fb119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29968b3bd55e4fb8a59e1bd92743eecf'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:41.757285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5b8c66ae-b86d-4372-9d41-eaf4ad4fb119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29968b3bd55e4fb8a59e1bd92743eecf'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:41.770535 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5b8c66ae-b86d-4372-9d41-eaf4ad4fb119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29968b3bd55e4fb8a59e1bd92743eecf'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:41.778243 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1045/2074] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:41 2022] DELETE /identity/v3/users/29968b3bd55e4fb8a59e1bd92743eecf => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:42.606736 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:42.608238 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:42.622664 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efc8cc-00c0-4533-ae8f-206871d6c0f0 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:42.683248 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883a67d-44dc-4234-b0be-7009435f7fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:42.684492 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883a67d-44dc-4234-b0be-7009435f7fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:42.684902 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883a67d-44dc-4234-b0be-7009435f7fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:42.685533 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883a67d-44dc-4234-b0be-7009435f7fc3 admin admin] PATH_INFO: `/v3/projects/9cf542efb37649af86f1831f6274f094` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:42.686869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883a67d-44dc-4234-b0be-7009435f7fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf542efb37649af86f1831f6274f094)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:42.689141 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883a67d-44dc-4234-b0be-7009435f7fc3 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:42.825633 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-7883a67d-44dc-4234-b0be-7009435f7fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf542efb37649af86f1831f6274f094', 'request_id': 'req-7883a67d-44dc-4234-b0be-7009435f7fc3'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:42.919120 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-7883a67d-44dc-4234-b0be-7009435f7fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf542efb37649af86f1831f6274f094', 'request_id': 'req-7883a67d-44dc-4234-b0be-7009435f7fc3'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:42.926012 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-7883a67d-44dc-4234-b0be-7009435f7fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf542efb37649af86f1831f6274f094', 'request_id': 'req-7883a67d-44dc-4234-b0be-7009435f7fc3'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:42.945833 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-7883a67d-44dc-4234-b0be-7009435f7fc3 admin admin] The token cache is being invalidate because project 9cf542efb37649af86f1831f6274f094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:42.946230 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-7883a67d-44dc-4234-b0be-7009435f7fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:42.946882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-7883a67d-44dc-4234-b0be-7009435f7fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:42.948512 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1030/2075] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:42 2022] DELETE /identity/v3/projects/9cf542efb37649af86f1831f6274f094 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:42.953445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2f735-85db-41e0-ba7a-02c56faf0595 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:42.953919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2f735-85db-41e0-ba7a-02c56faf0595 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:42.954241 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2f735-85db-41e0-ba7a-02c56faf0595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:42.973767 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-28f2f735-85db-41e0-ba7a-02c56faf0595 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:42.975312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-28f2f735-85db-41e0-ba7a-02c56faf0595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:43.056838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1046/2076] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:43.058771 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70164-2123-4465-930e-3b5a0cd4a329 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:43.059378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70164-2123-4465-930e-3b5a0cd4a329 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:43.059922 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70164-2123-4465-930e-3b5a0cd4a329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:43.086668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-03c70164-2123-4465-930e-3b5a0cd4a329 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:43.088574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-03c70164-2123-4465-930e-3b5a0cd4a329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:43.097284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1031/2077] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:43.101864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2f735-85db-41e0-ba7a-02c56faf0595 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:43.139927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2f735-85db-41e0-ba7a-02c56faf0595 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:43.149601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba0b49-de48-42c3-81e6-d2dd994de847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:43.150481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba0b49-de48-42c3-81e6-d2dd994de847 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:43.150921 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba0b49-de48-42c3-81e6-d2dd994de847 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:43.151208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba0b49-de48-42c3-81e6-d2dd994de847 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:43.152069 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba0b49-de48-42c3-81e6-d2dd994de847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:01:43.152650 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba0b49-de48-42c3-81e6-d2dd994de847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:43.154488 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba0b49-de48-42c3-81e6-d2dd994de847 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:43.176992 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1047/2078] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:01:43.179280 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c70164-2123-4465-930e-3b5a0cd4a329 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:43.202322 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c70164-2123-4465-930e-3b5a0cd4a329 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:43.208259 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93ead2-1427-489f-8f80-7d57dd0203e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:43.209716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93ead2-1427-489f-8f80-7d57dd0203e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:43.210155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93ead2-1427-489f-8f80-7d57dd0203e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:43.210573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93ead2-1427-489f-8f80-7d57dd0203e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:43.211810 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93ead2-1427-489f-8f80-7d57dd0203e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:43.215729 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93ead2-1427-489f-8f80-7d57dd0203e2 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:43.356835 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1032/2079] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:01:43 2022] POST /identity/v3/projects => generated 409 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:43.358285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba0b49-de48-42c3-81e6-d2dd994de847 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:43.368799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba0b49-de48-42c3-81e6-d2dd994de847 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:43.444686 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e6135-ecec-4448-9936-8c1a14e15c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:43.445383 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e6135-ecec-4448-9936-8c1a14e15c35 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:43.445670 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e6135-ecec-4448-9936-8c1a14e15c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:43.445947 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e6135-ecec-4448-9936-8c1a14e15c35 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:43.446957 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e6135-ecec-4448-9936-8c1a14e15c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:43.449007 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e6135-ecec-4448-9936-8c1a14e15c35 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:43.570675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1048/2080] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:01:43 2022] POST /identity/v3/users => generated 305 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:43.574190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93ead2-1427-489f-8f80-7d57dd0203e2 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:43.591758 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93ead2-1427-489f-8f80-7d57dd0203e2 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:43.597533 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13fbe3-fc78-4ab3-b312-10aed092db65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:43.598557 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13fbe3-fc78-4ab3-b312-10aed092db65 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:43.598998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13fbe3-fc78-4ab3-b312-10aed092db65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:43.599276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13fbe3-fc78-4ab3-b312-10aed092db65 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:43.609632 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13fbe3-fc78-4ab3-b312-10aed092db65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:43.609632 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13fbe3-fc78-4ab3-b312-10aed092db65 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:43.627440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1033/2081] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:43.630210 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e6135-ecec-4448-9936-8c1a14e15c35 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:43.644858 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e6135-ecec-4448-9936-8c1a14e15c35 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:43.651603 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95d78d-c90d-49ba-93c9-2b545861963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:43.656185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95d78d-c90d-49ba-93c9-2b545861963a admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:43.656185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95d78d-c90d-49ba-93c9-2b545861963a admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:43.656185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95d78d-c90d-49ba-93c9-2b545861963a admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:43.656185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95d78d-c90d-49ba-93c9-2b545861963a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:43.656185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95d78d-c90d-49ba-93c9-2b545861963a admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:43.669962 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1049/2082] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:43.673480 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13fbe3-fc78-4ab3-b312-10aed092db65 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:43.686380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13fbe3-fc78-4ab3-b312-10aed092db65 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:43.701069 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc2d47-98cf-42dd-b2e5-42f1d6d6204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:43.701983 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc2d47-98cf-42dd-b2e5-42f1d6d6204f admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:43.702483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc2d47-98cf-42dd-b2e5-42f1d6d6204f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:43.702784 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc2d47-98cf-42dd-b2e5-42f1d6d6204f admin admin] PATH_INFO: `/v3/projects/b55b4b6d2f42482db1988efcbcbc564a/users/44768e5a55894425839f21b0c997a453/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:43.739855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc2d47-98cf-42dd-b2e5-42f1d6d6204f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55b4b6d2f42482db1988efcbcbc564a, user_id=44768e5a55894425839f21b0c997a453, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:43.748074 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc2d47-98cf-42dd-b2e5-42f1d6d6204f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:43.833828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1034/2083] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:43 2022] PUT /identity/v3/projects/b55b4b6d2f42482db1988efcbcbc564a/users/44768e5a55894425839f21b0c997a453/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:01:43.837302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153a7bc-2560-40e5-9005-90bc42d43989 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:43.837603 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153a7bc-2560-40e5-9005-90bc42d43989 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:43.838058 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153a7bc-2560-40e5-9005-90bc42d43989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:43.895753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c153a7bc-2560-40e5-9005-90bc42d43989 None None] MFA Rules not processed for user `44768e5a55894425839f21b0c997a453`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:43.895753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c153a7bc-2560-40e5-9005-90bc42d43989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:44.030130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1050/2084] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:43 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:44.034871 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc2d47-98cf-42dd-b2e5-42f1d6d6204f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:44.160518 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc2d47-98cf-42dd-b2e5-42f1d6d6204f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:44.181764 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f23f0-fa3b-4301-b6c9-e3daad80ef4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:44.183717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f23f0-fa3b-4301-b6c9-e3daad80ef4c admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:44.184101 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f23f0-fa3b-4301-b6c9-e3daad80ef4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:44.184611 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f23f0-fa3b-4301-b6c9-e3daad80ef4c admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:44.186187 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f23f0-fa3b-4301-b6c9-e3daad80ef4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:44.190514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f23f0-fa3b-4301-b6c9-e3daad80ef4c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:44.307781 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1035/2085] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:01:44 2022] POST /identity/v3/projects => generated 409 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:44.309061 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153a7bc-2560-40e5-9005-90bc42d43989 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:44.321361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153a7bc-2560-40e5-9005-90bc42d43989 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:44.396469 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafc4cb-f802-45db-abd5-de3b78a4c9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:44.397214 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafc4cb-f802-45db-abd5-de3b78a4c9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:44.397698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafc4cb-f802-45db-abd5-de3b78a4c9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:44.397978 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafc4cb-f802-45db-abd5-de3b78a4c9c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:44.398685 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafc4cb-f802-45db-abd5-de3b78a4c9c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:44.400756 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafc4cb-f802-45db-abd5-de3b78a4c9c1 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:44.551651 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1051/2086] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:01:44 2022] POST /identity/v3/users => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:44.556415 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f23f0-fa3b-4301-b6c9-e3daad80ef4c admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:44.570602 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f23f0-fa3b-4301-b6c9-e3daad80ef4c admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:44.607050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3447c7-8e96-4fba-b9d2-afe42414b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:44.607778 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3447c7-8e96-4fba-b9d2-afe42414b821 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:44.608068 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3447c7-8e96-4fba-b9d2-afe42414b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:44.612185 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3447c7-8e96-4fba-b9d2-afe42414b821 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:44.612185 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3447c7-8e96-4fba-b9d2-afe42414b821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:44.614302 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3447c7-8e96-4fba-b9d2-afe42414b821 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:44.632532 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafc4cb-f802-45db-abd5-de3b78a4c9c1 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:44.645010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1036/2087] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:44.650516 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafc4cb-f802-45db-abd5-de3b78a4c9c1 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:44.656846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70bad1-a0d5-402a-8b64-2d6629bdb6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:44.657759 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70bad1-a0d5-402a-8b64-2d6629bdb6c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:44.658039 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70bad1-a0d5-402a-8b64-2d6629bdb6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:44.658315 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70bad1-a0d5-402a-8b64-2d6629bdb6c5 admin admin] PATH_INFO: `/v3/projects/5cbc5db570b347b8959a83c025cc750b/users/95a17b7f256b439bba94aa3efd99460c/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:44.687474 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70bad1-a0d5-402a-8b64-2d6629bdb6c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbc5db570b347b8959a83c025cc750b, user_id=95a17b7f256b439bba94aa3efd99460c, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:44.695262 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70bad1-a0d5-402a-8b64-2d6629bdb6c5 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:44.789310 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1052/2088] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:44 2022] PUT /identity/v3/projects/5cbc5db570b347b8959a83c025cc750b/users/95a17b7f256b439bba94aa3efd99460c/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:44.793549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3447c7-8e96-4fba-b9d2-afe42414b821 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:44.811312 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3447c7-8e96-4fba-b9d2-afe42414b821 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:44.946707 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4ccc0-7f16-47d3-8c38-29b33d496e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:44.947859 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4ccc0-7f16-47d3-8c38-29b33d496e81 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:44.951763 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4ccc0-7f16-47d3-8c38-29b33d496e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:44.952642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4ccc0-7f16-47d3-8c38-29b33d496e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:44.953571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4ccc0-7f16-47d3-8c38-29b33d496e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:44.955426 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4ccc0-7f16-47d3-8c38-29b33d496e81 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:44.969374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1037/2089] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:44.973265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70bad1-a0d5-402a-8b64-2d6629bdb6c5 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:44.987212 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70bad1-a0d5-402a-8b64-2d6629bdb6c5 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:44.997570 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c70563-d53f-43be-afa6-651205956c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:44.998694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c70563-d53f-43be-afa6-651205956c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:44.999410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c70563-d53f-43be-afa6-651205956c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:44.999857 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c70563-d53f-43be-afa6-651205956c7c admin admin] PATH_INFO: `/v3/projects/5cbc5db570b347b8959a83c025cc750b/users/95a17b7f256b439bba94aa3efd99460c/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:45.002627 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c70563-d53f-43be-afa6-651205956c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbc5db570b347b8959a83c025cc750b, user_id=95a17b7f256b439bba94aa3efd99460c, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:45.007330 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c70563-d53f-43be-afa6-651205956c7c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:45.023953 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1053/2090] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:44 2022] PUT /identity/v3/projects/5cbc5db570b347b8959a83c025cc750b/users/95a17b7f256b439bba94aa3efd99460c/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:01:45.034790 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a8fb-78e7-461d-ab76-cf2277127276 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:45.035105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a8fb-78e7-461d-ab76-cf2277127276 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:45.035388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a8fb-78e7-461d-ab76-cf2277127276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:45.098320 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-09e1a8fb-78e7-461d-ab76-cf2277127276 None None] MFA Rules not processed for user `95a17b7f256b439bba94aa3efd99460c`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:45.100042 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-09e1a8fb-78e7-461d-ab76-cf2277127276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:45.236815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1038/2091] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:45 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:45.259560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c70563-d53f-43be-afa6-651205956c7c admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:45.261462 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-40c70563-d53f-43be-afa6-651205956c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:45.386722 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c70563-d53f-43be-afa6-651205956c7c admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:45.401514 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ca0f6-0b88-4c33-9981-dfed323365ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:45.402198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ca0f6-0b88-4c33-9981-dfed323365ef service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:45.402480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ca0f6-0b88-4c33-9981-dfed323365ef service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:45.402765 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ca0f6-0b88-4c33-9981-dfed323365ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:45.428627 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ca0f6-0b88-4c33-9981-dfed323365ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:45.430494 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ca0f6-0b88-4c33-9981-dfed323365ef service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:45.447349 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1054/2092] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:45 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:45.888956 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a8fb-78e7-461d-ab76-cf2277127276 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:45.891097 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-09e1a8fb-78e7-461d-ab76-cf2277127276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:45.909928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a8fb-78e7-461d-ab76-cf2277127276 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:45.914907 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623e308-312e-4a90-bfc2-102879d5385b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:45.915860 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623e308-312e-4a90-bfc2-102879d5385b service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:45.916420 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623e308-312e-4a90-bfc2-102879d5385b service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:45.916840 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623e308-312e-4a90-bfc2-102879d5385b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:45.998553 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623e308-312e-4a90-bfc2-102879d5385b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:46.000059 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623e308-312e-4a90-bfc2-102879d5385b service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:46.009987 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1039/2093] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:46.124754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4b3c4-4122-417b-8c5a-fde7cdb69cec None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:46.125233 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4b3c4-4122-417b-8c5a-fde7cdb69cec None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:46.125700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4b3c4-4122-417b-8c5a-fde7cdb69cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:46.168535 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-ecb4b3c4-4122-417b-8c5a-fde7cdb69cec None None] MFA Rules not processed for user `420d44749c064fc883bc3aadd9d2e8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:46.170180 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-ecb4b3c4-4122-417b-8c5a-fde7cdb69cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:46.260347 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1055/2094] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:46.273314 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623e308-312e-4a90-bfc2-102879d5385b service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:46.274855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-2623e308-312e-4a90-bfc2-102879d5385b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:46.360545 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623e308-312e-4a90-bfc2-102879d5385b service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:46.368268 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65298112-e73b-47aa-b18d-e2c6eb76de58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:46.369321 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65298112-e73b-47aa-b18d-e2c6eb76de58 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:46.369541 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65298112-e73b-47aa-b18d-e2c6eb76de58 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:46.369874 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65298112-e73b-47aa-b18d-e2c6eb76de58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:46.380911 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65298112-e73b-47aa-b18d-e2c6eb76de58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:46.383507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65298112-e73b-47aa-b18d-e2c6eb76de58 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:46.393752 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1040/2095] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:49.998963 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4b3c4-4122-417b-8c5a-fde7cdb69cec None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:50.000524 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-ecb4b3c4-4122-417b-8c5a-fde7cdb69cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:50.034716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72808ba5-f321-46cf-a027-ede866c5a2e5 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:50.035643 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72808ba5-f321-46cf-a027-ede866c5a2e5 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:50.035919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72808ba5-f321-46cf-a027-ede866c5a2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:50.054471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-72808ba5-f321-46cf-a027-ede866c5a2e5 None None] MFA Rules not processed for user `420d44749c064fc883bc3aadd9d2e8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:50.055732 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-72808ba5-f321-46cf-a027-ede866c5a2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:50.062978 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1041/2096] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:01:50.079605 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4b3c4-4122-417b-8c5a-fde7cdb69cec None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:50.085739 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b5f24-6514-4469-9e94-dd91f9ab4a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:50.086694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b5f24-6514-4469-9e94-dd91f9ab4a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:50.087053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b5f24-6514-4469-9e94-dd91f9ab4a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:50.093192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b5f24-6514-4469-9e94-dd91f9ab4a79 admin admin] PATH_INFO: `/v3/users/44147787d6644392b5dd1b95679ee6c7` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:50.093192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b5f24-6514-4469-9e94-dd91f9ab4a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44147787d6644392b5dd1b95679ee6c7)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:50.093192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b5f24-6514-4469-9e94-dd91f9ab4a79 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:50.280199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-327b5f24-6514-4469-9e94-dd91f9ab4a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44147787d6644392b5dd1b95679ee6c7'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:50.280986 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-327b5f24-6514-4469-9e94-dd91f9ab4a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44147787d6644392b5dd1b95679ee6c7'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:50.288435 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-327b5f24-6514-4469-9e94-dd91f9ab4a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44147787d6644392b5dd1b95679ee6c7'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:50.381660 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-327b5f24-6514-4469-9e94-dd91f9ab4a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44147787d6644392b5dd1b95679ee6c7'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:50.395177 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-327b5f24-6514-4469-9e94-dd91f9ab4a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44147787d6644392b5dd1b95679ee6c7'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:50.402313 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1056/2097] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:49 2022] DELETE /identity/v3/users/44147787d6644392b5dd1b95679ee6c7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:50.406568 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a46a4-f2d7-4aab-9324-31fd66b8927e None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:50.406789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a46a4-f2d7-4aab-9324-31fd66b8927e None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:50.407227 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a46a4-f2d7-4aab-9324-31fd66b8927e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:50.428731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-e13a46a4-f2d7-4aab-9324-31fd66b8927e None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:50.429998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e13a46a4-f2d7-4aab-9324-31fd66b8927e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:50.494973 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1042/2098] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:50.504799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b5f24-6514-4469-9e94-dd91f9ab4a79 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:50.506928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-327b5f24-6514-4469-9e94-dd91f9ab4a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:50.565618 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b5f24-6514-4469-9e94-dd91f9ab4a79 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:50.569885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474840ac-9c22-4d56-98a2-2ac85ff0d285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:50.570531 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474840ac-9c22-4d56-98a2-2ac85ff0d285 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:50.570818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474840ac-9c22-4d56-98a2-2ac85ff0d285 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:50.571089 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474840ac-9c22-4d56-98a2-2ac85ff0d285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:50.580606 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474840ac-9c22-4d56-98a2-2ac85ff0d285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:50.582267 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474840ac-9c22-4d56-98a2-2ac85ff0d285 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:50.593092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1057/2099] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:01:51.094372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a46a4-f2d7-4aab-9324-31fd66b8927e None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:51.095887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e13a46a4-f2d7-4aab-9324-31fd66b8927e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:51.109136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a46a4-f2d7-4aab-9324-31fd66b8927e None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:51.116086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b2720-4676-4475-b71c-04e18d6daf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:51.116086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b2720-4676-4475-b71c-04e18d6daf4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:51.116086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b2720-4676-4475-b71c-04e18d6daf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:51.116086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b2720-4676-4475-b71c-04e18d6daf4c admin admin] PATH_INFO: `/v3/projects/8728c4de8d314d878a74384760d9445b` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:51.117190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b2720-4676-4475-b71c-04e18d6daf4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8728c4de8d314d878a74384760d9445b)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:51.119106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b2720-4676-4475-b71c-04e18d6daf4c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:51.261947 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d77b2720-4676-4475-b71c-04e18d6daf4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8728c4de8d314d878a74384760d9445b', 'request_id': 'req-d77b2720-4676-4475-b71c-04e18d6daf4c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:51.352486 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d77b2720-4676-4475-b71c-04e18d6daf4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8728c4de8d314d878a74384760d9445b', 'request_id': 'req-d77b2720-4676-4475-b71c-04e18d6daf4c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:51.359402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d77b2720-4676-4475-b71c-04e18d6daf4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8728c4de8d314d878a74384760d9445b', 'request_id': 'req-d77b2720-4676-4475-b71c-04e18d6daf4c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:51.369255 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d77b2720-4676-4475-b71c-04e18d6daf4c admin admin] The token cache is being invalidate because project 8728c4de8d314d878a74384760d9445b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:51.369543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d77b2720-4676-4475-b71c-04e18d6daf4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:51.370167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d77b2720-4676-4475-b71c-04e18d6daf4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:51.371756 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1043/2100] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:51 2022] DELETE /identity/v3/projects/8728c4de8d314d878a74384760d9445b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:51.376118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474840ac-9c22-4d56-98a2-2ac85ff0d285 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:51.386752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474840ac-9c22-4d56-98a2-2ac85ff0d285 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:51.441503 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cd8bb-60f8-4753-a794-8f7948ece92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:51.442370 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cd8bb-60f8-4753-a794-8f7948ece92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:51.442651 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cd8bb-60f8-4753-a794-8f7948ece92c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:51.443430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cd8bb-60f8-4753-a794-8f7948ece92c admin admin] PATH_INFO: `/v3/users/1ddae43c696a434f856d68e341c6f752` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:51.444912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cd8bb-60f8-4753-a794-8f7948ece92c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ddae43c696a434f856d68e341c6f752)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:51.446893 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cd8bb-60f8-4753-a794-8f7948ece92c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:51.629011 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c84cd8bb-60f8-4753-a794-8f7948ece92c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ddae43c696a434f856d68e341c6f752'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:51.629654 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c84cd8bb-60f8-4753-a794-8f7948ece92c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ddae43c696a434f856d68e341c6f752'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:51.636820 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c84cd8bb-60f8-4753-a794-8f7948ece92c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ddae43c696a434f856d68e341c6f752'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:51.699407 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c84cd8bb-60f8-4753-a794-8f7948ece92c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ddae43c696a434f856d68e341c6f752'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:51.712445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c84cd8bb-60f8-4753-a794-8f7948ece92c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ddae43c696a434f856d68e341c6f752'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:51.718577 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1058/2101] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:51 2022] DELETE /identity/v3/users/1ddae43c696a434f856d68e341c6f752 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:52.197848 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b2720-4676-4475-b71c-04e18d6daf4c admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:52.200922 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d77b2720-4676-4475-b71c-04e18d6daf4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:52.251439 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b2720-4676-4475-b71c-04e18d6daf4c admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:52.313770 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b6e5d-3872-44c7-ab6a-432a8fae21db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:52.314845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b6e5d-3872-44c7-ab6a-432a8fae21db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:52.315550 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b6e5d-3872-44c7-ab6a-432a8fae21db admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:52.316099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b6e5d-3872-44c7-ab6a-432a8fae21db admin admin] PATH_INFO: `/v3/projects/3f64b4c7983647378a5b60fbf1e77240` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:52.320372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b6e5d-3872-44c7-ab6a-432a8fae21db admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f64b4c7983647378a5b60fbf1e77240)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:52.322304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b6e5d-3872-44c7-ab6a-432a8fae21db admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:52.466898 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3f1b6e5d-3872-44c7-ab6a-432a8fae21db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f64b4c7983647378a5b60fbf1e77240', 'request_id': 'req-3f1b6e5d-3872-44c7-ab6a-432a8fae21db'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:52.569682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3f1b6e5d-3872-44c7-ab6a-432a8fae21db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f64b4c7983647378a5b60fbf1e77240', 'request_id': 'req-3f1b6e5d-3872-44c7-ab6a-432a8fae21db'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:52.576325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3f1b6e5d-3872-44c7-ab6a-432a8fae21db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f64b4c7983647378a5b60fbf1e77240', 'request_id': 'req-3f1b6e5d-3872-44c7-ab6a-432a8fae21db'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:52.587151 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3f1b6e5d-3872-44c7-ab6a-432a8fae21db admin admin] The token cache is being invalidate because project 3f64b4c7983647378a5b60fbf1e77240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:52.587439 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3f1b6e5d-3872-44c7-ab6a-432a8fae21db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:52.588147 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3f1b6e5d-3872-44c7-ab6a-432a8fae21db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:52.589690 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1044/2102] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:52 2022] DELETE /identity/v3/projects/3f64b4c7983647378a5b60fbf1e77240 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:52.594736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dd53f-cc61-4099-8e2f-b4043bb27d0d None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:52.595265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dd53f-cc61-4099-8e2f-b4043bb27d0d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:52.595348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dd53f-cc61-4099-8e2f-b4043bb27d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:52.614637 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-8d6dd53f-cc61-4099-8e2f-b4043bb27d0d None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:52.615936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-8d6dd53f-cc61-4099-8e2f-b4043bb27d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:52.675738 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1059/2103] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:52.683929 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d223b-d7cd-4d8c-85a9-b64a40c5a96c None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:52.684221 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d223b-d7cd-4d8c-85a9-b64a40c5a96c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:52.684502 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d223b-d7cd-4d8c-85a9-b64a40c5a96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:52.703353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-b68d223b-d7cd-4d8c-85a9-b64a40c5a96c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:52.704618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b68d223b-d7cd-4d8c-85a9-b64a40c5a96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:52.714160 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1045/2104] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:52.718451 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dd53f-cc61-4099-8e2f-b4043bb27d0d None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:52.728317 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dd53f-cc61-4099-8e2f-b4043bb27d0d None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:52.733268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae29c44-0922-41cc-aa40-8472e5c57750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:52.734047 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae29c44-0922-41cc-aa40-8472e5c57750 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:52.734332 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae29c44-0922-41cc-aa40-8472e5c57750 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:52.734603 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae29c44-0922-41cc-aa40-8472e5c57750 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:52.735361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae29c44-0922-41cc-aa40-8472e5c57750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:01:52.735703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae29c44-0922-41cc-aa40-8472e5c57750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:52.737463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae29c44-0922-41cc-aa40-8472e5c57750 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:52.752654 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1060/2105] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:01:52.757477 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d223b-d7cd-4d8c-85a9-b64a40c5a96c None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:52.767117 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d223b-d7cd-4d8c-85a9-b64a40c5a96c None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:52.776704 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48692f-ca9e-4a24-910e-6513665daf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:52.777735 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48692f-ca9e-4a24-910e-6513665daf15 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:52.778019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48692f-ca9e-4a24-910e-6513665daf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:52.778292 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48692f-ca9e-4a24-910e-6513665daf15 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:52.779022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48692f-ca9e-4a24-910e-6513665daf15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:52.781029 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48692f-ca9e-4a24-910e-6513665daf15 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:52.868316 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1046/2106] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:01:52 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:52.872315 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae29c44-0922-41cc-aa40-8472e5c57750 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:52.884610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae29c44-0922-41cc-aa40-8472e5c57750 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:52.953885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5a521-f063-439a-a273-92e10a79169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:52.954556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5a521-f063-439a-a273-92e10a79169f admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:52.954840 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5a521-f063-439a-a273-92e10a79169f admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:52.955113 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5a521-f063-439a-a273-92e10a79169f admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:52.956022 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5a521-f063-439a-a273-92e10a79169f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:52.957938 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5a521-f063-439a-a273-92e10a79169f admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:53.047294 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1061/2107] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:01:52 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:01:53.051474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48692f-ca9e-4a24-910e-6513665daf15 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:53.064785 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48692f-ca9e-4a24-910e-6513665daf15 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:53.077564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1a6de-290e-4736-bcce-b44ea9fb99c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:53.078648 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1a6de-290e-4736-bcce-b44ea9fb99c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:53.078864 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1a6de-290e-4736-bcce-b44ea9fb99c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:53.079208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1a6de-290e-4736-bcce-b44ea9fb99c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:53.080750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1a6de-290e-4736-bcce-b44ea9fb99c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:53.082753 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1a6de-290e-4736-bcce-b44ea9fb99c8 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:53.098271 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1047/2108] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:53.105559 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5a521-f063-439a-a273-92e10a79169f admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:53.121528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5a521-f063-439a-a273-92e10a79169f admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:53.126679 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd823e4-3d73-45eb-9304-02ca3eb461de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:53.127544 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd823e4-3d73-45eb-9304-02ca3eb461de admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:53.128183 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd823e4-3d73-45eb-9304-02ca3eb461de admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:53.128610 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd823e4-3d73-45eb-9304-02ca3eb461de admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:53.129662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd823e4-3d73-45eb-9304-02ca3eb461de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:53.132733 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd823e4-3d73-45eb-9304-02ca3eb461de admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:53.145167 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1062/2109] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:53.150890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1a6de-290e-4736-bcce-b44ea9fb99c8 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:53.167541 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1a6de-290e-4736-bcce-b44ea9fb99c8 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:53.173116 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce79e9-30ea-4038-8900-50b0ee16324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:53.174140 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce79e9-30ea-4038-8900-50b0ee16324f admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:53.174680 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce79e9-30ea-4038-8900-50b0ee16324f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:53.174963 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce79e9-30ea-4038-8900-50b0ee16324f admin admin] PATH_INFO: `/v3/projects/0d484854d0044d48b680b2a5cc5eec51/users/c7b8094d48144292b16f33e74280e4e6/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:53.197468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce79e9-30ea-4038-8900-50b0ee16324f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d484854d0044d48b680b2a5cc5eec51, user_id=c7b8094d48144292b16f33e74280e4e6, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:53.200175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce79e9-30ea-4038-8900-50b0ee16324f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:53.289378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1048/2110] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:53 2022] PUT /identity/v3/projects/0d484854d0044d48b680b2a5cc5eec51/users/c7b8094d48144292b16f33e74280e4e6/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:53.301890 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2423b69-fda6-4938-a4f5-a77b27e89c5d None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:53.303060 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2423b69-fda6-4938-a4f5-a77b27e89c5d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:53.303173 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2423b69-fda6-4938-a4f5-a77b27e89c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:53.345434 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-d2423b69-fda6-4938-a4f5-a77b27e89c5d None None] MFA Rules not processed for user `c7b8094d48144292b16f33e74280e4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:53.346755 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d2423b69-fda6-4938-a4f5-a77b27e89c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:53.448235 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1063/2111] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:53.449540 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce79e9-30ea-4038-8900-50b0ee16324f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:53.531433 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce79e9-30ea-4038-8900-50b0ee16324f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:53.539134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e1511-fcc3-4599-a518-220d55d836e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:53.540255 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e1511-fcc3-4599-a518-220d55d836e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:53.541303 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e1511-fcc3-4599-a518-220d55d836e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:53.541731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e1511-fcc3-4599-a518-220d55d836e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:53.542584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e1511-fcc3-4599-a518-220d55d836e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:53.545040 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e1511-fcc3-4599-a518-220d55d836e0 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:53.648887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1049/2112] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:01:53 2022] POST /identity/v3/projects => generated 369 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:53.652705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2423b69-fda6-4938-a4f5-a77b27e89c5d None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:53.671328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2423b69-fda6-4938-a4f5-a77b27e89c5d None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:53.769936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f64b49-2ac5-46b1-8746-2ea30aeb0d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:53.770623 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f64b49-2ac5-46b1-8746-2ea30aeb0d79 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:53.770936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f64b49-2ac5-46b1-8746-2ea30aeb0d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:53.771991 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f64b49-2ac5-46b1-8746-2ea30aeb0d79 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:53.772743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f64b49-2ac5-46b1-8746-2ea30aeb0d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:53.774763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f64b49-2ac5-46b1-8746-2ea30aeb0d79 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:53.881926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1064/2113] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:01:53 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:53.890410 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e1511-fcc3-4599-a518-220d55d836e0 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:53.902336 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e1511-fcc3-4599-a518-220d55d836e0 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:53.907502 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b82e4c-74b9-4c02-96e0-a74ed1071350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:53.908411 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b82e4c-74b9-4c02-96e0-a74ed1071350 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:53.908881 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b82e4c-74b9-4c02-96e0-a74ed1071350 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:53.909363 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b82e4c-74b9-4c02-96e0-a74ed1071350 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:53.910282 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b82e4c-74b9-4c02-96e0-a74ed1071350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:53.912277 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b82e4c-74b9-4c02-96e0-a74ed1071350 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:53.923306 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1050/2114] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:53.930159 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f64b49-2ac5-46b1-8746-2ea30aeb0d79 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:53.958355 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f64b49-2ac5-46b1-8746-2ea30aeb0d79 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:53.964097 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e31ab0-ab9f-448c-997d-672461cec8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:53.965101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e31ab0-ab9f-448c-997d-672461cec8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:53.965269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e31ab0-ab9f-448c-997d-672461cec8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:53.965563 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e31ab0-ab9f-448c-997d-672461cec8c8 admin admin] PATH_INFO: `/v3/projects/d1316bbd5b3d47f98df673fe3191acc0/users/981d57f79b8b44968c859d2457435ca5/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:53.985631 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e31ab0-ab9f-448c-997d-672461cec8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1316bbd5b3d47f98df673fe3191acc0, user_id=981d57f79b8b44968c859d2457435ca5, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:53.988640 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e31ab0-ab9f-448c-997d-672461cec8c8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:54.100517 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1065/2115] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:53 2022] PUT /identity/v3/projects/d1316bbd5b3d47f98df673fe3191acc0/users/981d57f79b8b44968c859d2457435ca5/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:01:54.104763 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b82e4c-74b9-4c02-96e0-a74ed1071350 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:54.118315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b82e4c-74b9-4c02-96e0-a74ed1071350 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:54.244858 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3b5a7-e310-4b1b-ab4c-dc998cfb80b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:54.245388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3b5a7-e310-4b1b-ab4c-dc998cfb80b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:54.245388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3b5a7-e310-4b1b-ab4c-dc998cfb80b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:54.245568 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3b5a7-e310-4b1b-ab4c-dc998cfb80b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:54.246555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3b5a7-e310-4b1b-ab4c-dc998cfb80b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:54.248537 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3b5a7-e310-4b1b-ab4c-dc998cfb80b6 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:54.260893 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1051/2116] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:01:54.272259 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e31ab0-ab9f-448c-997d-672461cec8c8 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:54.282979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e31ab0-ab9f-448c-997d-672461cec8c8 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:54.288412 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43481a-6ce4-411e-9d89-44de3912b3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:54.289322 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43481a-6ce4-411e-9d89-44de3912b3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:54.289579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43481a-6ce4-411e-9d89-44de3912b3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:54.289853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43481a-6ce4-411e-9d89-44de3912b3d6 admin admin] PATH_INFO: `/v3/projects/d1316bbd5b3d47f98df673fe3191acc0/users/981d57f79b8b44968c859d2457435ca5/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:54.291845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43481a-6ce4-411e-9d89-44de3912b3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1316bbd5b3d47f98df673fe3191acc0, user_id=981d57f79b8b44968c859d2457435ca5, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:54.294515 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43481a-6ce4-411e-9d89-44de3912b3d6 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:54.305785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1066/2117] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:01:54 2022] PUT /identity/v3/projects/d1316bbd5b3d47f98df673fe3191acc0/users/981d57f79b8b44968c859d2457435ca5/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:01:54.316374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d402d1-f854-4b25-8053-66df9b425266 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:54.321906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d402d1-f854-4b25-8053-66df9b425266 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:54.321906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d402d1-f854-4b25-8053-66df9b425266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:54.347376 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-33d402d1-f854-4b25-8053-66df9b425266 None None] MFA Rules not processed for user `981d57f79b8b44968c859d2457435ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:54.348763 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-33d402d1-f854-4b25-8053-66df9b425266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:54.442643 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1052/2118] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:54.458206 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43481a-6ce4-411e-9d89-44de3912b3d6 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:54.460187 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-be43481a-6ce4-411e-9d89-44de3912b3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:54.530830 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43481a-6ce4-411e-9d89-44de3912b3d6 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:54.534996 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2387a98-1017-4af5-9be1-8a183f8ae70c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:54.535692 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2387a98-1017-4af5-9be1-8a183f8ae70c service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:54.535995 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2387a98-1017-4af5-9be1-8a183f8ae70c service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:54.536274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2387a98-1017-4af5-9be1-8a183f8ae70c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:54.545975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2387a98-1017-4af5-9be1-8a183f8ae70c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:54.547541 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2387a98-1017-4af5-9be1-8a183f8ae70c service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:54.558125 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1067/2119] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:01:54.675941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d402d1-f854-4b25-8053-66df9b425266 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:54.678483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-33d402d1-f854-4b25-8053-66df9b425266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:54.690482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d402d1-f854-4b25-8053-66df9b425266 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:54.694666 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96844fb7-f109-46e2-bf5b-2c9a2eb1d7fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:54.695319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96844fb7-f109-46e2-bf5b-2c9a2eb1d7fa service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:54.695634 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96844fb7-f109-46e2-bf5b-2c9a2eb1d7fa service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:54.695915 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96844fb7-f109-46e2-bf5b-2c9a2eb1d7fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:54.772183 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96844fb7-f109-46e2-bf5b-2c9a2eb1d7fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:54.773634 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96844fb7-f109-46e2-bf5b-2c9a2eb1d7fa service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:54.783678 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1053/2120] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:55.771983 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81526a-10dc-4e3a-b51a-0a391adac8fb None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:55.772595 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81526a-10dc-4e3a-b51a-0a391adac8fb None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:55.772781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81526a-10dc-4e3a-b51a-0a391adac8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:55.799787 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-ad81526a-10dc-4e3a-b51a-0a391adac8fb None None] MFA Rules not processed for user `2d616b3ce8ee49f6bfca34111f3f2b63`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:55.801838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-ad81526a-10dc-4e3a-b51a-0a391adac8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:55.882983 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1068/2121] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:01:56.836449 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96844fb7-f109-46e2-bf5b-2c9a2eb1d7fa service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:56.837958 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-96844fb7-f109-46e2-bf5b-2c9a2eb1d7fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:56.912903 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96844fb7-f109-46e2-bf5b-2c9a2eb1d7fa service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:56.917558 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38299426-d3d1-4f0f-a0ee-2a3d85232183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:56.918455 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38299426-d3d1-4f0f-a0ee-2a3d85232183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:56.918731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38299426-d3d1-4f0f-a0ee-2a3d85232183 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:56.919005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38299426-d3d1-4f0f-a0ee-2a3d85232183 admin admin] PATH_INFO: `/v3/users/44768e5a55894425839f21b0c997a453` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:56.920217 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38299426-d3d1-4f0f-a0ee-2a3d85232183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44768e5a55894425839f21b0c997a453)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:56.922202 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38299426-d3d1-4f0f-a0ee-2a3d85232183 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:57.178138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-38299426-d3d1-4f0f-a0ee-2a3d85232183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44768e5a55894425839f21b0c997a453'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:57.178819 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-38299426-d3d1-4f0f-a0ee-2a3d85232183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44768e5a55894425839f21b0c997a453'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:57.255583 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-38299426-d3d1-4f0f-a0ee-2a3d85232183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44768e5a55894425839f21b0c997a453'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:57.269723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-38299426-d3d1-4f0f-a0ee-2a3d85232183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44768e5a55894425839f21b0c997a453'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:57.277733 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-38299426-d3d1-4f0f-a0ee-2a3d85232183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44768e5a55894425839f21b0c997a453'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:57.283673 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1054/2122] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:56 2022] DELETE /identity/v3/users/44768e5a55894425839f21b0c997a453 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:57.288265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecce88-c97c-44fb-8354-85fbfb27ed2b None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:57.288735 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecce88-c97c-44fb-8354-85fbfb27ed2b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:57.288822 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecce88-c97c-44fb-8354-85fbfb27ed2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:57.305885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-04ecce88-c97c-44fb-8354-85fbfb27ed2b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:57.307090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-04ecce88-c97c-44fb-8354-85fbfb27ed2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:57.369486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1069/2123] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:57.378795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38299426-d3d1-4f0f-a0ee-2a3d85232183 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:57.380743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-38299426-d3d1-4f0f-a0ee-2a3d85232183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:57.440596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38299426-d3d1-4f0f-a0ee-2a3d85232183 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:57.445301 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb074b-b39b-4df4-bfe4-acf79fdd5f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:57.445967 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb074b-b39b-4df4-bfe4-acf79fdd5f68 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:57.446252 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb074b-b39b-4df4-bfe4-acf79fdd5f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:57.446533 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb074b-b39b-4df4-bfe4-acf79fdd5f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:57.456115 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb074b-b39b-4df4-bfe4-acf79fdd5f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:57.457568 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb074b-b39b-4df4-bfe4-acf79fdd5f68 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:57.468034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1055/2124] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:01:58.009547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecce88-c97c-44fb-8354-85fbfb27ed2b None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:58.023590 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-04ecce88-c97c-44fb-8354-85fbfb27ed2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:58.030819 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecce88-c97c-44fb-8354-85fbfb27ed2b None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:58.037804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817f29b-af3f-4efa-a125-af3b65c3cddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:58.038736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817f29b-af3f-4efa-a125-af3b65c3cddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:58.039127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817f29b-af3f-4efa-a125-af3b65c3cddd admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:58.039568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817f29b-af3f-4efa-a125-af3b65c3cddd admin admin] PATH_INFO: `/v3/projects/b55b4b6d2f42482db1988efcbcbc564a` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:58.040856 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817f29b-af3f-4efa-a125-af3b65c3cddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55b4b6d2f42482db1988efcbcbc564a)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:58.042851 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817f29b-af3f-4efa-a125-af3b65c3cddd admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:58.159119 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a817f29b-af3f-4efa-a125-af3b65c3cddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55b4b6d2f42482db1988efcbcbc564a', 'request_id': 'req-a817f29b-af3f-4efa-a125-af3b65c3cddd'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:58.165708 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a817f29b-af3f-4efa-a125-af3b65c3cddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55b4b6d2f42482db1988efcbcbc564a', 'request_id': 'req-a817f29b-af3f-4efa-a125-af3b65c3cddd'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:58.247689 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a817f29b-af3f-4efa-a125-af3b65c3cddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55b4b6d2f42482db1988efcbcbc564a', 'request_id': 'req-a817f29b-af3f-4efa-a125-af3b65c3cddd'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:58.258484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a817f29b-af3f-4efa-a125-af3b65c3cddd admin admin] The token cache is being invalidate because project b55b4b6d2f42482db1988efcbcbc564a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:58.258775 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a817f29b-af3f-4efa-a125-af3b65c3cddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:58.259437 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a817f29b-af3f-4efa-a125-af3b65c3cddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:58.261115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1070/2125] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:58 2022] DELETE /identity/v3/projects/b55b4b6d2f42482db1988efcbcbc564a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:58.265248 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb074b-b39b-4df4-bfe4-acf79fdd5f68 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:58.275814 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb074b-b39b-4df4-bfe4-acf79fdd5f68 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:58.332181 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849909cf-36d4-4b52-9666-1d325bb4c5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:58.333629 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849909cf-36d4-4b52-9666-1d325bb4c5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:58.333908 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849909cf-36d4-4b52-9666-1d325bb4c5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:58.334173 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849909cf-36d4-4b52-9666-1d325bb4c5f2 admin admin] PATH_INFO: `/v3/users/95a17b7f256b439bba94aa3efd99460c` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:58.335380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849909cf-36d4-4b52-9666-1d325bb4c5f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a17b7f256b439bba94aa3efd99460c)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:58.337337 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849909cf-36d4-4b52-9666-1d325bb4c5f2 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:58.571630 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-849909cf-36d4-4b52-9666-1d325bb4c5f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a17b7f256b439bba94aa3efd99460c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:58.572214 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-849909cf-36d4-4b52-9666-1d325bb4c5f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a17b7f256b439bba94aa3efd99460c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:58.643295 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-849909cf-36d4-4b52-9666-1d325bb4c5f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a17b7f256b439bba94aa3efd99460c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:58.656175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-849909cf-36d4-4b52-9666-1d325bb4c5f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a17b7f256b439bba94aa3efd99460c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:58.662894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-849909cf-36d4-4b52-9666-1d325bb4c5f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a17b7f256b439bba94aa3efd99460c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:58.668925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1056/2126] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:01:58 2022] DELETE /identity/v3/users/95a17b7f256b439bba94aa3efd99460c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:59.066169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817f29b-af3f-4efa-a125-af3b65c3cddd admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:59.070274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a817f29b-af3f-4efa-a125-af3b65c3cddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:59.098211 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817f29b-af3f-4efa-a125-af3b65c3cddd admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:59.186397 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b52b39-794a-4b91-a5fb-757952fccb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:59.188507 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b52b39-794a-4b91-a5fb-757952fccb1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:59.195803 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b52b39-794a-4b91-a5fb-757952fccb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:59.195803 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b52b39-794a-4b91-a5fb-757952fccb1f admin admin] PATH_INFO: `/v3/projects/5cbc5db570b347b8959a83c025cc750b` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:59.196118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b52b39-794a-4b91-a5fb-757952fccb1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cbc5db570b347b8959a83c025cc750b)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:59.204134 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b52b39-794a-4b91-a5fb-757952fccb1f admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:59.366153 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-15b52b39-794a-4b91-a5fb-757952fccb1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cbc5db570b347b8959a83c025cc750b', 'request_id': 'req-15b52b39-794a-4b91-a5fb-757952fccb1f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:59.374102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-15b52b39-794a-4b91-a5fb-757952fccb1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cbc5db570b347b8959a83c025cc750b', 'request_id': 'req-15b52b39-794a-4b91-a5fb-757952fccb1f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:59.523606 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-15b52b39-794a-4b91-a5fb-757952fccb1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cbc5db570b347b8959a83c025cc750b', 'request_id': 'req-15b52b39-794a-4b91-a5fb-757952fccb1f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:59.534492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-15b52b39-794a-4b91-a5fb-757952fccb1f admin admin] The token cache is being invalidate because project 5cbc5db570b347b8959a83c025cc750b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:01:59.534803 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-15b52b39-794a-4b91-a5fb-757952fccb1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:59.535397 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-15b52b39-794a-4b91-a5fb-757952fccb1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:01:59.536959 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1071/2127] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:01:59 2022] DELETE /identity/v3/projects/5cbc5db570b347b8959a83c025cc750b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:01:59.542411 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a302705-e11e-4963-815a-eb7626a9059f None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:59.542920 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a302705-e11e-4963-815a-eb7626a9059f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:59.543009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a302705-e11e-4963-815a-eb7626a9059f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:59.562066 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-4a302705-e11e-4963-815a-eb7626a9059f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:59.563461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-4a302705-e11e-4963-815a-eb7626a9059f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:59.632440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1057/2128] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:59.640417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27bb1e-4949-46d9-b124-2efe18915952 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:59.640705 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27bb1e-4949-46d9-b124-2efe18915952 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:59.641814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27bb1e-4949-46d9-b124-2efe18915952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:59.665286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-aa27bb1e-4949-46d9-b124-2efe18915952 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:01:59.666535 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-aa27bb1e-4949-46d9-b124-2efe18915952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:01:59.674600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1072/2129] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:01:59.679651 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a302705-e11e-4963-815a-eb7626a9059f None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:59.690770 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a302705-e11e-4963-815a-eb7626a9059f None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:59.696073 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b13523-e034-4c63-830e-7e734d7ccf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:59.696964 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b13523-e034-4c63-830e-7e734d7ccf9b admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:59.697243 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b13523-e034-4c63-830e-7e734d7ccf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:59.699245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b13523-e034-4c63-830e-7e734d7ccf9b admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:59.699245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b13523-e034-4c63-830e-7e734d7ccf9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:01:59.699245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b13523-e034-4c63-830e-7e734d7ccf9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:59.700331 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b13523-e034-4c63-830e-7e734d7ccf9b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:59.713292 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1058/2130] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:01:59.718384 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27bb1e-4949-46d9-b124-2efe18915952 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:59.732709 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27bb1e-4949-46d9-b124-2efe18915952 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:59.737937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a8bd1-4ca7-4eb2-8a01-117f2e096be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:59.738663 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a8bd1-4ca7-4eb2-8a01-117f2e096be8 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:59.739222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a8bd1-4ca7-4eb2-8a01-117f2e096be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:59.739864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a8bd1-4ca7-4eb2-8a01-117f2e096be8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:59.741500 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a8bd1-4ca7-4eb2-8a01-117f2e096be8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:59.743657 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a8bd1-4ca7-4eb2-8a01-117f2e096be8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:01:59.855598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1073/2131] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:01:59 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:01:59.856735 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b13523-e034-4c63-830e-7e734d7ccf9b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:01:59.867327 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b13523-e034-4c63-830e-7e734d7ccf9b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:01:59.954736 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de50d27-fbb2-424c-b529-23db5b759025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:01:59.955549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de50d27-fbb2-424c-b529-23db5b759025 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:01:59.956360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de50d27-fbb2-424c-b529-23db5b759025 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:01:59.956654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de50d27-fbb2-424c-b529-23db5b759025 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:01:59.957528 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de50d27-fbb2-424c-b529-23db5b759025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:01:59.960413 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de50d27-fbb2-424c-b529-23db5b759025 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:00.078152 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1059/2132] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:01:59 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:00.079427 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a8bd1-4ca7-4eb2-8a01-117f2e096be8 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:00.103198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a8bd1-4ca7-4eb2-8a01-117f2e096be8 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:00.111377 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843512f-192d-445f-a06a-e90c9e0791f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:00.112305 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843512f-192d-445f-a06a-e90c9e0791f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:00.112594 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843512f-192d-445f-a06a-e90c9e0791f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:00.112869 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843512f-192d-445f-a06a-e90c9e0791f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:00.113747 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843512f-192d-445f-a06a-e90c9e0791f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:00.130528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843512f-192d-445f-a06a-e90c9e0791f7 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:00.159749 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1074/2133] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:00.160865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de50d27-fbb2-424c-b529-23db5b759025 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:00.175408 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de50d27-fbb2-424c-b529-23db5b759025 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:00.187032 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b27ad-799a-4db6-83f4-ee495776ae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:00.187848 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b27ad-799a-4db6-83f4-ee495776ae79 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:00.188133 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b27ad-799a-4db6-83f4-ee495776ae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:00.188412 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b27ad-799a-4db6-83f4-ee495776ae79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:00.189471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b27ad-799a-4db6-83f4-ee495776ae79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:00.191406 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b27ad-799a-4db6-83f4-ee495776ae79 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:00.207869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1060/2134] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:02:00.213485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843512f-192d-445f-a06a-e90c9e0791f7 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:00.226781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843512f-192d-445f-a06a-e90c9e0791f7 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:00.232887 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625344b5-a262-40bd-87a0-0561042d0a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:00.234025 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625344b5-a262-40bd-87a0-0561042d0a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:00.234410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625344b5-a262-40bd-87a0-0561042d0a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:00.234783 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625344b5-a262-40bd-87a0-0561042d0a14 admin admin] PATH_INFO: `/v3/projects/712752bf27cf40f480ded90ff90d0192/users/2a95980c64524196ad604c72cfeda580/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:00.254751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625344b5-a262-40bd-87a0-0561042d0a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=712752bf27cf40f480ded90ff90d0192, user_id=2a95980c64524196ad604c72cfeda580, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:00.258120 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625344b5-a262-40bd-87a0-0561042d0a14 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:00.365166 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1075/2135] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:00 2022] PUT /identity/v3/projects/712752bf27cf40f480ded90ff90d0192/users/2a95980c64524196ad604c72cfeda580/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:00.378188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc974a-a285-4086-9aac-32602bd0c87c None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:00.378375 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc974a-a285-4086-9aac-32602bd0c87c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:00.378593 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc974a-a285-4086-9aac-32602bd0c87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:00.441957 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-bdbc974a-a285-4086-9aac-32602bd0c87c None None] MFA Rules not processed for user `2a95980c64524196ad604c72cfeda580`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:00.443387 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-bdbc974a-a285-4086-9aac-32602bd0c87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:00.521483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625344b5-a262-40bd-87a0-0561042d0a14 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:00.529630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-625344b5-a262-40bd-87a0-0561042d0a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:00.539483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1061/2136] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:00.543768 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc974a-a285-4086-9aac-32602bd0c87c None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:00.623286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625344b5-a262-40bd-87a0-0561042d0a14 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:00.628862 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcd475-d1a2-4777-9e78-138f83258a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:00.629919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcd475-d1a2-4777-9e78-138f83258a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:00.630355 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcd475-d1a2-4777-9e78-138f83258a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:00.630784 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcd475-d1a2-4777-9e78-138f83258a5c admin admin] PATH_INFO: `/v3/users/c7b8094d48144292b16f33e74280e4e6` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:00.631801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc974a-a285-4086-9aac-32602bd0c87c None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:00.633025 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcd475-d1a2-4777-9e78-138f83258a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b8094d48144292b16f33e74280e4e6)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:00.635575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcd475-d1a2-4777-9e78-138f83258a5c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:00.637067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaca740-3ba6-4b47-b359-c4ca1cb8e710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:00.638128 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaca740-3ba6-4b47-b359-c4ca1cb8e710 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:00.638444 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaca740-3ba6-4b47-b359-c4ca1cb8e710 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:00.639695 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaca740-3ba6-4b47-b359-c4ca1cb8e710 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:00.640433 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaca740-3ba6-4b47-b359-c4ca1cb8e710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:00.642717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaca740-3ba6-4b47-b359-c4ca1cb8e710 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:00.742140 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1062/2137] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:02:00 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:02:00.743443 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaca740-3ba6-4b47-b359-c4ca1cb8e710 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:00.836950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaca740-3ba6-4b47-b359-c4ca1cb8e710 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:00.842098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a9c58-e668-473c-89f5-a6d589ae30c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:00.843031 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a9c58-e668-473c-89f5-a6d589ae30c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:00.843488 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a9c58-e668-473c-89f5-a6d589ae30c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:00.843854 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a9c58-e668-473c-89f5-a6d589ae30c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:00.844561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a9c58-e668-473c-89f5-a6d589ae30c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:00.846596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a9c58-e668-473c-89f5-a6d589ae30c8 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:00.881937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a3bcd475-d1a2-4777-9e78-138f83258a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b8094d48144292b16f33e74280e4e6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:00.882547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a3bcd475-d1a2-4777-9e78-138f83258a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b8094d48144292b16f33e74280e4e6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:00.889426 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a3bcd475-d1a2-4777-9e78-138f83258a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b8094d48144292b16f33e74280e4e6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:00.957638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1063/2138] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:02:00 2022] POST /identity/v3/users => generated 299 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:02:00.959188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a9c58-e668-473c-89f5-a6d589ae30c8 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:00.961082 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-793a9c58-e668-473c-89f5-a6d589ae30c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:00.979335 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a3bcd475-d1a2-4777-9e78-138f83258a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b8094d48144292b16f33e74280e4e6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:00.979625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a9c58-e668-473c-89f5-a6d589ae30c8 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:00.986202 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4e75b-30fc-4b05-9d89-d8719fde2e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:00.987071 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4e75b-30fc-4b05-9d89-d8719fde2e4e admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:00.991691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4e75b-30fc-4b05-9d89-d8719fde2e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:00.991691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4e75b-30fc-4b05-9d89-d8719fde2e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:00.996682 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a3bcd475-d1a2-4777-9e78-138f83258a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b8094d48144292b16f33e74280e4e6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:01.001987 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4e75b-30fc-4b05-9d89-d8719fde2e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:01.007552 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1076/2139] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:02:00 2022] DELETE /identity/v3/users/c7b8094d48144292b16f33e74280e4e6 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:01.007756 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4e75b-30fc-4b05-9d89-d8719fde2e4e admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:01.009703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ece415-294b-491e-8d03-ac37687c10bc None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:01.010000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ece415-294b-491e-8d03-ac37687c10bc None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:01.010337 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ece415-294b-491e-8d03-ac37687c10bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:01.024889 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1064/2140] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:02:01.026122 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4e75b-30fc-4b05-9d89-d8719fde2e4e admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:01.033154 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-71ece415-294b-491e-8d03-ac37687c10bc None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:01.034377 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-71ece415-294b-491e-8d03-ac37687c10bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:01.058928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4e75b-30fc-4b05-9d89-d8719fde2e4e admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:01.134834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1077/2141] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:01.148280 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de883e-d7fb-4726-a0a5-2418e1ca9e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:01.149201 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de883e-d7fb-4726-a0a5-2418e1ca9e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:01.149635 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de883e-d7fb-4726-a0a5-2418e1ca9e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:01.149918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de883e-d7fb-4726-a0a5-2418e1ca9e90 admin admin] PATH_INFO: `/v3/projects/6d313dd1839441c1860c41f8cf524c7e/users/84448af35ccd41e7bf5129acd1f41173/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:01.177935 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ece415-294b-491e-8d03-ac37687c10bc None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:01.180284 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-71ece415-294b-491e-8d03-ac37687c10bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:01.194066 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de883e-d7fb-4726-a0a5-2418e1ca9e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d313dd1839441c1860c41f8cf524c7e, user_id=84448af35ccd41e7bf5129acd1f41173, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:01.194066 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de883e-d7fb-4726-a0a5-2418e1ca9e90 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:01.256732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ece415-294b-491e-8d03-ac37687c10bc None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:01.266684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf1baf-b81f-4c8a-8488-79275a9b6733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:01.267346 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf1baf-b81f-4c8a-8488-79275a9b6733 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:01.267752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf1baf-b81f-4c8a-8488-79275a9b6733 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:01.268100 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf1baf-b81f-4c8a-8488-79275a9b6733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:01.278990 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf1baf-b81f-4c8a-8488-79275a9b6733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:01.280446 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf1baf-b81f-4c8a-8488-79275a9b6733 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:01.295136 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1078/2142] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:02:01.347210 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1065/2143] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:01 2022] PUT /identity/v3/projects/6d313dd1839441c1860c41f8cf524c7e/users/84448af35ccd41e7bf5129acd1f41173/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:01.354577 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf1baf-b81f-4c8a-8488-79275a9b6733 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:01.364782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf1baf-b81f-4c8a-8488-79275a9b6733 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:01.462198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51f81f-c77d-4f54-b59f-7e33866f7b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:01.462886 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51f81f-c77d-4f54-b59f-7e33866f7b05 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:01.463167 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51f81f-c77d-4f54-b59f-7e33866f7b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:01.463463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51f81f-c77d-4f54-b59f-7e33866f7b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:01.464238 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51f81f-c77d-4f54-b59f-7e33866f7b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:01.465989 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51f81f-c77d-4f54-b59f-7e33866f7b05 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:01.477515 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1079/2144] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:01.481582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de883e-d7fb-4726-a0a5-2418e1ca9e90 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:01.492652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de883e-d7fb-4726-a0a5-2418e1ca9e90 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:01.499170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965636f2-5c6f-458a-b461-81f58f0c43c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:01.501214 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965636f2-5c6f-458a-b461-81f58f0c43c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:01.501688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965636f2-5c6f-458a-b461-81f58f0c43c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:01.501979 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965636f2-5c6f-458a-b461-81f58f0c43c4 admin admin] PATH_INFO: `/v3/projects/6d313dd1839441c1860c41f8cf524c7e/users/84448af35ccd41e7bf5129acd1f41173/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:01.504088 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965636f2-5c6f-458a-b461-81f58f0c43c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d313dd1839441c1860c41f8cf524c7e, user_id=84448af35ccd41e7bf5129acd1f41173, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:01.507115 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965636f2-5c6f-458a-b461-81f58f0c43c4 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:01.521585 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1066/2145] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:01 2022] PUT /identity/v3/projects/6d313dd1839441c1860c41f8cf524c7e/users/84448af35ccd41e7bf5129acd1f41173/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:02:01.533694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64df90-6f13-4a89-8126-42cd8fd66f81 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:01.533694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64df90-6f13-4a89-8126-42cd8fd66f81 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:01.533694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64df90-6f13-4a89-8126-42cd8fd66f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:01.584404 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-df64df90-6f13-4a89-8126-42cd8fd66f81 None None] MFA Rules not processed for user `84448af35ccd41e7bf5129acd1f41173`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:01.586055 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-df64df90-6f13-4a89-8126-42cd8fd66f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:01.689227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1080/2146] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:01.705641 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965636f2-5c6f-458a-b461-81f58f0c43c4 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:01.710928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-965636f2-5c6f-458a-b461-81f58f0c43c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:01.840062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965636f2-5c6f-458a-b461-81f58f0c43c4 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:01.847332 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed1fec-8d5f-4f7d-a13a-0149a7c7a9df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:01.848068 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed1fec-8d5f-4f7d-a13a-0149a7c7a9df service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:01.848477 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed1fec-8d5f-4f7d-a13a-0149a7c7a9df service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:01.848754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed1fec-8d5f-4f7d-a13a-0149a7c7a9df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:01.860123 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed1fec-8d5f-4f7d-a13a-0149a7c7a9df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:01.861637 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed1fec-8d5f-4f7d-a13a-0149a7c7a9df service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:01.873629 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1067/2147] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:02:02.125073 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64df90-6f13-4a89-8126-42cd8fd66f81 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:02.127145 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-df64df90-6f13-4a89-8126-42cd8fd66f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:02.236773 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64df90-6f13-4a89-8126-42cd8fd66f81 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:02.245452 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b2ddc-90e1-417f-b82f-533583ebea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:02.246676 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b2ddc-90e1-417f-b82f-533583ebea7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:02.247199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b2ddc-90e1-417f-b82f-533583ebea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:02.248078 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b2ddc-90e1-417f-b82f-533583ebea7a admin admin] PATH_INFO: `/v3/projects/0d484854d0044d48b680b2a5cc5eec51` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:02.249200 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b2ddc-90e1-417f-b82f-533583ebea7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d484854d0044d48b680b2a5cc5eec51)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:02.251142 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b2ddc-90e1-417f-b82f-533583ebea7a admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:02.427876 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-db0b2ddc-90e1-417f-b82f-533583ebea7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d484854d0044d48b680b2a5cc5eec51', 'request_id': 'req-db0b2ddc-90e1-417f-b82f-533583ebea7a'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:02.435839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-db0b2ddc-90e1-417f-b82f-533583ebea7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d484854d0044d48b680b2a5cc5eec51', 'request_id': 'req-db0b2ddc-90e1-417f-b82f-533583ebea7a'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:02.487454 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-db0b2ddc-90e1-417f-b82f-533583ebea7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d484854d0044d48b680b2a5cc5eec51', 'request_id': 'req-db0b2ddc-90e1-417f-b82f-533583ebea7a'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:02.499370 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-db0b2ddc-90e1-417f-b82f-533583ebea7a admin admin] The token cache is being invalidate because project 0d484854d0044d48b680b2a5cc5eec51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:02:02.499682 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-db0b2ddc-90e1-417f-b82f-533583ebea7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:02.500331 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-db0b2ddc-90e1-417f-b82f-533583ebea7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:02.501904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1081/2148] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:02:02 2022] DELETE /identity/v3/projects/0d484854d0044d48b680b2a5cc5eec51 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:02.505908 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed1fec-8d5f-4f7d-a13a-0149a7c7a9df service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:02.520825 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed1fec-8d5f-4f7d-a13a-0149a7c7a9df service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:02.588974 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e5ff4-428a-4719-ac76-f1842b6984d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:02.589851 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e5ff4-428a-4719-ac76-f1842b6984d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:02.590151 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e5ff4-428a-4719-ac76-f1842b6984d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:02.590743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e5ff4-428a-4719-ac76-f1842b6984d7 admin admin] PATH_INFO: `/v3/users/981d57f79b8b44968c859d2457435ca5` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:02.591625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e5ff4-428a-4719-ac76-f1842b6984d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=981d57f79b8b44968c859d2457435ca5)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:02.593573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e5ff4-428a-4719-ac76-f1842b6984d7 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:02.762486 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-174e5ff4-428a-4719-ac76-f1842b6984d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '981d57f79b8b44968c859d2457435ca5'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:02.763142 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-174e5ff4-428a-4719-ac76-f1842b6984d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '981d57f79b8b44968c859d2457435ca5'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:02.848691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-174e5ff4-428a-4719-ac76-f1842b6984d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '981d57f79b8b44968c859d2457435ca5'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:02.861546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-174e5ff4-428a-4719-ac76-f1842b6984d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '981d57f79b8b44968c859d2457435ca5'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:02.868074 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-174e5ff4-428a-4719-ac76-f1842b6984d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '981d57f79b8b44968c859d2457435ca5'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:02.874244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1068/2149] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:02:02 2022] DELETE /identity/v3/users/981d57f79b8b44968c859d2457435ca5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:03.109846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b2ddc-90e1-417f-b82f-533583ebea7a admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:03.111427 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-db0b2ddc-90e1-417f-b82f-533583ebea7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:03.125559 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b2ddc-90e1-417f-b82f-533583ebea7a admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:03.185262 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6006f-ee74-42a5-96d7-20398334ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:03.186210 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6006f-ee74-42a5-96d7-20398334ce3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:03.186494 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6006f-ee74-42a5-96d7-20398334ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:03.186771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6006f-ee74-42a5-96d7-20398334ce3e admin admin] PATH_INFO: `/v3/users/2a95980c64524196ad604c72cfeda580` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:03.188022 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6006f-ee74-42a5-96d7-20398334ce3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a95980c64524196ad604c72cfeda580)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:03.190162 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6006f-ee74-42a5-96d7-20398334ce3e admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:03.410521 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e5ff4-428a-4719-ac76-f1842b6984d7 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:03.412081 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-174e5ff4-428a-4719-ac76-f1842b6984d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:03.443398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-82c6006f-ee74-42a5-96d7-20398334ce3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a95980c64524196ad604c72cfeda580'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:03.443398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-82c6006f-ee74-42a5-96d7-20398334ce3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a95980c64524196ad604c72cfeda580'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:03.451028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-82c6006f-ee74-42a5-96d7-20398334ce3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a95980c64524196ad604c72cfeda580'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:03.458458 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e5ff4-428a-4719-ac76-f1842b6984d7 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:03.464714 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea2e5e-b1e8-421e-b505-efc049ab4c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:03.465623 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea2e5e-b1e8-421e-b505-efc049ab4c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:03.465908 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea2e5e-b1e8-421e-b505-efc049ab4c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:03.466184 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea2e5e-b1e8-421e-b505-efc049ab4c17 admin admin] PATH_INFO: `/v3/projects/d1316bbd5b3d47f98df673fe3191acc0` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:03.467506 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea2e5e-b1e8-421e-b505-efc049ab4c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1316bbd5b3d47f98df673fe3191acc0)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:03.469668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea2e5e-b1e8-421e-b505-efc049ab4c17 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:03.523616 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-82c6006f-ee74-42a5-96d7-20398334ce3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a95980c64524196ad604c72cfeda580'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:03.538812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-82c6006f-ee74-42a5-96d7-20398334ce3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a95980c64524196ad604c72cfeda580'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:03.559880 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1082/2150] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:02:03 2022] DELETE /identity/v3/users/2a95980c64524196ad604c72cfeda580 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:03.561601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b501ce5-e94a-41b6-872f-cecd4bbb7f57 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:03.562183 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b501ce5-e94a-41b6-872f-cecd4bbb7f57 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:03.562562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b501ce5-e94a-41b6-872f-cecd4bbb7f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:03.582464 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-8b501ce5-e94a-41b6-872f-cecd4bbb7f57 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:03.584302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-8b501ce5-e94a-41b6-872f-cecd4bbb7f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:03.603989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-85ea2e5e-b1e8-421e-b505-efc049ab4c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1316bbd5b3d47f98df673fe3191acc0', 'request_id': 'req-85ea2e5e-b1e8-421e-b505-efc049ab4c17'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:03.671683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1083/2151] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:03.681211 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b501ce5-e94a-41b6-872f-cecd4bbb7f57 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:03.682619 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-8b501ce5-e94a-41b6-872f-cecd4bbb7f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:03.692564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-85ea2e5e-b1e8-421e-b505-efc049ab4c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1316bbd5b3d47f98df673fe3191acc0', 'request_id': 'req-85ea2e5e-b1e8-421e-b505-efc049ab4c17'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:03.700331 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-85ea2e5e-b1e8-421e-b505-efc049ab4c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1316bbd5b3d47f98df673fe3191acc0', 'request_id': 'req-85ea2e5e-b1e8-421e-b505-efc049ab4c17'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:03.711395 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-85ea2e5e-b1e8-421e-b505-efc049ab4c17 admin admin] The token cache is being invalidate because project d1316bbd5b3d47f98df673fe3191acc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:02:03.711807 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-85ea2e5e-b1e8-421e-b505-efc049ab4c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:03.712572 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-85ea2e5e-b1e8-421e-b505-efc049ab4c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:03.719753 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1069/2152] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:02:03 2022] DELETE /identity/v3/projects/d1316bbd5b3d47f98df673fe3191acc0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:02:03.719753 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeb2d3-cc4e-4758-bb71-bbba29bebb15 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:03.719753 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeb2d3-cc4e-4758-bb71-bbba29bebb15 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:03.720862 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeb2d3-cc4e-4758-bb71-bbba29bebb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:03.741172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-a1eeb2d3-cc4e-4758-bb71-bbba29bebb15 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:03.742561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a1eeb2d3-cc4e-4758-bb71-bbba29bebb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:03.744642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b501ce5-e94a-41b6-872f-cecd4bbb7f57 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:03.748575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e03f6-70d8-4497-9619-6098da867964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:03.749270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e03f6-70d8-4497-9619-6098da867964 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:03.749536 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e03f6-70d8-4497-9619-6098da867964 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:03.749811 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e03f6-70d8-4497-9619-6098da867964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:03.750806 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1070/2153] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:02:03.751917 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-7c0e03f6-70d8-4497-9619-6098da867964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:03.758919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186f6ca-c3c1-4cd4-a36f-14446d95432b None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:03.759204 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186f6ca-c3c1-4cd4-a36f-14446d95432b None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:03.759482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186f6ca-c3c1-4cd4-a36f-14446d95432b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:03.764906 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e03f6-70d8-4497-9619-6098da867964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:03.766344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e03f6-70d8-4497-9619-6098da867964 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:03.776430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1084/2154] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:02:03.776994 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-9186f6ca-c3c1-4cd4-a36f-14446d95432b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:03.778176 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-9186f6ca-c3c1-4cd4-a36f-14446d95432b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:03.786029 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1071/2155] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:02:03.790173 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e03f6-70d8-4497-9619-6098da867964 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:03.799456 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e03f6-70d8-4497-9619-6098da867964 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:03.804927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3fd3b-88d8-46ca-9c8d-fe7e9d8a2442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:03.805669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3fd3b-88d8-46ca-9c8d-fe7e9d8a2442 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:03.805870 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3fd3b-88d8-46ca-9c8d-fe7e9d8a2442 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:03.806125 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3fd3b-88d8-46ca-9c8d-fe7e9d8a2442 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:03.806835 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3fd3b-88d8-46ca-9c8d-fe7e9d8a2442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:02:03.807137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3fd3b-88d8-46ca-9c8d-fe7e9d8a2442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:03.808973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3fd3b-88d8-46ca-9c8d-fe7e9d8a2442 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:03.823054 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1085/2156] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:02:03.827470 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186f6ca-c3c1-4cd4-a36f-14446d95432b None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:03.836687 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186f6ca-c3c1-4cd4-a36f-14446d95432b None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:03.841607 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d60e1-6a85-48be-8e25-10c00d78c7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:03.842267 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d60e1-6a85-48be-8e25-10c00d78c7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:03.842546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d60e1-6a85-48be-8e25-10c00d78c7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:03.842818 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d60e1-6a85-48be-8e25-10c00d78c7a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:03.843498 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d60e1-6a85-48be-8e25-10c00d78c7a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:03.845565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d60e1-6a85-48be-8e25-10c00d78c7a3 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:03.935156 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1072/2157] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:02:03 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:03.939440 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3fd3b-88d8-46ca-9c8d-fe7e9d8a2442 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:03.949671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3fd3b-88d8-46ca-9c8d-fe7e9d8a2442 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:04.029894 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7f44a-5880-44a0-93c6-25a0b7f30209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:04.030645 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7f44a-5880-44a0-93c6-25a0b7f30209 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:04.030993 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7f44a-5880-44a0-93c6-25a0b7f30209 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:04.031272 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7f44a-5880-44a0-93c6-25a0b7f30209 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:04.032081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7f44a-5880-44a0-93c6-25a0b7f30209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:04.034061 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7f44a-5880-44a0-93c6-25a0b7f30209 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:04.112229 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1086/2158] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:02:03 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:04.117933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d60e1-6a85-48be-8e25-10c00d78c7a3 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:04.136129 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d60e1-6a85-48be-8e25-10c00d78c7a3 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:04.143167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e0d64-a68a-41dd-9a70-da6f4fa0c30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:04.144041 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e0d64-a68a-41dd-9a70-da6f4fa0c30b admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:04.144542 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e0d64-a68a-41dd-9a70-da6f4fa0c30b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:04.144928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e0d64-a68a-41dd-9a70-da6f4fa0c30b admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:04.145773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e0d64-a68a-41dd-9a70-da6f4fa0c30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:04.147730 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e0d64-a68a-41dd-9a70-da6f4fa0c30b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:04.158319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1073/2159] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:02:04.162870 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7f44a-5880-44a0-93c6-25a0b7f30209 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:04.172853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7f44a-5880-44a0-93c6-25a0b7f30209 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:04.177414 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77434811-5892-4207-8e67-8da834049990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:04.178658 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77434811-5892-4207-8e67-8da834049990 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:04.178948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77434811-5892-4207-8e67-8da834049990 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:04.179227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77434811-5892-4207-8e67-8da834049990 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:04.179987 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77434811-5892-4207-8e67-8da834049990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:04.181613 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77434811-5892-4207-8e67-8da834049990 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:04.191439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1087/2160] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:04.195681 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e0d64-a68a-41dd-9a70-da6f4fa0c30b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:04.208660 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77434811-5892-4207-8e67-8da834049990 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:04.210748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-77434811-5892-4207-8e67-8da834049990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:04.213788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e0d64-a68a-41dd-9a70-da6f4fa0c30b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:04.218850 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a16854-0c5d-4bd0-872e-77155ce05fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:04.219497 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a16854-0c5d-4bd0-872e-77155ce05fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:04.219867 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a16854-0c5d-4bd0-872e-77155ce05fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:04.220148 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a16854-0c5d-4bd0-872e-77155ce05fe2 admin admin] PATH_INFO: `/v3/projects/8e022f0f4762424e80a7dff19ab1426b/users/12dfd80b53034677ab3290359cdc9d9a/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:04.224217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77434811-5892-4207-8e67-8da834049990 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:04.230557 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:04.233763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:04.233763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:04.233763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255 admin admin] PATH_INFO: `/v3/projects/712752bf27cf40f480ded90ff90d0192` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:04.233763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=712752bf27cf40f480ded90ff90d0192)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:04.235305 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:04.247428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a16854-0c5d-4bd0-872e-77155ce05fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e022f0f4762424e80a7dff19ab1426b, user_id=12dfd80b53034677ab3290359cdc9d9a, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:04.250212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a16854-0c5d-4bd0-872e-77155ce05fe2 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:04.408621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1074/2161] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:04 2022] PUT /identity/v3/projects/8e022f0f4762424e80a7dff19ab1426b/users/12dfd80b53034677ab3290359cdc9d9a/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:04.419635 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345bdd6-f239-4b89-8110-a89f11c5a150 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:04.419932 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345bdd6-f239-4b89-8110-a89f11c5a150 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:04.420214 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345bdd6-f239-4b89-8110-a89f11c5a150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:04.450773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-d345bdd6-f239-4b89-8110-a89f11c5a150 None None] MFA Rules not processed for user `12dfd80b53034677ab3290359cdc9d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:04.452269 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d345bdd6-f239-4b89-8110-a89f11c5a150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:04.464422 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712752bf27cf40f480ded90ff90d0192', 'request_id': 'req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:04.473687 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712752bf27cf40f480ded90ff90d0192', 'request_id': 'req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:04.528500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1075/2162] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:04.532868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345bdd6-f239-4b89-8110-a89f11c5a150 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:04.540137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712752bf27cf40f480ded90ff90d0192', 'request_id': 'req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:04.550776 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255 admin admin] The token cache is being invalidate because project 712752bf27cf40f480ded90ff90d0192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:02:04.551064 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:04.551796 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:04.555286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1088/2163] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:02:04 2022] DELETE /identity/v3/projects/712752bf27cf40f480ded90ff90d0192 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:04.559408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:04.560833 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:04.604133 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345bdd6-f239-4b89-8110-a89f11c5a150 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:04.609318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef1d7e-35e2-4815-9946-055cbc31aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:04.610043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef1d7e-35e2-4815-9946-055cbc31aeff admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:04.610426 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef1d7e-35e2-4815-9946-055cbc31aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:04.610631 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef1d7e-35e2-4815-9946-055cbc31aeff admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:04.611310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef1d7e-35e2-4815-9946-055cbc31aeff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:04.613466 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef1d7e-35e2-4815-9946-055cbc31aeff admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:04.628140 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c029bb1-84a2-4b0e-b6b7-0b94ff8bd255 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:04.633521 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5151d3a-b3cb-462e-8243-30ac64aa0707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:04.634559 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5151d3a-b3cb-462e-8243-30ac64aa0707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:04.634842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5151d3a-b3cb-462e-8243-30ac64aa0707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:04.635213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5151d3a-b3cb-462e-8243-30ac64aa0707 admin admin] PATH_INFO: `/v3/users/84448af35ccd41e7bf5129acd1f41173` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:04.636473 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5151d3a-b3cb-462e-8243-30ac64aa0707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84448af35ccd41e7bf5129acd1f41173)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:04.638743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5151d3a-b3cb-462e-8243-30ac64aa0707 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:04.704515 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1076/2164] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:02:04 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:02:04.705625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef1d7e-35e2-4815-9946-055cbc31aeff admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:04.707332 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b7ef1d7e-35e2-4815-9946-055cbc31aeff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:04.791114 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef1d7e-35e2-4815-9946-055cbc31aeff admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:04.807137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5e8ae-6b06-4e75-a320-cb74471e6795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:04.808533 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5e8ae-6b06-4e75-a320-cb74471e6795 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:04.808815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5e8ae-6b06-4e75-a320-cb74471e6795 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:04.811670 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5e8ae-6b06-4e75-a320-cb74471e6795 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:04.811670 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5e8ae-6b06-4e75-a320-cb74471e6795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:04.813619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5e8ae-6b06-4e75-a320-cb74471e6795 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:04.820879 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-f5151d3a-b3cb-462e-8243-30ac64aa0707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84448af35ccd41e7bf5129acd1f41173'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:04.821612 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-f5151d3a-b3cb-462e-8243-30ac64aa0707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84448af35ccd41e7bf5129acd1f41173'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:04.830189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-f5151d3a-b3cb-462e-8243-30ac64aa0707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84448af35ccd41e7bf5129acd1f41173'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:04.918390 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1077/2165] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:02:04 2022] POST /identity/v3/users => generated 296 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:04.920310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5e8ae-6b06-4e75-a320-cb74471e6795 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:04.922026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-eba5e8ae-6b06-4e75-a320-cb74471e6795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:04.934035 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5e8ae-6b06-4e75-a320-cb74471e6795 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:04.938825 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf78afb-9d0c-49d4-82ed-a7b448c68a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:04.944189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf78afb-9d0c-49d4-82ed-a7b448c68a4f admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:04.944189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf78afb-9d0c-49d4-82ed-a7b448c68a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:04.944189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf78afb-9d0c-49d4-82ed-a7b448c68a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:04.944189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf78afb-9d0c-49d4-82ed-a7b448c68a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:04.944189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf78afb-9d0c-49d4-82ed-a7b448c68a4f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:04.954729 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1078/2166] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:02:04.958866 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf78afb-9d0c-49d4-82ed-a7b448c68a4f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:04.963585 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-f5151d3a-b3cb-462e-8243-30ac64aa0707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84448af35ccd41e7bf5129acd1f41173'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:04.969348 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf78afb-9d0c-49d4-82ed-a7b448c68a4f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:04.974407 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ef886-d03a-4b86-874b-0af6ca7e5a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:04.975358 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ef886-d03a-4b86-874b-0af6ca7e5a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:04.975658 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ef886-d03a-4b86-874b-0af6ca7e5a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:04.975789 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-f5151d3a-b3cb-462e-8243-30ac64aa0707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84448af35ccd41e7bf5129acd1f41173'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:04.975940 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ef886-d03a-4b86-874b-0af6ca7e5a1e admin admin] PATH_INFO: `/v3/projects/1c773d1552ff489d88ad0d86c2b85ead/users/f86dcf57d6384f3ea3fe113770a944e7/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:04.981927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1089/2167] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:02:04 2022] DELETE /identity/v3/users/84448af35ccd41e7bf5129acd1f41173 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:02:04.992230 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ef886-d03a-4b86-874b-0af6ca7e5a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c773d1552ff489d88ad0d86c2b85ead, user_id=f86dcf57d6384f3ea3fe113770a944e7, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:04.994895 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ef886-d03a-4b86-874b-0af6ca7e5a1e admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:05.061710 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1079/2168] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:04 2022] PUT /identity/v3/projects/1c773d1552ff489d88ad0d86c2b85ead/users/f86dcf57d6384f3ea3fe113770a944e7/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:02:05.065816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5151d3a-b3cb-462e-8243-30ac64aa0707 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:05.132074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5151d3a-b3cb-462e-8243-30ac64aa0707 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:05.230560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13279f-48fe-450d-a5b0-245a122c2e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:05.230560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13279f-48fe-450d-a5b0-245a122c2e46 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:05.230560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13279f-48fe-450d-a5b0-245a122c2e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:05.230560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13279f-48fe-450d-a5b0-245a122c2e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:05.231571 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13279f-48fe-450d-a5b0-245a122c2e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:05.231571 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13279f-48fe-450d-a5b0-245a122c2e46 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:05.231571 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1090/2169] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:05.246570 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ef886-d03a-4b86-874b-0af6ca7e5a1e admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:05.258560 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ef886-d03a-4b86-874b-0af6ca7e5a1e admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:05.264626 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd923cb9-bdb4-4df6-8578-b46864c2f8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:05.265608 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923cb9-bdb4-4df6-8578-b46864c2f8ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:05.265889 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923cb9-bdb4-4df6-8578-b46864c2f8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:05.266168 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923cb9-bdb4-4df6-8578-b46864c2f8ab admin admin] PATH_INFO: `/v3/projects/1c773d1552ff489d88ad0d86c2b85ead/users/f86dcf57d6384f3ea3fe113770a944e7/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:05.268706 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd923cb9-bdb4-4df6-8578-b46864c2f8ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c773d1552ff489d88ad0d86c2b85ead, user_id=f86dcf57d6384f3ea3fe113770a944e7, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:05.271764 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd923cb9-bdb4-4df6-8578-b46864c2f8ab admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:05.283585 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1080/2170] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:05 2022] PUT /identity/v3/projects/1c773d1552ff489d88ad0d86c2b85ead/users/f86dcf57d6384f3ea3fe113770a944e7/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:05.304567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f920b4-7959-4b26-900f-539f7c6a9502 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:05.304859 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f920b4-7959-4b26-900f-539f7c6a9502 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:05.305201 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f920b4-7959-4b26-900f-539f7c6a9502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:05.340625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-37f920b4-7959-4b26-900f-539f7c6a9502 None None] MFA Rules not processed for user `f86dcf57d6384f3ea3fe113770a944e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:05.341962 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-37f920b4-7959-4b26-900f-539f7c6a9502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:05.420204 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1091/2171] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:05.431380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd923cb9-bdb4-4df6-8578-b46864c2f8ab admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:05.433253 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-fd923cb9-bdb4-4df6-8578-b46864c2f8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:05.496123 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd923cb9-bdb4-4df6-8578-b46864c2f8ab admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:05.500001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f627da-0010-4d80-a26b-34b68a09359b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:05.500659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f627da-0010-4d80-a26b-34b68a09359b service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:05.500942 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f627da-0010-4d80-a26b-34b68a09359b service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:05.501212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f627da-0010-4d80-a26b-34b68a09359b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:05.511771 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f627da-0010-4d80-a26b-34b68a09359b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:05.515793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f627da-0010-4d80-a26b-34b68a09359b service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:05.530005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1081/2172] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:02:05.685102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f920b4-7959-4b26-900f-539f7c6a9502 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:05.686832 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-37f920b4-7959-4b26-900f-539f7c6a9502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:05.822067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f920b4-7959-4b26-900f-539f7c6a9502 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:05.833012 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79392c-3601-40f4-8133-a1edeb45adb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:05.833940 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79392c-3601-40f4-8133-a1edeb45adb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:05.835101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79392c-3601-40f4-8133-a1edeb45adb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:05.835348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79392c-3601-40f4-8133-a1edeb45adb6 admin admin] PATH_INFO: `/v3/projects/6d313dd1839441c1860c41f8cf524c7e` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:05.836635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79392c-3601-40f4-8133-a1edeb45adb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d313dd1839441c1860c41f8cf524c7e)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:05.838713 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79392c-3601-40f4-8133-a1edeb45adb6 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:06.014570 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ba79392c-3601-40f4-8133-a1edeb45adb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d313dd1839441c1860c41f8cf524c7e', 'request_id': 'req-ba79392c-3601-40f4-8133-a1edeb45adb6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:06.028271 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ba79392c-3601-40f4-8133-a1edeb45adb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d313dd1839441c1860c41f8cf524c7e', 'request_id': 'req-ba79392c-3601-40f4-8133-a1edeb45adb6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:06.088496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ba79392c-3601-40f4-8133-a1edeb45adb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d313dd1839441c1860c41f8cf524c7e', 'request_id': 'req-ba79392c-3601-40f4-8133-a1edeb45adb6'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:06.101170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ba79392c-3601-40f4-8133-a1edeb45adb6 admin admin] The token cache is being invalidate because project 6d313dd1839441c1860c41f8cf524c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:02:06.101368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ba79392c-3601-40f4-8133-a1edeb45adb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:06.102027 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-ba79392c-3601-40f4-8133-a1edeb45adb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:06.104162 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1092/2173] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:02:05 2022] DELETE /identity/v3/projects/6d313dd1839441c1860c41f8cf524c7e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:06.109760 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0d106-615e-4539-9f61-12af1e35ad6e None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:06.110308 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0d106-615e-4539-9f61-12af1e35ad6e None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:06.110308 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0d106-615e-4539-9f61-12af1e35ad6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:06.138010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-f6b0d106-615e-4539-9f61-12af1e35ad6e None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:06.139340 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f6b0d106-615e-4539-9f61-12af1e35ad6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:06.201449 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1082/2174] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:06.209507 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af791cf5-94d3-4660-89fa-5a9dd3e72209 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:06.210070 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af791cf5-94d3-4660-89fa-5a9dd3e72209 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:06.210452 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af791cf5-94d3-4660-89fa-5a9dd3e72209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:06.231725 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-af791cf5-94d3-4660-89fa-5a9dd3e72209 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:06.233037 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-af791cf5-94d3-4660-89fa-5a9dd3e72209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:06.241699 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1093/2175] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:06.246032 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0d106-615e-4539-9f61-12af1e35ad6e None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:06.255994 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0d106-615e-4539-9f61-12af1e35ad6e None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:06.261026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e0244-f1a0-4be5-94ac-723a053bb7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:06.261685 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e0244-f1a0-4be5-94ac-723a053bb7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:06.261964 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e0244-f1a0-4be5-94ac-723a053bb7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:06.262235 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e0244-f1a0-4be5-94ac-723a053bb7b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:06.262982 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e0244-f1a0-4be5-94ac-723a053bb7b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:02:06.263286 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e0244-f1a0-4be5-94ac-723a053bb7b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:06.264953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e0244-f1a0-4be5-94ac-723a053bb7b5 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:06.276483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1083/2176] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:02:06.280863 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af791cf5-94d3-4660-89fa-5a9dd3e72209 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:06.291458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af791cf5-94d3-4660-89fa-5a9dd3e72209 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:06.295900 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ae418-92c6-49c1-b6fe-a2f69f47b023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:06.296560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ae418-92c6-49c1-b6fe-a2f69f47b023 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:06.296876 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ae418-92c6-49c1-b6fe-a2f69f47b023 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:06.297163 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ae418-92c6-49c1-b6fe-a2f69f47b023 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:06.297939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ae418-92c6-49c1-b6fe-a2f69f47b023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:06.300013 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ae418-92c6-49c1-b6fe-a2f69f47b023 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:06.408244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e0244-f1a0-4be5-94ac-723a053bb7b5 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:06.410952 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-137e0244-f1a0-4be5-94ac-723a053bb7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:06.437129 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e0244-f1a0-4be5-94ac-723a053bb7b5 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:06.438735 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1094/2177] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:02:06 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:06.440406 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ae418-92c6-49c1-b6fe-a2f69f47b023 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:06.516694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ae418-92c6-49c1-b6fe-a2f69f47b023 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:06.520009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aa4dc-d4c2-4134-a61d-41ba3c93ad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:06.521064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa4dc-d4c2-4134-a61d-41ba3c93ad26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:06.521449 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa4dc-d4c2-4134-a61d-41ba3c93ad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:06.522357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aa4dc-d4c2-4134-a61d-41ba3c93ad26 admin admin] PATH_INFO: `/v3/users/12dfd80b53034677ab3290359cdc9d9a` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:06.531410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b518a90-32e0-4b53-ab13-c19d7e93f5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:06.531784 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aa4dc-d4c2-4134-a61d-41ba3c93ad26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12dfd80b53034677ab3290359cdc9d9a)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:06.531891 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b518a90-32e0-4b53-ab13-c19d7e93f5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:06.531986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aa4dc-d4c2-4134-a61d-41ba3c93ad26 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:06.532080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b518a90-32e0-4b53-ab13-c19d7e93f5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:06.532080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b518a90-32e0-4b53-ab13-c19d7e93f5d7 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:06.532080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b518a90-32e0-4b53-ab13-c19d7e93f5d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:06.532080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b518a90-32e0-4b53-ab13-c19d7e93f5d7 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:06.649630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1095/2178] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:02:06 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:06.660321 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b518a90-32e0-4b53-ab13-c19d7e93f5d7 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:06.675613 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b518a90-32e0-4b53-ab13-c19d7e93f5d7 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:06.681635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40eb2ed-1634-4d2a-a9e0-a38f59fd1bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:06.682306 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eb2ed-1634-4d2a-a9e0-a38f59fd1bcc admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:06.683232 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eb2ed-1634-4d2a-a9e0-a38f59fd1bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:06.683232 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eb2ed-1634-4d2a-a9e0-a38f59fd1bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:06.683690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40eb2ed-1634-4d2a-a9e0-a38f59fd1bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:06.693043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40eb2ed-1634-4d2a-a9e0-a38f59fd1bcc admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:06.696230 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1096/2179] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:02:06.700183 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40eb2ed-1634-4d2a-a9e0-a38f59fd1bcc admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:06.710258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40eb2ed-1634-4d2a-a9e0-a38f59fd1bcc admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:06.715119 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aef071-2b84-4871-b515-9a891114716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:06.717439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aef071-2b84-4871-b515-9a891114716a admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:06.717439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aef071-2b84-4871-b515-9a891114716a admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:06.717439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aef071-2b84-4871-b515-9a891114716a admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:06.717439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aef071-2b84-4871-b515-9a891114716a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:06.718652 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aef071-2b84-4871-b515-9a891114716a admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:06.730785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1097/2180] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:02:06.734728 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aef071-2b84-4871-b515-9a891114716a admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:06.744531 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aef071-2b84-4871-b515-9a891114716a admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:06.752533 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb68e6f-af7f-41cd-95a5-8eabcdd51180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:06.752533 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb68e6f-af7f-41cd-95a5-8eabcdd51180 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:06.752533 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb68e6f-af7f-41cd-95a5-8eabcdd51180 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:06.752533 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb68e6f-af7f-41cd-95a5-8eabcdd51180 admin admin] PATH_INFO: `/v3/projects/e899511298394a11804d28b25d0a925c/users/30962247dd4046b3800f3136fbc8345c/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:06.775416 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb68e6f-af7f-41cd-95a5-8eabcdd51180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e899511298394a11804d28b25d0a925c, user_id=30962247dd4046b3800f3136fbc8345c, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:06.778273 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb68e6f-af7f-41cd-95a5-8eabcdd51180 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:06.788511 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-162aa4dc-d4c2-4134-a61d-41ba3c93ad26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12dfd80b53034677ab3290359cdc9d9a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:06.789136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-162aa4dc-d4c2-4134-a61d-41ba3c93ad26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12dfd80b53034677ab3290359cdc9d9a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:06.869838 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-162aa4dc-d4c2-4134-a61d-41ba3c93ad26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12dfd80b53034677ab3290359cdc9d9a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:06.879184 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1098/2181] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:06 2022] PUT /identity/v3/projects/e899511298394a11804d28b25d0a925c/users/30962247dd4046b3800f3136fbc8345c/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:02:06.885654 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f5ff4-9bbe-4a61-8fe8-cbc0b0d142b0 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:06.885948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f5ff4-9bbe-4a61-8fe8-cbc0b0d142b0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:06.886223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f5ff4-9bbe-4a61-8fe8-cbc0b0d142b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:06.887224 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-162aa4dc-d4c2-4134-a61d-41ba3c93ad26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12dfd80b53034677ab3290359cdc9d9a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:06.895852 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-162aa4dc-d4c2-4134-a61d-41ba3c93ad26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12dfd80b53034677ab3290359cdc9d9a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:06.903914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1084/2182] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:02:06 2022] DELETE /identity/v3/users/12dfd80b53034677ab3290359cdc9d9a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:06.910536 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb79a7a-6495-4dd2-92f1-8108ce259691 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:06.911110 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb79a7a-6495-4dd2-92f1-8108ce259691 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:06.911628 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb79a7a-6495-4dd2-92f1-8108ce259691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:06.931548 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-efb79a7a-6495-4dd2-92f1-8108ce259691 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:06.933200 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-efb79a7a-6495-4dd2-92f1-8108ce259691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:06.936625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-506f5ff4-9bbe-4a61-8fe8-cbc0b0d142b0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:06.937820 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-506f5ff4-9bbe-4a61-8fe8-cbc0b0d142b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:07.000598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1085/2183] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:07.011767 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb79a7a-6495-4dd2-92f1-8108ce259691 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:07.013248 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-efb79a7a-6495-4dd2-92f1-8108ce259691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:07.035685 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1099/2184] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:07.047087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f5ff4-9bbe-4a61-8fe8-cbc0b0d142b0 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:07.048949 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-506f5ff4-9bbe-4a61-8fe8-cbc0b0d142b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:07.123975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f5ff4-9bbe-4a61-8fe8-cbc0b0d142b0 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:07.128433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8a040-dd43-4803-bffb-4d7d5634effb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:07.129545 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8a040-dd43-4803-bffb-4d7d5634effb service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:07.129726 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8a040-dd43-4803-bffb-4d7d5634effb service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:07.129848 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb79a7a-6495-4dd2-92f1-8108ce259691 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:07.130289 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8a040-dd43-4803-bffb-4d7d5634effb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:07.136467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f46f0c-0a9f-4801-a5b5-6c34bac9e330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:07.138666 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f46f0c-0a9f-4801-a5b5-6c34bac9e330 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:07.138666 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f46f0c-0a9f-4801-a5b5-6c34bac9e330 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:07.138666 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f46f0c-0a9f-4801-a5b5-6c34bac9e330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:07.150768 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8a040-dd43-4803-bffb-4d7d5634effb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:07.152401 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8a040-dd43-4803-bffb-4d7d5634effb service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:07.159011 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f46f0c-0a9f-4801-a5b5-6c34bac9e330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:07.161105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f46f0c-0a9f-4801-a5b5-6c34bac9e330 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:07.176380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1086/2185] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:02:07.182385 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1100/2186] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:02:08.101023 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8a040-dd43-4803-bffb-4d7d5634effb service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:08.102753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-efa8a040-dd43-4803-bffb-4d7d5634effb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:08.117405 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8a040-dd43-4803-bffb-4d7d5634effb service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:08.122465 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95522ec1-f7e9-4e2c-9ac4-92ca5a7640db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:08.127939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95522ec1-f7e9-4e2c-9ac4-92ca5a7640db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:08.127939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95522ec1-f7e9-4e2c-9ac4-92ca5a7640db admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:08.127939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95522ec1-f7e9-4e2c-9ac4-92ca5a7640db admin admin] PATH_INFO: `/v3/projects/8e022f0f4762424e80a7dff19ab1426b` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:08.127939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95522ec1-f7e9-4e2c-9ac4-92ca5a7640db admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e022f0f4762424e80a7dff19ab1426b)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:08.127939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95522ec1-f7e9-4e2c-9ac4-92ca5a7640db admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:08.260559 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95522ec1-f7e9-4e2c-9ac4-92ca5a7640db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e022f0f4762424e80a7dff19ab1426b', 'request_id': 'req-95522ec1-f7e9-4e2c-9ac4-92ca5a7640db'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:08.266787 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95522ec1-f7e9-4e2c-9ac4-92ca5a7640db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e022f0f4762424e80a7dff19ab1426b', 'request_id': 'req-95522ec1-f7e9-4e2c-9ac4-92ca5a7640db'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:08.392080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95522ec1-f7e9-4e2c-9ac4-92ca5a7640db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e022f0f4762424e80a7dff19ab1426b', 'request_id': 'req-95522ec1-f7e9-4e2c-9ac4-92ca5a7640db'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:08.404516 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95522ec1-f7e9-4e2c-9ac4-92ca5a7640db admin admin] The token cache is being invalidate because project 8e022f0f4762424e80a7dff19ab1426b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:02:08.404945 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95522ec1-f7e9-4e2c-9ac4-92ca5a7640db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:08.405818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95522ec1-f7e9-4e2c-9ac4-92ca5a7640db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:08.407699 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1101/2187] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:02:08 2022] DELETE /identity/v3/projects/8e022f0f4762424e80a7dff19ab1426b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:08.411598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f46f0c-0a9f-4801-a5b5-6c34bac9e330 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:08.422258 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f46f0c-0a9f-4801-a5b5-6c34bac9e330 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:08.482843 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f04d5-7467-475e-97c2-bbb304ac3f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:08.483877 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f04d5-7467-475e-97c2-bbb304ac3f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:08.484368 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f04d5-7467-475e-97c2-bbb304ac3f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:08.484802 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f04d5-7467-475e-97c2-bbb304ac3f92 admin admin] PATH_INFO: `/v3/users/f86dcf57d6384f3ea3fe113770a944e7` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:08.486108 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f04d5-7467-475e-97c2-bbb304ac3f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f86dcf57d6384f3ea3fe113770a944e7)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:08.488205 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f04d5-7467-475e-97c2-bbb304ac3f92 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:08.698862 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-367f04d5-7467-475e-97c2-bbb304ac3f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f86dcf57d6384f3ea3fe113770a944e7'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:08.700407 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-367f04d5-7467-475e-97c2-bbb304ac3f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f86dcf57d6384f3ea3fe113770a944e7'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:08.801625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-367f04d5-7467-475e-97c2-bbb304ac3f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f86dcf57d6384f3ea3fe113770a944e7'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:08.817820 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-367f04d5-7467-475e-97c2-bbb304ac3f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f86dcf57d6384f3ea3fe113770a944e7'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:08.826884 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-367f04d5-7467-475e-97c2-bbb304ac3f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f86dcf57d6384f3ea3fe113770a944e7'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:08.833008 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1087/2188] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:02:08 2022] DELETE /identity/v3/users/f86dcf57d6384f3ea3fe113770a944e7 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:09.048582 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729052ad-ad33-4c4c-a4a2-a17a0d460783 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:09.049187 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729052ad-ad33-4c4c-a4a2-a17a0d460783 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:09.049713 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729052ad-ad33-4c4c-a4a2-a17a0d460783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:09.097818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-729052ad-ad33-4c4c-a4a2-a17a0d460783 None None] MFA Rules not processed for user `30962247dd4046b3800f3136fbc8345c`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:09.099171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-729052ad-ad33-4c4c-a4a2-a17a0d460783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:09.214818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1102/2189] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:09.219474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f04d5-7467-475e-97c2-bbb304ac3f92 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:09.221257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-367f04d5-7467-475e-97c2-bbb304ac3f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:09.364235 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f04d5-7467-475e-97c2-bbb304ac3f92 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:09.371653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa979e-016f-4116-8f64-f0fd8304949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:09.371653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa979e-016f-4116-8f64-f0fd8304949e admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:09.371653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa979e-016f-4116-8f64-f0fd8304949e admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:09.371653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa979e-016f-4116-8f64-f0fd8304949e admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:09.373180 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa979e-016f-4116-8f64-f0fd8304949e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:09.376456 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa979e-016f-4116-8f64-f0fd8304949e admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:09.497419 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729052ad-ad33-4c4c-a4a2-a17a0d460783 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:09.498840 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-729052ad-ad33-4c4c-a4a2-a17a0d460783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:09.504440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1088/2190] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:02:09 2022] POST /identity/v3/projects => generated 373 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:02:09.505353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa979e-016f-4116-8f64-f0fd8304949e admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:09.514036 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729052ad-ad33-4c4c-a4a2-a17a0d460783 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:09.645736 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa979e-016f-4116-8f64-f0fd8304949e admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:09.655194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77621ef4-35d6-49e5-bc64-796df2f50904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:09.655991 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77621ef4-35d6-49e5-bc64-796df2f50904 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:09.659515 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77621ef4-35d6-49e5-bc64-796df2f50904 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:09.659515 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77621ef4-35d6-49e5-bc64-796df2f50904 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:09.659515 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77621ef4-35d6-49e5-bc64-796df2f50904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:09.659969 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77621ef4-35d6-49e5-bc64-796df2f50904 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:09.740796 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1089/2191] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:02:09 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:09.745671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9af03d-627f-4255-bdbf-0e964dda1b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:09.745671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9af03d-627f-4255-bdbf-0e964dda1b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:09.745876 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77621ef4-35d6-49e5-bc64-796df2f50904 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:09.745962 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9af03d-627f-4255-bdbf-0e964dda1b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:09.745962 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9af03d-627f-4255-bdbf-0e964dda1b51 admin admin] PATH_INFO: `/v3/projects/1c773d1552ff489d88ad0d86c2b85ead` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:09.746368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9af03d-627f-4255-bdbf-0e964dda1b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c773d1552ff489d88ad0d86c2b85ead)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:09.748359 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9af03d-627f-4255-bdbf-0e964dda1b51 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:09.755409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77621ef4-35d6-49e5-bc64-796df2f50904 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:09.768697 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fccee-8d0c-4944-bf70-6d9a743892e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:09.769802 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fccee-8d0c-4944-bf70-6d9a743892e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:09.770928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fccee-8d0c-4944-bf70-6d9a743892e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:09.772305 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fccee-8d0c-4944-bf70-6d9a743892e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:09.773208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fccee-8d0c-4944-bf70-6d9a743892e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:09.776524 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fccee-8d0c-4944-bf70-6d9a743892e6 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:09.790503 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1090/2192] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:09.795064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fccee-8d0c-4944-bf70-6d9a743892e6 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:09.807273 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fccee-8d0c-4944-bf70-6d9a743892e6 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:09.819346 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c4c66-e751-4e62-bc43-a615f4606889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:09.819346 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c4c66-e751-4e62-bc43-a615f4606889 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:09.819346 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c4c66-e751-4e62-bc43-a615f4606889 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:09.819346 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c4c66-e751-4e62-bc43-a615f4606889 admin admin] PATH_INFO: `/v3/projects/a26335b18df2471aa373124a5a02b21b/users/b1e601c68be24403851e6e3d21e60854/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:09.844723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c4c66-e751-4e62-bc43-a615f4606889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26335b18df2471aa373124a5a02b21b, user_id=b1e601c68be24403851e6e3d21e60854, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:09.853588 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c4c66-e751-4e62-bc43-a615f4606889 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:09.865142 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6f9af03d-627f-4255-bdbf-0e964dda1b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c773d1552ff489d88ad0d86c2b85ead', 'request_id': 'req-6f9af03d-627f-4255-bdbf-0e964dda1b51'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:09.873078 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6f9af03d-627f-4255-bdbf-0e964dda1b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c773d1552ff489d88ad0d86c2b85ead', 'request_id': 'req-6f9af03d-627f-4255-bdbf-0e964dda1b51'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:09.940743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6f9af03d-627f-4255-bdbf-0e964dda1b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c773d1552ff489d88ad0d86c2b85ead', 'request_id': 'req-6f9af03d-627f-4255-bdbf-0e964dda1b51'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:09.945188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1091/2193] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:09 2022] PUT /identity/v3/projects/a26335b18df2471aa373124a5a02b21b/users/b1e601c68be24403851e6e3d21e60854/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:02:09.949372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c4c66-e751-4e62-bc43-a615f4606889 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:09.960343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6f9af03d-627f-4255-bdbf-0e964dda1b51 admin admin] The token cache is being invalidate because project 1c773d1552ff489d88ad0d86c2b85ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:02:09.962853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6f9af03d-627f-4255-bdbf-0e964dda1b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:09.962853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6f9af03d-627f-4255-bdbf-0e964dda1b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:09.969282 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1103/2194] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:02:09 2022] DELETE /identity/v3/projects/1c773d1552ff489d88ad0d86c2b85ead => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:09.971232 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba3c08-5fb3-4a28-aee0-b8a2db6d87b9 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:09.971960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba3c08-5fb3-4a28-aee0-b8a2db6d87b9 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:09.972242 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba3c08-5fb3-4a28-aee0-b8a2db6d87b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:10.001157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-1dba3c08-5fb3-4a28-aee0-b8a2db6d87b9 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:10.002530 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-1dba3c08-5fb3-4a28-aee0-b8a2db6d87b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:10.055712 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c4c66-e751-4e62-bc43-a615f4606889 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:10.060662 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30627d4a-f1f1-41a1-aebe-e7ad78979e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:10.061419 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30627d4a-f1f1-41a1-aebe-e7ad78979e4b admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:10.061769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30627d4a-f1f1-41a1-aebe-e7ad78979e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:10.062469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30627d4a-f1f1-41a1-aebe-e7ad78979e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:10.063561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30627d4a-f1f1-41a1-aebe-e7ad78979e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:10.065464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30627d4a-f1f1-41a1-aebe-e7ad78979e4b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:10.080223 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1092/2195] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:10.086887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30627d4a-f1f1-41a1-aebe-e7ad78979e4b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:10.087074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1104/2196] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:10.090940 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-30627d4a-f1f1-41a1-aebe-e7ad78979e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:10.094804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff86568-de20-4eb1-beb7-2be7f8fc813d None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:10.095092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff86568-de20-4eb1-beb7-2be7f8fc813d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:10.095412 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff86568-de20-4eb1-beb7-2be7f8fc813d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:10.107427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30627d4a-f1f1-41a1-aebe-e7ad78979e4b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:10.112715 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d231e0-f8ce-43e1-9338-015405fd34a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:10.113751 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d231e0-f8ce-43e1-9338-015405fd34a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:10.114036 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d231e0-f8ce-43e1-9338-015405fd34a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:10.114372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d231e0-f8ce-43e1-9338-015405fd34a8 admin admin] PATH_INFO: `/v3/projects/a26335b18df2471aa373124a5a02b21b/users/b1e601c68be24403851e6e3d21e60854/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:10.115792 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-dff86568-de20-4eb1-beb7-2be7f8fc813d None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:10.116721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d231e0-f8ce-43e1-9338-015405fd34a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26335b18df2471aa373124a5a02b21b, user_id=b1e601c68be24403851e6e3d21e60854, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:10.117280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-dff86568-de20-4eb1-beb7-2be7f8fc813d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:10.119815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d231e0-f8ce-43e1-9338-015405fd34a8 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:10.126084 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1105/2197] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:02:10.130360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff86568-de20-4eb1-beb7-2be7f8fc813d None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:10.139140 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1093/2198] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:10 2022] PUT /identity/v3/projects/a26335b18df2471aa373124a5a02b21b/users/b1e601c68be24403851e6e3d21e60854/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:10.141427 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff86568-de20-4eb1-beb7-2be7f8fc813d None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:10.207700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b099c-ad4e-4511-bf70-72451c199c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:10.208501 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b099c-ad4e-4511-bf70-72451c199c04 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:10.209801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b099c-ad4e-4511-bf70-72451c199c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:10.210207 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b099c-ad4e-4511-bf70-72451c199c04 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:10.211173 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b099c-ad4e-4511-bf70-72451c199c04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:02:10.211581 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b099c-ad4e-4511-bf70-72451c199c04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:10.213343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b099c-ad4e-4511-bf70-72451c199c04 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:10.225244 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1106/2199] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:02:10.229671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d231e0-f8ce-43e1-9338-015405fd34a8 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:10.241905 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d231e0-f8ce-43e1-9338-015405fd34a8 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:10.247084 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed66830-56a6-4044-afbc-f5a09491f527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:10.247441 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed66830-56a6-4044-afbc-f5a09491f527 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:10.247764 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed66830-56a6-4044-afbc-f5a09491f527 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:10.248046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed66830-56a6-4044-afbc-f5a09491f527 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:10.248760 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed66830-56a6-4044-afbc-f5a09491f527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:10.250662 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed66830-56a6-4044-afbc-f5a09491f527 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:10.341199 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1094/2200] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:02:10 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:10.345285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b099c-ad4e-4511-bf70-72451c199c04 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:10.356393 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b099c-ad4e-4511-bf70-72451c199c04 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:10.415108 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f9d98-bddb-4df6-8701-947b28368018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:10.415912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f9d98-bddb-4df6-8701-947b28368018 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:10.416311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f9d98-bddb-4df6-8701-947b28368018 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:10.416748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f9d98-bddb-4df6-8701-947b28368018 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:10.417626 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f9d98-bddb-4df6-8701-947b28368018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:10.419485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f9d98-bddb-4df6-8701-947b28368018 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:10.530458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1107/2201] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:02:10 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:10.535116 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed66830-56a6-4044-afbc-f5a09491f527 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:10.545910 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed66830-56a6-4044-afbc-f5a09491f527 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:10.550619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6207af-9326-4ed3-936f-7b26973c3ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:10.551489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6207af-9326-4ed3-936f-7b26973c3ffe admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:10.551811 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6207af-9326-4ed3-936f-7b26973c3ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:10.552100 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6207af-9326-4ed3-936f-7b26973c3ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:10.553403 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6207af-9326-4ed3-936f-7b26973c3ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:10.555153 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6207af-9326-4ed3-936f-7b26973c3ffe admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:10.565309 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1095/2202] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:10.570089 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f9d98-bddb-4df6-8701-947b28368018 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:10.581951 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f9d98-bddb-4df6-8701-947b28368018 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:10.586771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a8dc2-24e0-4916-8c16-c6386755b7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:10.587484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a8dc2-24e0-4916-8c16-c6386755b7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:10.587800 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a8dc2-24e0-4916-8c16-c6386755b7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:10.595440 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a8dc2-24e0-4916-8c16-c6386755b7a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:10.595440 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a8dc2-24e0-4916-8c16-c6386755b7a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:10.595440 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a8dc2-24e0-4916-8c16-c6386755b7a3 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:10.601470 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1108/2203] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:10.605988 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6207af-9326-4ed3-936f-7b26973c3ffe admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:10.617012 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6207af-9326-4ed3-936f-7b26973c3ffe admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:10.622458 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b26dae-7b3e-46d2-9666-de56bfe67197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:10.623386 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b26dae-7b3e-46d2-9666-de56bfe67197 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:10.623797 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b26dae-7b3e-46d2-9666-de56bfe67197 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:10.624065 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b26dae-7b3e-46d2-9666-de56bfe67197 admin admin] PATH_INFO: `/v3/projects/e8d38b4cc69d4510a9c665b7619b27d9/users/ed5030da5363441caf35b6fb5619abc5/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:10.641134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b26dae-7b3e-46d2-9666-de56bfe67197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d38b4cc69d4510a9c665b7619b27d9, user_id=ed5030da5363441caf35b6fb5619abc5, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:10.644026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b26dae-7b3e-46d2-9666-de56bfe67197 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:10.745967 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1096/2204] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:10 2022] PUT /identity/v3/projects/e8d38b4cc69d4510a9c665b7619b27d9/users/ed5030da5363441caf35b6fb5619abc5/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:10.758401 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cedd5-11d4-4e56-afab-5e10c47db247 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:10.758720 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cedd5-11d4-4e56-afab-5e10c47db247 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:10.759032 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cedd5-11d4-4e56-afab-5e10c47db247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:10.796849 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-9b7cedd5-11d4-4e56-afab-5e10c47db247 None None] MFA Rules not processed for user `ed5030da5363441caf35b6fb5619abc5`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:10.800809 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-9b7cedd5-11d4-4e56-afab-5e10c47db247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:10.882263 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1109/2205] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:02:10.886494 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b26dae-7b3e-46d2-9666-de56bfe67197 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:10.956178 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b26dae-7b3e-46d2-9666-de56bfe67197 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:10.961007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0ca79-e2a2-4d27-a850-dd7df400f5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:10.961672 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0ca79-e2a2-4d27-a850-dd7df400f5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:10.961987 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0ca79-e2a2-4d27-a850-dd7df400f5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:10.962247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0ca79-e2a2-4d27-a850-dd7df400f5d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:10.962940 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0ca79-e2a2-4d27-a850-dd7df400f5d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:10.964899 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0ca79-e2a2-4d27-a850-dd7df400f5d2 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:11.091326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1097/2206] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:02:10 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:02:11.095488 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cedd5-11d4-4e56-afab-5e10c47db247 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:11.112164 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cedd5-11d4-4e56-afab-5e10c47db247 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:11.209409 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913076d-a9f5-4922-b749-ac6bb526be14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:11.210847 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913076d-a9f5-4922-b749-ac6bb526be14 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:11.211211 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913076d-a9f5-4922-b749-ac6bb526be14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:11.211580 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913076d-a9f5-4922-b749-ac6bb526be14 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:11.214250 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913076d-a9f5-4922-b749-ac6bb526be14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:11.217546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913076d-a9f5-4922-b749-ac6bb526be14 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:11.317170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1110/2207] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:02:11 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:02:11.317727 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0ca79-e2a2-4d27-a850-dd7df400f5d2 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:11.350474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0ca79-e2a2-4d27-a850-dd7df400f5d2 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:11.363750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04e3f5-c7f3-47d6-80c3-b07c048bd2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:11.368743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04e3f5-c7f3-47d6-80c3-b07c048bd2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:11.368743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04e3f5-c7f3-47d6-80c3-b07c048bd2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:11.368743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04e3f5-c7f3-47d6-80c3-b07c048bd2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:11.368743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04e3f5-c7f3-47d6-80c3-b07c048bd2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:11.368743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04e3f5-c7f3-47d6-80c3-b07c048bd2b8 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:11.379624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1098/2208] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:11.384657 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913076d-a9f5-4922-b749-ac6bb526be14 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:11.394827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913076d-a9f5-4922-b749-ac6bb526be14 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:11.405849 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424fca4-daa4-4f74-906d-0432cb46c216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:11.407186 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424fca4-daa4-4f74-906d-0432cb46c216 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:11.407558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424fca4-daa4-4f74-906d-0432cb46c216 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:11.407918 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424fca4-daa4-4f74-906d-0432cb46c216 admin admin] PATH_INFO: `/v3/projects/1c768e47171f48669471be0d98563acf/users/5a713a039ec84df48eebd98e35cd6fad/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:11.454985 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424fca4-daa4-4f74-906d-0432cb46c216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c768e47171f48669471be0d98563acf, user_id=5a713a039ec84df48eebd98e35cd6fad, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:11.454985 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424fca4-daa4-4f74-906d-0432cb46c216 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:11.546139 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1111/2209] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:11 2022] PUT /identity/v3/projects/1c768e47171f48669471be0d98563acf/users/5a713a039ec84df48eebd98e35cd6fad/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:02:11.550087 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04e3f5-c7f3-47d6-80c3-b07c048bd2b8 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:11.561344 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04e3f5-c7f3-47d6-80c3-b07c048bd2b8 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:11.618840 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f78275-238a-4b00-91af-b970d46e755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:11.619796 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f78275-238a-4b00-91af-b970d46e755d admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:11.620084 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f78275-238a-4b00-91af-b970d46e755d admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:11.620362 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f78275-238a-4b00-91af-b970d46e755d admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:11.621094 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f78275-238a-4b00-91af-b970d46e755d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:11.622768 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f78275-238a-4b00-91af-b970d46e755d admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:11.633514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1099/2210] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:02:11.637508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424fca4-daa4-4f74-906d-0432cb46c216 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:11.660676 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424fca4-daa4-4f74-906d-0432cb46c216 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:11.682650 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c366e9-1519-44f4-b479-c0403444de84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:11.682650 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c366e9-1519-44f4-b479-c0403444de84 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:11.682650 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c366e9-1519-44f4-b479-c0403444de84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:11.682650 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c366e9-1519-44f4-b479-c0403444de84 admin admin] PATH_INFO: `/v3/projects/1c768e47171f48669471be0d98563acf/users/5a713a039ec84df48eebd98e35cd6fad/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:11.682940 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c366e9-1519-44f4-b479-c0403444de84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c768e47171f48669471be0d98563acf, user_id=5a713a039ec84df48eebd98e35cd6fad, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:11.687190 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c366e9-1519-44f4-b479-c0403444de84 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:11.722635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1112/2211] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:11 2022] PUT /identity/v3/projects/1c768e47171f48669471be0d98563acf/users/5a713a039ec84df48eebd98e35cd6fad/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:11.724994 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9c5c0-d385-4d65-bf51-3ba7a69e00d7 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:11.725290 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9c5c0-d385-4d65-bf51-3ba7a69e00d7 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:11.725769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9c5c0-d385-4d65-bf51-3ba7a69e00d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:11.742212 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556bba0-237a-482c-b326-87938c604428 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:11.742525 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556bba0-237a-482c-b326-87938c604428 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:11.742802 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556bba0-237a-482c-b326-87938c604428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:11.758960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-94e9c5c0-d385-4d65-bf51-3ba7a69e00d7 None None] MFA Rules not processed for user `5a713a039ec84df48eebd98e35cd6fad`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:11.760622 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-94e9c5c0-d385-4d65-bf51-3ba7a69e00d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:11.773335 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-d556bba0-237a-482c-b326-87938c604428 None None] MFA Rules not processed for user `b1e601c68be24403851e6e3d21e60854`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:11.774650 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d556bba0-237a-482c-b326-87938c604428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:11.857337 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1100/2212] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:02:11.865730 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1113/2213] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:02:11.873797 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9c5c0-d385-4d65-bf51-3ba7a69e00d7 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:11.875404 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-94e9c5c0-d385-4d65-bf51-3ba7a69e00d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:11.878490 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556bba0-237a-482c-b326-87938c604428 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:11.880205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d556bba0-237a-482c-b326-87938c604428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:11.945555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9c5c0-d385-4d65-bf51-3ba7a69e00d7 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:11.949302 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7874f-8c9e-4788-9293-9e8821c64ab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:11.949965 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7874f-8c9e-4788-9293-9e8821c64ab7 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:11.950244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7874f-8c9e-4788-9293-9e8821c64ab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:11.950519 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7874f-8c9e-4788-9293-9e8821c64ab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:11.958449 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556bba0-237a-482c-b326-87938c604428 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:11.963969 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40887a8f-db70-49f8-b8b1-74716845d8ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:11.964877 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40887a8f-db70-49f8-b8b1-74716845d8ae service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:11.965376 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40887a8f-db70-49f8-b8b1-74716845d8ae service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:11.965727 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40887a8f-db70-49f8-b8b1-74716845d8ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:11.967841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-40887a8f-db70-49f8-b8b1-74716845d8ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:12.008366 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7874f-8c9e-4788-9293-9e8821c64ab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:12.009855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7874f-8c9e-4788-9293-9e8821c64ab7 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:12.020946 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1101/2214] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:02:12.036220 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40887a8f-db70-49f8-b8b1-74716845d8ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:12.038697 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40887a8f-db70-49f8-b8b1-74716845d8ae service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:12.049607 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1114/2215] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:02:13.019598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7874f-8c9e-4788-9293-9e8821c64ab7 service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:13.021846 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e4c7874f-8c9e-4788-9293-9e8821c64ab7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:13.227068 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7874f-8c9e-4788-9293-9e8821c64ab7 service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:13.231966 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7a320-b430-47f4-bced-99f6d79e53fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:13.232884 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7a320-b430-47f4-bced-99f6d79e53fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:13.233165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7a320-b430-47f4-bced-99f6d79e53fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:13.233434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7a320-b430-47f4-bced-99f6d79e53fa admin admin] PATH_INFO: `/v3/users/4890bc0a17ea4518bc9276cc08357537` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:13.234626 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7a320-b430-47f4-bced-99f6d79e53fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4890bc0a17ea4518bc9276cc08357537)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:13.236639 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7a320-b430-47f4-bced-99f6d79e53fa admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:13.469536 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-0cf7a320-b430-47f4-bced-99f6d79e53fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4890bc0a17ea4518bc9276cc08357537'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:13.470211 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-0cf7a320-b430-47f4-bced-99f6d79e53fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4890bc0a17ea4518bc9276cc08357537'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:13.539828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-0cf7a320-b430-47f4-bced-99f6d79e53fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4890bc0a17ea4518bc9276cc08357537'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:13.553302 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-0cf7a320-b430-47f4-bced-99f6d79e53fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4890bc0a17ea4518bc9276cc08357537'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:13.560839 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-0cf7a320-b430-47f4-bced-99f6d79e53fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4890bc0a17ea4518bc9276cc08357537'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:13.567917 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1102/2216] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:02:13 2022] DELETE /identity/v3/users/4890bc0a17ea4518bc9276cc08357537 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:13.572792 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d3089-c34e-4fc8-a29a-d7f163d8fa42 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:13.573967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d3089-c34e-4fc8-a29a-d7f163d8fa42 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:13.578294 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d3089-c34e-4fc8-a29a-d7f163d8fa42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:13.608377 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-649d3089-c34e-4fc8-a29a-d7f163d8fa42 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:13.609732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-649d3089-c34e-4fc8-a29a-d7f163d8fa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:13.678744 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1115/2217] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:13.688277 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7a320-b430-47f4-bced-99f6d79e53fa admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:13.689936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0cf7a320-b430-47f4-bced-99f6d79e53fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:13.753549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7a320-b430-47f4-bced-99f6d79e53fa admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:13.758170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e04da-b29c-4862-a230-ca4a803542a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:13.758827 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e04da-b29c-4862-a230-ca4a803542a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:13.759109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e04da-b29c-4862-a230-ca4a803542a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:13.759412 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e04da-b29c-4862-a230-ca4a803542a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:13.769157 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e04da-b29c-4862-a230-ca4a803542a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:13.770598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e04da-b29c-4862-a230-ca4a803542a4 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:13.785412 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1103/2218] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:02:14.188037 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d3089-c34e-4fc8-a29a-d7f163d8fa42 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:14.196419 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-649d3089-c34e-4fc8-a29a-d7f163d8fa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:14.213885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d3089-c34e-4fc8-a29a-d7f163d8fa42 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:14.221225 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b16456-b1fe-490d-b382-1228c799c9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:14.222088 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b16456-b1fe-490d-b382-1228c799c9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:14.222357 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b16456-b1fe-490d-b382-1228c799c9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:14.222642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b16456-b1fe-490d-b382-1228c799c9fa admin admin] PATH_INFO: `/v3/projects/339b183a249e4ebe91fa3245f5473a9e` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:14.223852 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b16456-b1fe-490d-b382-1228c799c9fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=339b183a249e4ebe91fa3245f5473a9e)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:14.226611 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b16456-b1fe-490d-b382-1228c799c9fa admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:14.358593 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-45b16456-b1fe-490d-b382-1228c799c9fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339b183a249e4ebe91fa3245f5473a9e', 'request_id': 'req-45b16456-b1fe-490d-b382-1228c799c9fa'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:14.364666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-45b16456-b1fe-490d-b382-1228c799c9fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339b183a249e4ebe91fa3245f5473a9e', 'request_id': 'req-45b16456-b1fe-490d-b382-1228c799c9fa'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:14.442678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-45b16456-b1fe-490d-b382-1228c799c9fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339b183a249e4ebe91fa3245f5473a9e', 'request_id': 'req-45b16456-b1fe-490d-b382-1228c799c9fa'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:14.454328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-45b16456-b1fe-490d-b382-1228c799c9fa admin admin] The token cache is being invalidate because project 339b183a249e4ebe91fa3245f5473a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:02:14.454622 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-45b16456-b1fe-490d-b382-1228c799c9fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:14.455268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-45b16456-b1fe-490d-b382-1228c799c9fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:14.456860 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1116/2219] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:02:14 2022] DELETE /identity/v3/projects/339b183a249e4ebe91fa3245f5473a9e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:14.463006 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a815-b41e-4cf9-9060-ece231cd3eac None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:14.463463 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a815-b41e-4cf9-9060-ece231cd3eac None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:14.463596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a815-b41e-4cf9-9060-ece231cd3eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:14.481623 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-8142a815-b41e-4cf9-9060-ece231cd3eac None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:14.482828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-8142a815-b41e-4cf9-9060-ece231cd3eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:14.541257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1104/2220] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:14.549235 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb71850-6de5-4004-a0b5-c96b6c8cda49 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:14.549522 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb71850-6de5-4004-a0b5-c96b6c8cda49 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:14.549803 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb71850-6de5-4004-a0b5-c96b6c8cda49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:14.568527 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-feb71850-6de5-4004-a0b5-c96b6c8cda49 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:14.569737 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-feb71850-6de5-4004-a0b5-c96b6c8cda49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:14.578432 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1117/2221] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:14.582777 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142a815-b41e-4cf9-9060-ece231cd3eac None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:14.592894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142a815-b41e-4cf9-9060-ece231cd3eac None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:14.597538 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee9d04-4b84-4cda-95ad-a6eb4ff0d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:14.598191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee9d04-4b84-4cda-95ad-a6eb4ff0d0be admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:14.598475 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee9d04-4b84-4cda-95ad-a6eb4ff0d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:14.598753 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee9d04-4b84-4cda-95ad-a6eb4ff0d0be admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:14.602563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee9d04-4b84-4cda-95ad-a6eb4ff0d0be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:02:14.602563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee9d04-4b84-4cda-95ad-a6eb4ff0d0be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:14.606669 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee9d04-4b84-4cda-95ad-a6eb4ff0d0be admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:14.618701 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1105/2222] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:02:14.623284 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb71850-6de5-4004-a0b5-c96b6c8cda49 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:14.633027 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb71850-6de5-4004-a0b5-c96b6c8cda49 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:14.637767 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d711de-9da8-48b1-881b-7cb6b3b04f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:14.638411 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d711de-9da8-48b1-881b-7cb6b3b04f50 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:14.638692 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d711de-9da8-48b1-881b-7cb6b3b04f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:14.638966 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d711de-9da8-48b1-881b-7cb6b3b04f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:14.639683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d711de-9da8-48b1-881b-7cb6b3b04f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:14.641579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d711de-9da8-48b1-881b-7cb6b3b04f50 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:14.781009 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1118/2223] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:02:14 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:14.785734 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee9d04-4b84-4cda-95ad-a6eb4ff0d0be admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:14.795287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee9d04-4b84-4cda-95ad-a6eb4ff0d0be admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:14.872291 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a6b7c-8dd2-4541-a359-f9314bfdae22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:14.873096 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a6b7c-8dd2-4541-a359-f9314bfdae22 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:14.873589 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a6b7c-8dd2-4541-a359-f9314bfdae22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:14.873929 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a6b7c-8dd2-4541-a359-f9314bfdae22 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:14.874751 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a6b7c-8dd2-4541-a359-f9314bfdae22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:14.876987 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a6b7c-8dd2-4541-a359-f9314bfdae22 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:14.963181 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1106/2224] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:02:14 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:02:14.967576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d711de-9da8-48b1-881b-7cb6b3b04f50 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:14.979195 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d711de-9da8-48b1-881b-7cb6b3b04f50 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:14.984112 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae8565-18ac-4300-8280-637ba275c424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:14.984877 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae8565-18ac-4300-8280-637ba275c424 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:14.985227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae8565-18ac-4300-8280-637ba275c424 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:14.985580 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae8565-18ac-4300-8280-637ba275c424 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:14.986385 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae8565-18ac-4300-8280-637ba275c424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:14.988037 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae8565-18ac-4300-8280-637ba275c424 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:14.999570 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1119/2225] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:02:15.003865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a6b7c-8dd2-4541-a359-f9314bfdae22 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:15.014484 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a6b7c-8dd2-4541-a359-f9314bfdae22 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:15.019130 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4450f61-7e6b-41f1-971e-27ebbeb476a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:15.019814 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4450f61-7e6b-41f1-971e-27ebbeb476a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:15.020098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4450f61-7e6b-41f1-971e-27ebbeb476a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:15.020369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4450f61-7e6b-41f1-971e-27ebbeb476a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:15.021188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4450f61-7e6b-41f1-971e-27ebbeb476a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:15.022793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4450f61-7e6b-41f1-971e-27ebbeb476a5 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:15.032900 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1107/2226] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:15.040132 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae8565-18ac-4300-8280-637ba275c424 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:15.050197 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae8565-18ac-4300-8280-637ba275c424 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:15.056013 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf7939-3418-4940-a04d-32e36b655e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:15.056898 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf7939-3418-4940-a04d-32e36b655e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:15.057181 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf7939-3418-4940-a04d-32e36b655e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:15.057460 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf7939-3418-4940-a04d-32e36b655e31 admin admin] PATH_INFO: `/v3/projects/1e3b02ffef16499f8e59905a9641bcef/users/fa99a27f6cb94850a9f2cbdf0c0ca353/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:15.074144 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf7939-3418-4940-a04d-32e36b655e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3b02ffef16499f8e59905a9641bcef, user_id=fa99a27f6cb94850a9f2cbdf0c0ca353, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:15.077087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf7939-3418-4940-a04d-32e36b655e31 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:15.141750 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1120/2227] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:15 2022] PUT /identity/v3/projects/1e3b02ffef16499f8e59905a9641bcef/users/fa99a27f6cb94850a9f2cbdf0c0ca353/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:15.152789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b021319-f121-4a2d-9d38-4703439a28ce None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:15.153080 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b021319-f121-4a2d-9d38-4703439a28ce None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:15.153370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b021319-f121-4a2d-9d38-4703439a28ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:15.182209 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-8b021319-f121-4a2d-9d38-4703439a28ce None None] MFA Rules not processed for user `fa99a27f6cb94850a9f2cbdf0c0ca353`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:15.183462 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-8b021319-f121-4a2d-9d38-4703439a28ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:15.195246 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf7939-3418-4940-a04d-32e36b655e31 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:15.197252 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a2bf7939-3418-4940-a04d-32e36b655e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:15.251376 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1108/2228] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:02:15.255169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf7939-3418-4940-a04d-32e36b655e31 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:15.259002 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160dfcf-6f5b-4150-aff7-4422117b6d2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:15.259687 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160dfcf-6f5b-4150-aff7-4422117b6d2c service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:15.259990 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160dfcf-6f5b-4150-aff7-4422117b6d2c service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:15.260252 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160dfcf-6f5b-4150-aff7-4422117b6d2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:15.262248 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c160dfcf-6f5b-4150-aff7-4422117b6d2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:15.262740 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b021319-f121-4a2d-9d38-4703439a28ce None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:15.264125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-8b021319-f121-4a2d-9d38-4703439a28ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:15.280057 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b021319-f121-4a2d-9d38-4703439a28ce None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:15.283910 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788554cd-2d01-404f-afce-26a1fe9e03ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:15.284550 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788554cd-2d01-404f-afce-26a1fe9e03ce service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:15.284834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788554cd-2d01-404f-afce-26a1fe9e03ce service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:15.285113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788554cd-2d01-404f-afce-26a1fe9e03ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:15.294476 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788554cd-2d01-404f-afce-26a1fe9e03ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:15.295983 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788554cd-2d01-404f-afce-26a1fe9e03ce service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:15.305377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1109/2229] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:02:15.329758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160dfcf-6f5b-4150-aff7-4422117b6d2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:15.331226 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160dfcf-6f5b-4150-aff7-4422117b6d2c service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:15.341074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1121/2230] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:02:16.955210 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d82ae-41a3-45f1-8dce-5b9f64adc0d8 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:16.955823 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d82ae-41a3-45f1-8dce-5b9f64adc0d8 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:16.955823 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d82ae-41a3-45f1-8dce-5b9f64adc0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:16.984465 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-984d82ae-41a3-45f1-8dce-5b9f64adc0d8 None None] MFA Rules not processed for user `fa99a27f6cb94850a9f2cbdf0c0ca353`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:16.985995 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-984d82ae-41a3-45f1-8dce-5b9f64adc0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:17.009157 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1110/2231] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:18.688683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160dfcf-6f5b-4150-aff7-4422117b6d2c service cinder] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:18.707018 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160dfcf-6f5b-4150-aff7-4422117b6d2c service cinder] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:18.711980 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f54533-6206-47a8-bdb9-fbca52de5240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:18.712630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f54533-6206-47a8-bdb9-fbca52de5240 service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:18.712913 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f54533-6206-47a8-bdb9-fbca52de5240 service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:18.713192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f54533-6206-47a8-bdb9-fbca52de5240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:18.715031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-39f54533-6206-47a8-bdb9-fbca52de5240 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:18.785805 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f54533-6206-47a8-bdb9-fbca52de5240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:18.787158 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f54533-6206-47a8-bdb9-fbca52de5240 service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:18.797257 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1122/2232] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:02:22.758798 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58a5b9-1daa-4b1d-a982-a5a927b972ef None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:22.759291 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58a5b9-1daa-4b1d-a982-a5a927b972ef None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:22.759378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58a5b9-1daa-4b1d-a982-a5a927b972ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:22.778149 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-eb58a5b9-1daa-4b1d-a982-a5a927b972ef None None] MFA Rules not processed for user `bda2f2412e6441c3a8c232f39c56fc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:22.779400 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-eb58a5b9-1daa-4b1d-a982-a5a927b972ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:22.838456 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1111/2233] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:24.719235 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f54533-6206-47a8-bdb9-fbca52de5240 service cinder] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:24.720891 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-39f54533-6206-47a8-bdb9-fbca52de5240 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:24.819339 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f54533-6206-47a8-bdb9-fbca52de5240 service cinder] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:24.825464 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df141e-acfb-46d8-b94c-caf24861a6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:24.826353 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df141e-acfb-46d8-b94c-caf24861a6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:24.826633 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df141e-acfb-46d8-b94c-caf24861a6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:24.826910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df141e-acfb-46d8-b94c-caf24861a6e0 admin admin] PATH_INFO: `/v3/users/ed5030da5363441caf35b6fb5619abc5` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:24.828136 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df141e-acfb-46d8-b94c-caf24861a6e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5030da5363441caf35b6fb5619abc5)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:24.830066 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df141e-acfb-46d8-b94c-caf24861a6e0 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:25.046547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-e4df141e-acfb-46d8-b94c-caf24861a6e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5030da5363441caf35b6fb5619abc5'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:25.047243 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-e4df141e-acfb-46d8-b94c-caf24861a6e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5030da5363441caf35b6fb5619abc5'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:25.054609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-e4df141e-acfb-46d8-b94c-caf24861a6e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5030da5363441caf35b6fb5619abc5'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:25.141811 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-e4df141e-acfb-46d8-b94c-caf24861a6e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5030da5363441caf35b6fb5619abc5'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:25.157128 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-e4df141e-acfb-46d8-b94c-caf24861a6e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5030da5363441caf35b6fb5619abc5'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:25.164810 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1123/2234] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:02:24 2022] DELETE /identity/v3/users/ed5030da5363441caf35b6fb5619abc5 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:25.169174 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8745d6-c697-4831-96c7-f637ea95568f None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:25.169655 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8745d6-c697-4831-96c7-f637ea95568f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:25.169754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8745d6-c697-4831-96c7-f637ea95568f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:25.204131 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-bc8745d6-c697-4831-96c7-f637ea95568f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:25.205517 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-bc8745d6-c697-4831-96c7-f637ea95568f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:25.273247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1112/2235] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:02:25.282551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df141e-acfb-46d8-b94c-caf24861a6e0 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:25.284004 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-e4df141e-acfb-46d8-b94c-caf24861a6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:25.370853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df141e-acfb-46d8-b94c-caf24861a6e0 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:25.374565 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e107a-fbbb-4323-91b4-ca661664b546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:25.375210 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e107a-fbbb-4323-91b4-ca661664b546 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:25.375489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e107a-fbbb-4323-91b4-ca661664b546 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:25.375798 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e107a-fbbb-4323-91b4-ca661664b546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:25.385374 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e107a-fbbb-4323-91b4-ca661664b546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:25.386817 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e107a-fbbb-4323-91b4-ca661664b546 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:25.396349 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1124/2236] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:02:25.869663 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8745d6-c697-4831-96c7-f637ea95568f None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:25.871091 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-bc8745d6-c697-4831-96c7-f637ea95568f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:25.884042 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8745d6-c697-4831-96c7-f637ea95568f None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:25.888906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4095092-9def-4072-9482-6c3dcf49e709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:25.891642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4095092-9def-4072-9482-6c3dcf49e709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:25.891642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4095092-9def-4072-9482-6c3dcf49e709 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:25.891642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4095092-9def-4072-9482-6c3dcf49e709 admin admin] PATH_INFO: `/v3/projects/e8d38b4cc69d4510a9c665b7619b27d9` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:25.891847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4095092-9def-4072-9482-6c3dcf49e709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8d38b4cc69d4510a9c665b7619b27d9)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:25.893704 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4095092-9def-4072-9482-6c3dcf49e709 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:26.020951 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f4095092-9def-4072-9482-6c3dcf49e709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8d38b4cc69d4510a9c665b7619b27d9', 'request_id': 'req-f4095092-9def-4072-9482-6c3dcf49e709'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:26.118349 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f4095092-9def-4072-9482-6c3dcf49e709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8d38b4cc69d4510a9c665b7619b27d9', 'request_id': 'req-f4095092-9def-4072-9482-6c3dcf49e709'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:26.124836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f4095092-9def-4072-9482-6c3dcf49e709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8d38b4cc69d4510a9c665b7619b27d9', 'request_id': 'req-f4095092-9def-4072-9482-6c3dcf49e709'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:26.135393 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f4095092-9def-4072-9482-6c3dcf49e709 admin admin] The token cache is being invalidate because project e8d38b4cc69d4510a9c665b7619b27d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:02:26.135713 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f4095092-9def-4072-9482-6c3dcf49e709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:26.140546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f4095092-9def-4072-9482-6c3dcf49e709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:26.140546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1113/2237] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:02:25 2022] DELETE /identity/v3/projects/e8d38b4cc69d4510a9c665b7619b27d9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:26.141892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e107a-fbbb-4323-91b4-ca661664b546 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:26.151354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e107a-fbbb-4323-91b4-ca661664b546 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:26.206775 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95779bdb-0967-4077-844a-352261a5a3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:26.207700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95779bdb-0967-4077-844a-352261a5a3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:26.207986 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95779bdb-0967-4077-844a-352261a5a3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:26.208271 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95779bdb-0967-4077-844a-352261a5a3f9 admin admin] PATH_INFO: `/v3/users/5a713a039ec84df48eebd98e35cd6fad` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:26.209473 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95779bdb-0967-4077-844a-352261a5a3f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a713a039ec84df48eebd98e35cd6fad)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:26.211874 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95779bdb-0967-4077-844a-352261a5a3f9 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:26.417346 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95779bdb-0967-4077-844a-352261a5a3f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a713a039ec84df48eebd98e35cd6fad'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:26.418005 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95779bdb-0967-4077-844a-352261a5a3f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a713a039ec84df48eebd98e35cd6fad'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:26.424630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95779bdb-0967-4077-844a-352261a5a3f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a713a039ec84df48eebd98e35cd6fad'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:26.504481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95779bdb-0967-4077-844a-352261a5a3f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a713a039ec84df48eebd98e35cd6fad'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:26.516534 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95779bdb-0967-4077-844a-352261a5a3f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a713a039ec84df48eebd98e35cd6fad'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:26.522484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1125/2238] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:02:26 2022] DELETE /identity/v3/users/5a713a039ec84df48eebd98e35cd6fad => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:26.923982 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4095092-9def-4072-9482-6c3dcf49e709 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:26.926651 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f4095092-9def-4072-9482-6c3dcf49e709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:26.954255 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4095092-9def-4072-9482-6c3dcf49e709 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:27.019561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7aa9b8-e261-4642-b0f7-ad1b3455ebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:27.019891 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7aa9b8-e261-4642-b0f7-ad1b3455ebe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:27.020172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7aa9b8-e261-4642-b0f7-ad1b3455ebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:27.020447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7aa9b8-e261-4642-b0f7-ad1b3455ebe5 admin admin] PATH_INFO: `/v3/projects/1c768e47171f48669471be0d98563acf` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:27.021686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7aa9b8-e261-4642-b0f7-ad1b3455ebe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c768e47171f48669471be0d98563acf)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:27.024260 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7aa9b8-e261-4642-b0f7-ad1b3455ebe5 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:27.132559 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-cf7aa9b8-e261-4642-b0f7-ad1b3455ebe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c768e47171f48669471be0d98563acf', 'request_id': 'req-cf7aa9b8-e261-4642-b0f7-ad1b3455ebe5'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:27.213528 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-cf7aa9b8-e261-4642-b0f7-ad1b3455ebe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c768e47171f48669471be0d98563acf', 'request_id': 'req-cf7aa9b8-e261-4642-b0f7-ad1b3455ebe5'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:27.222942 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-cf7aa9b8-e261-4642-b0f7-ad1b3455ebe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c768e47171f48669471be0d98563acf', 'request_id': 'req-cf7aa9b8-e261-4642-b0f7-ad1b3455ebe5'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:27.231922 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-cf7aa9b8-e261-4642-b0f7-ad1b3455ebe5 admin admin] The token cache is being invalidate because project 1c768e47171f48669471be0d98563acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:02:27.232208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-cf7aa9b8-e261-4642-b0f7-ad1b3455ebe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:27.232850 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-cf7aa9b8-e261-4642-b0f7-ad1b3455ebe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:27.234482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1114/2239] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:02:26 2022] DELETE /identity/v3/projects/1c768e47171f48669471be0d98563acf => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:27.240388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eec514-42ee-42ee-bd3f-5c256868dcbd None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:27.240841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eec514-42ee-42ee-bd3f-5c256868dcbd None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:27.240929 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eec514-42ee-42ee-bd3f-5c256868dcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:27.279247 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-00eec514-42ee-42ee-bd3f-5c256868dcbd None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:27.280579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-00eec514-42ee-42ee-bd3f-5c256868dcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:27.338383 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1126/2240] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:27.347473 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691926d-d041-472a-b45c-add28189d871 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:27.347788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691926d-d041-472a-b45c-add28189d871 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:27.350348 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691926d-d041-472a-b45c-add28189d871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:27.367297 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-1691926d-d041-472a-b45c-add28189d871 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:27.368673 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1691926d-d041-472a-b45c-add28189d871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:27.379618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1115/2241] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:27.380873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eec514-42ee-42ee-bd3f-5c256868dcbd None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:27.391240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eec514-42ee-42ee-bd3f-5c256868dcbd None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:27.395845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd2b88-27af-4873-b9de-8f1ce160d610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:27.396503 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd2b88-27af-4873-b9de-8f1ce160d610 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:27.396793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd2b88-27af-4873-b9de-8f1ce160d610 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:27.397068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd2b88-27af-4873-b9de-8f1ce160d610 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:27.397792 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd2b88-27af-4873-b9de-8f1ce160d610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:02:27.398100 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd2b88-27af-4873-b9de-8f1ce160d610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:27.400485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd2b88-27af-4873-b9de-8f1ce160d610 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:27.412014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1127/2242] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:02:27.416783 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691926d-d041-472a-b45c-add28189d871 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:27.425854 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691926d-d041-472a-b45c-add28189d871 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:27.430533 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3685cf8-1c5b-47d7-8d87-dd0312a262cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:27.431317 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3685cf8-1c5b-47d7-8d87-dd0312a262cf admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:27.431632 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3685cf8-1c5b-47d7-8d87-dd0312a262cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:27.431905 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3685cf8-1c5b-47d7-8d87-dd0312a262cf admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:27.432590 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3685cf8-1c5b-47d7-8d87-dd0312a262cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:27.434484 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3685cf8-1c5b-47d7-8d87-dd0312a262cf admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:27.507704 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1116/2243] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:02:27 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:27.512819 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd2b88-27af-4873-b9de-8f1ce160d610 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:27.522717 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd2b88-27af-4873-b9de-8f1ce160d610 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:27.575688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec56d56-1af9-4e55-b4e3-130f1e1849cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:27.576343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56d56-1af9-4e55-b4e3-130f1e1849cf admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:27.576621 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56d56-1af9-4e55-b4e3-130f1e1849cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:27.576894 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56d56-1af9-4e55-b4e3-130f1e1849cf admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:27.577576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec56d56-1af9-4e55-b4e3-130f1e1849cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:27.579476 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec56d56-1af9-4e55-b4e3-130f1e1849cf admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:27.655332 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1128/2244] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:02:27 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:27.659528 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3685cf8-1c5b-47d7-8d87-dd0312a262cf admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:27.669787 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3685cf8-1c5b-47d7-8d87-dd0312a262cf admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:27.674386 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd826c15-b46e-4376-929b-2f927675f184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:27.675042 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd826c15-b46e-4376-929b-2f927675f184 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:27.675325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd826c15-b46e-4376-929b-2f927675f184 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:27.675634 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd826c15-b46e-4376-929b-2f927675f184 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:27.676354 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd826c15-b46e-4376-929b-2f927675f184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:27.677976 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd826c15-b46e-4376-929b-2f927675f184 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:27.688544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1117/2245] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:27.692670 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec56d56-1af9-4e55-b4e3-130f1e1849cf admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:27.703095 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec56d56-1af9-4e55-b4e3-130f1e1849cf admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:27.707973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a77c4-b56d-423b-b21a-19e325bd8473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:27.708625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a77c4-b56d-423b-b21a-19e325bd8473 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:27.708909 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a77c4-b56d-423b-b21a-19e325bd8473 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:27.709193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a77c4-b56d-423b-b21a-19e325bd8473 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:27.709903 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a77c4-b56d-423b-b21a-19e325bd8473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:27.711690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a77c4-b56d-423b-b21a-19e325bd8473 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:27.721277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1129/2246] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:27.725135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd826c15-b46e-4376-929b-2f927675f184 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:27.735065 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd826c15-b46e-4376-929b-2f927675f184 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:27.739641 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee2fff-1a23-45b2-8e54-88654c4d362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:27.740513 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee2fff-1a23-45b2-8e54-88654c4d362c admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:27.740795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee2fff-1a23-45b2-8e54-88654c4d362c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:27.741071 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee2fff-1a23-45b2-8e54-88654c4d362c admin admin] PATH_INFO: `/v3/projects/3057b5497c1e489da07689e3b414c18c/users/7f29ec7f7a644ae7be8b141168841a1c/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:27.755334 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee2fff-1a23-45b2-8e54-88654c4d362c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3057b5497c1e489da07689e3b414c18c, user_id=7f29ec7f7a644ae7be8b141168841a1c, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:27.758028 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee2fff-1a23-45b2-8e54-88654c4d362c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:27.873397 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1118/2247] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:27 2022] PUT /identity/v3/projects/3057b5497c1e489da07689e3b414c18c/users/7f29ec7f7a644ae7be8b141168841a1c/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:02:27.891274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f4df7-202f-4701-8b8a-70eca23789cf None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:27.891601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f4df7-202f-4701-8b8a-70eca23789cf None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:27.891887 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f4df7-202f-4701-8b8a-70eca23789cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:27.919234 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-3e6f4df7-202f-4701-8b8a-70eca23789cf None None] MFA Rules not processed for user `7f29ec7f7a644ae7be8b141168841a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:27.920406 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3e6f4df7-202f-4701-8b8a-70eca23789cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:27.993638 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1130/2248] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:28.005203 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee2fff-1a23-45b2-8e54-88654c4d362c admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:28.006918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b6ee2fff-1a23-45b2-8e54-88654c4d362c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:28.066573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee2fff-1a23-45b2-8e54-88654c4d362c admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:28.071072 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7238ad-a695-4eb6-8ee0-652100905ef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:28.072039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7238ad-a695-4eb6-8ee0-652100905ef1 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:28.072626 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7238ad-a695-4eb6-8ee0-652100905ef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:28.072840 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7238ad-a695-4eb6-8ee0-652100905ef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:28.082096 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7238ad-a695-4eb6-8ee0-652100905ef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:28.083624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7238ad-a695-4eb6-8ee0-652100905ef1 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:28.093209 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1119/2249] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:02:29.909846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7f451-dd48-48d5-85fe-33ae3ccd8d79 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:29.910384 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7f451-dd48-48d5-85fe-33ae3ccd8d79 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:29.910579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7f451-dd48-48d5-85fe-33ae3ccd8d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:29.935378 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-6ae7f451-dd48-48d5-85fe-33ae3ccd8d79 None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:29.936715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-6ae7f451-dd48-48d5-85fe-33ae3ccd8d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:30.021488 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1131/2250] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 12:02:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:30.081355 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7238ad-a695-4eb6-8ee0-652100905ef1 service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:30.083492 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-fd7238ad-a695-4eb6-8ee0-652100905ef1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:30.160400 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7238ad-a695-4eb6-8ee0-652100905ef1 service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:30.165970 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fe5ce-d9f0-4384-8d5c-2e184a7d23e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:30.168473 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fe5ce-d9f0-4384-8d5c-2e184a7d23e6 service swift] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:30.168805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fe5ce-d9f0-4384-8d5c-2e184a7d23e6 service swift] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:30.169237 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fe5ce-d9f0-4384-8d5c-2e184a7d23e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:30.178386 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344fe5ce-d9f0-4384-8d5c-2e184a7d23e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:30.180044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344fe5ce-d9f0-4384-8d5c-2e184a7d23e6 service swift] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:30.193373 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1120/2251] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:02:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 12:02:31.844292 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7f451-dd48-48d5-85fe-33ae3ccd8d79 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:32.056462 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7f451-dd48-48d5-85fe-33ae3ccd8d79 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:32.080691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e36517-e228-4a26-9bf1-bdb83cb2ae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:32.080691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e36517-e228-4a26-9bf1-bdb83cb2ae82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:32.080691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e36517-e228-4a26-9bf1-bdb83cb2ae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:32.080691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e36517-e228-4a26-9bf1-bdb83cb2ae82 admin admin] PATH_INFO: `/v3/users/7f29ec7f7a644ae7be8b141168841a1c` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:32.088569 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e36517-e228-4a26-9bf1-bdb83cb2ae82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f29ec7f7a644ae7be8b141168841a1c)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:32.092111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e36517-e228-4a26-9bf1-bdb83cb2ae82 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:32.275513 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-29e36517-e228-4a26-9bf1-bdb83cb2ae82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f29ec7f7a644ae7be8b141168841a1c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:32.276514 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-29e36517-e228-4a26-9bf1-bdb83cb2ae82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f29ec7f7a644ae7be8b141168841a1c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:32.297662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-29e36517-e228-4a26-9bf1-bdb83cb2ae82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f29ec7f7a644ae7be8b141168841a1c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:32.364936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-29e36517-e228-4a26-9bf1-bdb83cb2ae82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f29ec7f7a644ae7be8b141168841a1c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:32.380156 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-29e36517-e228-4a26-9bf1-bdb83cb2ae82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f29ec7f7a644ae7be8b141168841a1c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:32.391598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1132/2252] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:02:31 2022] DELETE /identity/v3/users/7f29ec7f7a644ae7be8b141168841a1c => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:32.393402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08203ba5-cd4b-4a9e-ba61-cad4373ddcce None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:32.393938 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08203ba5-cd4b-4a9e-ba61-cad4373ddcce None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:32.394112 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08203ba5-cd4b-4a9e-ba61-cad4373ddcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:32.429418 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-08203ba5-cd4b-4a9e-ba61-cad4373ddcce None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:32.431348 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-08203ba5-cd4b-4a9e-ba61-cad4373ddcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:32.557743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1121/2253] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:32.583578 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e36517-e228-4a26-9bf1-bdb83cb2ae82 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:32.585325 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-29e36517-e228-4a26-9bf1-bdb83cb2ae82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:32.734480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e36517-e228-4a26-9bf1-bdb83cb2ae82 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:32.738658 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228eab6c-be3c-4988-94b6-7949d9ec51c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:32.739692 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228eab6c-be3c-4988-94b6-7949d9ec51c7 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:32.740231 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228eab6c-be3c-4988-94b6-7949d9ec51c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:32.740791 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228eab6c-be3c-4988-94b6-7949d9ec51c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:32.752500 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228eab6c-be3c-4988-94b6-7949d9ec51c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:32.754301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228eab6c-be3c-4988-94b6-7949d9ec51c7 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:32.765762 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1133/2254] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:02:33.200936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08203ba5-cd4b-4a9e-ba61-cad4373ddcce None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:33.200936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-08203ba5-cd4b-4a9e-ba61-cad4373ddcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:33.242183 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08203ba5-cd4b-4a9e-ba61-cad4373ddcce None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:33.249284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46175a5e-5143-4b5e-911a-925dd9b48b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:33.250818 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46175a5e-5143-4b5e-911a-925dd9b48b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:33.251354 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46175a5e-5143-4b5e-911a-925dd9b48b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:33.251954 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46175a5e-5143-4b5e-911a-925dd9b48b81 admin admin] PATH_INFO: `/v3/projects/3057b5497c1e489da07689e3b414c18c` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:33.254311 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46175a5e-5143-4b5e-911a-925dd9b48b81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3057b5497c1e489da07689e3b414c18c)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:33.257828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46175a5e-5143-4b5e-911a-925dd9b48b81 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:33.428723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-46175a5e-5143-4b5e-911a-925dd9b48b81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3057b5497c1e489da07689e3b414c18c', 'request_id': 'req-46175a5e-5143-4b5e-911a-925dd9b48b81'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:33.507225 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-46175a5e-5143-4b5e-911a-925dd9b48b81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3057b5497c1e489da07689e3b414c18c', 'request_id': 'req-46175a5e-5143-4b5e-911a-925dd9b48b81'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:33.514189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-46175a5e-5143-4b5e-911a-925dd9b48b81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3057b5497c1e489da07689e3b414c18c', 'request_id': 'req-46175a5e-5143-4b5e-911a-925dd9b48b81'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:33.524536 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-46175a5e-5143-4b5e-911a-925dd9b48b81 admin admin] The token cache is being invalidate because project 3057b5497c1e489da07689e3b414c18c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:02:33.525324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-46175a5e-5143-4b5e-911a-925dd9b48b81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:33.525966 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-46175a5e-5143-4b5e-911a-925dd9b48b81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:33.527490 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1122/2255] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:02:33 2022] DELETE /identity/v3/projects/3057b5497c1e489da07689e3b414c18c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:33.532274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee535bdb-2e39-43d5-ae8b-0f6ebe73faf8 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:33.532764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee535bdb-2e39-43d5-ae8b-0f6ebe73faf8 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:33.532866 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee535bdb-2e39-43d5-ae8b-0f6ebe73faf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:33.552215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-ee535bdb-2e39-43d5-ae8b-0f6ebe73faf8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:33.553486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-ee535bdb-2e39-43d5-ae8b-0f6ebe73faf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:33.655589 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1134/2256] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:33.661795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4b9b1-2944-4982-8342-aad966a7f071 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:33.662204 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4b9b1-2944-4982-8342-aad966a7f071 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:33.662372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4b9b1-2944-4982-8342-aad966a7f071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:33.700503 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-2fe4b9b1-2944-4982-8342-aad966a7f071 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:33.701800 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-2fe4b9b1-2944-4982-8342-aad966a7f071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:33.729125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1123/2257] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:33.733484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee535bdb-2e39-43d5-ae8b-0f6ebe73faf8 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:33.767979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee535bdb-2e39-43d5-ae8b-0f6ebe73faf8 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:33.774514 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae300a4-1326-4d9e-9b42-75ccf0562bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:33.778448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae300a4-1326-4d9e-9b42-75ccf0562bbe admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:33.778448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae300a4-1326-4d9e-9b42-75ccf0562bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:33.778448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae300a4-1326-4d9e-9b42-75ccf0562bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:33.778448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae300a4-1326-4d9e-9b42-75ccf0562bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:02:33.778979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae300a4-1326-4d9e-9b42-75ccf0562bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:33.781085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae300a4-1326-4d9e-9b42-75ccf0562bbe admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:33.808361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1135/2258] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:02:33.812857 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4b9b1-2944-4982-8342-aad966a7f071 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:33.822945 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4b9b1-2944-4982-8342-aad966a7f071 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:33.828563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263e7c4-d1d6-42b3-a185-e36f02a0289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:33.829245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263e7c4-d1d6-42b3-a185-e36f02a0289f admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:33.829592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263e7c4-d1d6-42b3-a185-e36f02a0289f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:33.829898 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263e7c4-d1d6-42b3-a185-e36f02a0289f admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:33.830707 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263e7c4-d1d6-42b3-a185-e36f02a0289f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:33.832640 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263e7c4-d1d6-42b3-a185-e36f02a0289f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:33.986285 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1124/2259] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:02:33 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:02:33.990236 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae300a4-1326-4d9e-9b42-75ccf0562bbe admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:34.009560 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae300a4-1326-4d9e-9b42-75ccf0562bbe admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:34.092864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d9b43-4235-4852-baca-7b45ef5c2171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:34.093602 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d9b43-4235-4852-baca-7b45ef5c2171 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:34.093892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d9b43-4235-4852-baca-7b45ef5c2171 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:34.094173 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d9b43-4235-4852-baca-7b45ef5c2171 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:34.094984 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d9b43-4235-4852-baca-7b45ef5c2171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:34.096959 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d9b43-4235-4852-baca-7b45ef5c2171 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:34.187712 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1136/2260] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:02:33 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:02:34.193754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263e7c4-d1d6-42b3-a185-e36f02a0289f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:34.219009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263e7c4-d1d6-42b3-a185-e36f02a0289f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:34.237992 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9415b55-a721-4347-a7fd-68d88fe8a3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:34.238693 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9415b55-a721-4347-a7fd-68d88fe8a3ba admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:34.239076 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9415b55-a721-4347-a7fd-68d88fe8a3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:34.239481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9415b55-a721-4347-a7fd-68d88fe8a3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:34.240942 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9415b55-a721-4347-a7fd-68d88fe8a3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:34.244044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9415b55-a721-4347-a7fd-68d88fe8a3ba admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:34.263346 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1125/2261] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:34.267179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d9b43-4235-4852-baca-7b45ef5c2171 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:34.281724 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d9b43-4235-4852-baca-7b45ef5c2171 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:34.286460 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff6162-b02e-40cb-aece-0a8c4e2ad9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:34.287779 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff6162-b02e-40cb-aece-0a8c4e2ad9fc admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:34.288872 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff6162-b02e-40cb-aece-0a8c4e2ad9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:34.289954 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff6162-b02e-40cb-aece-0a8c4e2ad9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:34.292617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff6162-b02e-40cb-aece-0a8c4e2ad9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:34.295297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff6162-b02e-40cb-aece-0a8c4e2ad9fc admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:34.307820 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1137/2262] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:02:34.311974 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9415b55-a721-4347-a7fd-68d88fe8a3ba admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:34.322795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9415b55-a721-4347-a7fd-68d88fe8a3ba admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:34.329698 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f246a-7d86-4792-827a-555e0dd19a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:34.333083 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f246a-7d86-4792-827a-555e0dd19a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:34.333083 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f246a-7d86-4792-827a-555e0dd19a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:34.333083 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f246a-7d86-4792-827a-555e0dd19a88 admin admin] PATH_INFO: `/v3/projects/1a8be6b6b7fb4b3784aa3132d66304c4/users/b17506605892471e862c31f6fdcb0a75/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:34.372422 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f246a-7d86-4792-827a-555e0dd19a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8be6b6b7fb4b3784aa3132d66304c4, user_id=b17506605892471e862c31f6fdcb0a75, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:34.375986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f246a-7d86-4792-827a-555e0dd19a88 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:34.482281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1126/2263] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:34 2022] PUT /identity/v3/projects/1a8be6b6b7fb4b3784aa3132d66304c4/users/b17506605892471e862c31f6fdcb0a75/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:34.498235 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812202a-9da4-4311-8c7f-db00e804877b None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:34.498540 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812202a-9da4-4311-8c7f-db00e804877b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:34.498903 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812202a-9da4-4311-8c7f-db00e804877b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:34.558869 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-8812202a-9da4-4311-8c7f-db00e804877b None None] MFA Rules not processed for user `b17506605892471e862c31f6fdcb0a75`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:34.562568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-8812202a-9da4-4311-8c7f-db00e804877b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:34.677764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1138/2264] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:34.725179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f246a-7d86-4792-827a-555e0dd19a88 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:34.727393 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-fa5f246a-7d86-4792-827a-555e0dd19a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:34.842808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f246a-7d86-4792-827a-555e0dd19a88 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:34.847087 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d185b-bdb0-414a-9879-8a5d7ca11980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:34.847929 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d185b-bdb0-414a-9879-8a5d7ca11980 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:34.848303 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d185b-bdb0-414a-9879-8a5d7ca11980 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:34.848657 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d185b-bdb0-414a-9879-8a5d7ca11980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:34.859380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d185b-bdb0-414a-9879-8a5d7ca11980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:34.861604 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d185b-bdb0-414a-9879-8a5d7ca11980 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:34.883903 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1127/2265] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:02:34.900659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812202a-9da4-4311-8c7f-db00e804877b None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:34.969929 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812202a-9da4-4311-8c7f-db00e804877b None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:34.974756 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04d423-158b-4a72-a329-fd1ad1c212d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:34.975664 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04d423-158b-4a72-a329-fd1ad1c212d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:34.975992 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04d423-158b-4a72-a329-fd1ad1c212d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:34.976207 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04d423-158b-4a72-a329-fd1ad1c212d8 admin admin] PATH_INFO: `/v3/users/b17506605892471e862c31f6fdcb0a75` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:34.977392 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04d423-158b-4a72-a329-fd1ad1c212d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b17506605892471e862c31f6fdcb0a75)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:34.979498 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04d423-158b-4a72-a329-fd1ad1c212d8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:35.195926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6c04d423-158b-4a72-a329-fd1ad1c212d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b17506605892471e862c31f6fdcb0a75'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:35.197789 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6c04d423-158b-4a72-a329-fd1ad1c212d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b17506605892471e862c31f6fdcb0a75'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:35.205495 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6c04d423-158b-4a72-a329-fd1ad1c212d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b17506605892471e862c31f6fdcb0a75'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:35.267786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6c04d423-158b-4a72-a329-fd1ad1c212d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b17506605892471e862c31f6fdcb0a75'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:35.282731 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6c04d423-158b-4a72-a329-fd1ad1c212d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b17506605892471e862c31f6fdcb0a75'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:35.291325 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1139/2266] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:02:34 2022] DELETE /identity/v3/users/b17506605892471e862c31f6fdcb0a75 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:02:35.296227 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc56d0-edc0-4176-88fa-cddbba621625 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:35.296452 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc56d0-edc0-4176-88fa-cddbba621625 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:35.296936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc56d0-edc0-4176-88fa-cddbba621625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:35.326968 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-0ecc56d0-edc0-4176-88fa-cddbba621625 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:35.329229 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0ecc56d0-edc0-4176-88fa-cddbba621625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:35.419036 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1128/2267] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:02:35.431342 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04d423-158b-4a72-a329-fd1ad1c212d8 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:35.434621 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-6c04d423-158b-4a72-a329-fd1ad1c212d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:35.507268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04d423-158b-4a72-a329-fd1ad1c212d8 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:35.514394 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830074dc-29c7-42d6-8e61-d75a18380ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:35.515208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830074dc-29c7-42d6-8e61-d75a18380ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:35.515483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830074dc-29c7-42d6-8e61-d75a18380ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:35.515811 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830074dc-29c7-42d6-8e61-d75a18380ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:35.528514 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830074dc-29c7-42d6-8e61-d75a18380ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:35.531623 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830074dc-29c7-42d6-8e61-d75a18380ce9 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:35.547406 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1140/2268] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:02:36.098049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc56d0-edc0-4176-88fa-cddbba621625 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:36.102999 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0ecc56d0-edc0-4176-88fa-cddbba621625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:36.131798 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc56d0-edc0-4176-88fa-cddbba621625 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:36.146446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea87674-239f-424f-aa8a-30f85e597f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:36.149769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea87674-239f-424f-aa8a-30f85e597f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:36.151855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea87674-239f-424f-aa8a-30f85e597f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:36.153108 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea87674-239f-424f-aa8a-30f85e597f37 admin admin] PATH_INFO: `/v3/projects/1a8be6b6b7fb4b3784aa3132d66304c4` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:36.156595 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea87674-239f-424f-aa8a-30f85e597f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8be6b6b7fb4b3784aa3132d66304c4)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:36.160021 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea87674-239f-424f-aa8a-30f85e597f37 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:36.391703 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dea87674-239f-424f-aa8a-30f85e597f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8be6b6b7fb4b3784aa3132d66304c4', 'request_id': 'req-dea87674-239f-424f-aa8a-30f85e597f37'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:36.505679 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dea87674-239f-424f-aa8a-30f85e597f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8be6b6b7fb4b3784aa3132d66304c4', 'request_id': 'req-dea87674-239f-424f-aa8a-30f85e597f37'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:36.515994 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dea87674-239f-424f-aa8a-30f85e597f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8be6b6b7fb4b3784aa3132d66304c4', 'request_id': 'req-dea87674-239f-424f-aa8a-30f85e597f37'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:36.546649 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dea87674-239f-424f-aa8a-30f85e597f37 admin admin] The token cache is being invalidate because project 1a8be6b6b7fb4b3784aa3132d66304c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:02:36.547010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dea87674-239f-424f-aa8a-30f85e597f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:36.549750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dea87674-239f-424f-aa8a-30f85e597f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:36.552850 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1129/2269] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:02:36 2022] DELETE /identity/v3/projects/1a8be6b6b7fb4b3784aa3132d66304c4 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:36.559316 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22be6f-c3d3-4f87-9e23-275a8d5f7275 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:36.559892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22be6f-c3d3-4f87-9e23-275a8d5f7275 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:36.560046 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22be6f-c3d3-4f87-9e23-275a8d5f7275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:36.595609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-9f22be6f-c3d3-4f87-9e23-275a8d5f7275 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:36.601258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-9f22be6f-c3d3-4f87-9e23-275a8d5f7275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:36.773864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1141/2270] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:36.781755 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda59f1-da2b-4c3f-9759-57c99c8d97fa None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:36.782482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda59f1-da2b-4c3f-9759-57c99c8d97fa None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:36.782989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda59f1-da2b-4c3f-9759-57c99c8d97fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:36.808140 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-abda59f1-da2b-4c3f-9759-57c99c8d97fa None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:36.809935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-abda59f1-da2b-4c3f-9759-57c99c8d97fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:36.825051 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1130/2271] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:36.826399 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22be6f-c3d3-4f87-9e23-275a8d5f7275 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:36.839771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22be6f-c3d3-4f87-9e23-275a8d5f7275 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:36.862099 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dab49-35c3-4aa8-b61f-ba22df220e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:36.862780 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dab49-35c3-4aa8-b61f-ba22df220e70 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:36.863246 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dab49-35c3-4aa8-b61f-ba22df220e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:36.863714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dab49-35c3-4aa8-b61f-ba22df220e70 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:36.864597 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dab49-35c3-4aa8-b61f-ba22df220e70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:02:36.865082 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dab49-35c3-4aa8-b61f-ba22df220e70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:36.866827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dab49-35c3-4aa8-b61f-ba22df220e70 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:36.889809 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1142/2272] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:02:36.895958 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda59f1-da2b-4c3f-9759-57c99c8d97fa None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:36.906832 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda59f1-da2b-4c3f-9759-57c99c8d97fa None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:36.913126 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432a80b-e884-438a-aad5-92dc669bf257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:36.913817 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432a80b-e884-438a-aad5-92dc669bf257 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:36.914366 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432a80b-e884-438a-aad5-92dc669bf257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:36.914648 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432a80b-e884-438a-aad5-92dc669bf257 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:36.915360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432a80b-e884-438a-aad5-92dc669bf257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:36.918574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432a80b-e884-438a-aad5-92dc669bf257 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:37.057482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1131/2273] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:02:36 2022] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:37.061686 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dab49-35c3-4aa8-b61f-ba22df220e70 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:37.073304 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dab49-35c3-4aa8-b61f-ba22df220e70 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:37.156806 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d25acc-29d4-4f09-a86e-02833d567928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:37.157418 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d25acc-29d4-4f09-a86e-02833d567928 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:37.157678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d25acc-29d4-4f09-a86e-02833d567928 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:37.158391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d25acc-29d4-4f09-a86e-02833d567928 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:37.159102 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d25acc-29d4-4f09-a86e-02833d567928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:37.161373 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d25acc-29d4-4f09-a86e-02833d567928 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:37.282896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1143/2274] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:02:37 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:37.287694 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432a80b-e884-438a-aad5-92dc669bf257 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:37.302676 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432a80b-e884-438a-aad5-92dc669bf257 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:37.321108 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00509ebc-8d41-44b0-a198-53b419c1c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:37.321817 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00509ebc-8d41-44b0-a198-53b419c1c47b admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:37.322154 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00509ebc-8d41-44b0-a198-53b419c1c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:37.322462 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00509ebc-8d41-44b0-a198-53b419c1c47b admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:37.323356 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00509ebc-8d41-44b0-a198-53b419c1c47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:37.334439 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00509ebc-8d41-44b0-a198-53b419c1c47b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:37.352132 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1132/2275] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:37.353750 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d25acc-29d4-4f09-a86e-02833d567928 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:37.392276 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d25acc-29d4-4f09-a86e-02833d567928 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:37.416285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f0061-d266-4c04-8bb4-c05dc3b2fb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:37.417849 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f0061-d266-4c04-8bb4-c05dc3b2fb47 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:37.418408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f0061-d266-4c04-8bb4-c05dc3b2fb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:37.418988 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f0061-d266-4c04-8bb4-c05dc3b2fb47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:37.424343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f0061-d266-4c04-8bb4-c05dc3b2fb47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:37.432524 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f0061-d266-4c04-8bb4-c05dc3b2fb47 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:37.456900 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1144/2276] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:37.458118 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00509ebc-8d41-44b0-a198-53b419c1c47b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:37.470715 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00509ebc-8d41-44b0-a198-53b419c1c47b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:37.486878 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749387fe-91be-4658-8712-bc282d231ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:37.487830 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749387fe-91be-4658-8712-bc282d231ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:37.488112 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749387fe-91be-4658-8712-bc282d231ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:37.488398 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749387fe-91be-4658-8712-bc282d231ba1 admin admin] PATH_INFO: `/v3/projects/2b4c572d2825408f93a7e5fbba463627/users/88b3173f84834cbb99b92cba4d3d7df1/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:37.526496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749387fe-91be-4658-8712-bc282d231ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4c572d2825408f93a7e5fbba463627, user_id=88b3173f84834cbb99b92cba4d3d7df1, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:37.529765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749387fe-91be-4658-8712-bc282d231ba1 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:37.649976 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1133/2277] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:37 2022] PUT /identity/v3/projects/2b4c572d2825408f93a7e5fbba463627/users/88b3173f84834cbb99b92cba4d3d7df1/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:37.652625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bdb4f-89d9-449c-9ab0-9ace2251e9da None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:37.653100 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bdb4f-89d9-449c-9ab0-9ace2251e9da None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:37.653530 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bdb4f-89d9-449c-9ab0-9ace2251e9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:37.753210 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-8a4bdb4f-89d9-449c-9ab0-9ace2251e9da None None] MFA Rules not processed for user `88b3173f84834cbb99b92cba4d3d7df1`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:37.754836 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-8a4bdb4f-89d9-449c-9ab0-9ace2251e9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:37.954614 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1145/2278] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:02:37.967010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749387fe-91be-4658-8712-bc282d231ba1 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:37.969104 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-749387fe-91be-4658-8712-bc282d231ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:38.058647 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749387fe-91be-4658-8712-bc282d231ba1 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:38.064509 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a81d76-20df-43ea-8a8a-b35c08fad414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:38.065432 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a81d76-20df-43ea-8a8a-b35c08fad414 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:38.065887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a81d76-20df-43ea-8a8a-b35c08fad414 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:38.066373 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a81d76-20df-43ea-8a8a-b35c08fad414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:38.085159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a81d76-20df-43ea-8a8a-b35c08fad414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:38.087258 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a81d76-20df-43ea-8a8a-b35c08fad414 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:38.101973 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1134/2279] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:02:38.371336 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bdb4f-89d9-449c-9ab0-9ace2251e9da None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:38.372592 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-8a4bdb4f-89d9-449c-9ab0-9ace2251e9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:38.507161 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bdb4f-89d9-449c-9ab0-9ace2251e9da None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:38.516562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bcfb9-388e-4dd5-b0da-857971726a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:38.517698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bcfb9-388e-4dd5-b0da-857971726a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:38.517932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bcfb9-388e-4dd5-b0da-857971726a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:38.518215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bcfb9-388e-4dd5-b0da-857971726a4d admin admin] PATH_INFO: `/v3/users/30962247dd4046b3800f3136fbc8345c` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:38.520117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bcfb9-388e-4dd5-b0da-857971726a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=30962247dd4046b3800f3136fbc8345c)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:38.523182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bcfb9-388e-4dd5-b0da-857971726a4d admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:38.769901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-773bcfb9-388e-4dd5-b0da-857971726a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30962247dd4046b3800f3136fbc8345c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:38.778786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-773bcfb9-388e-4dd5-b0da-857971726a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30962247dd4046b3800f3136fbc8345c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:38.791353 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-773bcfb9-388e-4dd5-b0da-857971726a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30962247dd4046b3800f3136fbc8345c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:38.906627 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-773bcfb9-388e-4dd5-b0da-857971726a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30962247dd4046b3800f3136fbc8345c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:38.920596 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-773bcfb9-388e-4dd5-b0da-857971726a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30962247dd4046b3800f3136fbc8345c'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:38.927166 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1146/2280] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:02:38 2022] DELETE /identity/v3/users/30962247dd4046b3800f3136fbc8345c => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:39.490194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a81d76-20df-43ea-8a8a-b35c08fad414 service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:39.513527 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a81d76-20df-43ea-8a8a-b35c08fad414 service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:39.626803 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af705e1-100d-4de8-94d3-f2844c063907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:39.627721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af705e1-100d-4de8-94d3-f2844c063907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:39.628010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af705e1-100d-4de8-94d3-f2844c063907 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:39.628287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af705e1-100d-4de8-94d3-f2844c063907 admin admin] PATH_INFO: `/v3/projects/e899511298394a11804d28b25d0a925c` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:39.632320 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af705e1-100d-4de8-94d3-f2844c063907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e899511298394a11804d28b25d0a925c)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:39.635387 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af705e1-100d-4de8-94d3-f2844c063907 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:39.796442 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2af705e1-100d-4de8-94d3-f2844c063907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e899511298394a11804d28b25d0a925c', 'request_id': 'req-2af705e1-100d-4de8-94d3-f2844c063907'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:39.857333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2af705e1-100d-4de8-94d3-f2844c063907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e899511298394a11804d28b25d0a925c', 'request_id': 'req-2af705e1-100d-4de8-94d3-f2844c063907'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:39.866445 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2af705e1-100d-4de8-94d3-f2844c063907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e899511298394a11804d28b25d0a925c', 'request_id': 'req-2af705e1-100d-4de8-94d3-f2844c063907'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:39.878257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2af705e1-100d-4de8-94d3-f2844c063907 admin admin] The token cache is being invalidate because project e899511298394a11804d28b25d0a925c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:02:39.878544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2af705e1-100d-4de8-94d3-f2844c063907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:39.879185 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2af705e1-100d-4de8-94d3-f2844c063907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:39.880731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1135/2281] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:02:39 2022] DELETE /identity/v3/projects/e899511298394a11804d28b25d0a925c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:02:39.884765 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bcfb9-388e-4dd5-b0da-857971726a4d admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:39.886247 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-773bcfb9-388e-4dd5-b0da-857971726a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:39.898786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bcfb9-388e-4dd5-b0da-857971726a4d admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:39.954546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cd519-fdf3-4b05-9106-00e224fd4ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:39.955367 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cd519-fdf3-4b05-9106-00e224fd4ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:39.955685 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cd519-fdf3-4b05-9106-00e224fd4ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:39.955964 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cd519-fdf3-4b05-9106-00e224fd4ff8 admin admin] PATH_INFO: `/v3/users/b1e601c68be24403851e6e3d21e60854` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:39.957167 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cd519-fdf3-4b05-9106-00e224fd4ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e601c68be24403851e6e3d21e60854)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:39.959081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cd519-fdf3-4b05-9106-00e224fd4ff8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:40.160429 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-fe0cd519-fdf3-4b05-9106-00e224fd4ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e601c68be24403851e6e3d21e60854'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:40.161109 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-fe0cd519-fdf3-4b05-9106-00e224fd4ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e601c68be24403851e6e3d21e60854'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:40.170504 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-fe0cd519-fdf3-4b05-9106-00e224fd4ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e601c68be24403851e6e3d21e60854'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:40.251636 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-fe0cd519-fdf3-4b05-9106-00e224fd4ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e601c68be24403851e6e3d21e60854'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:40.264769 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-fe0cd519-fdf3-4b05-9106-00e224fd4ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e601c68be24403851e6e3d21e60854'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:40.270848 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1147/2282] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:02:39 2022] DELETE /identity/v3/users/b1e601c68be24403851e6e3d21e60854 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:40.531933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af705e1-100d-4de8-94d3-f2844c063907 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:40.534159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-2af705e1-100d-4de8-94d3-f2844c063907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:40.547943 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af705e1-100d-4de8-94d3-f2844c063907 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:40.610100 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6e3b6-96eb-455f-b845-56c77f301085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:40.610966 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6e3b6-96eb-455f-b845-56c77f301085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:40.611250 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6e3b6-96eb-455f-b845-56c77f301085 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:40.611550 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6e3b6-96eb-455f-b845-56c77f301085 admin admin] PATH_INFO: `/v3/projects/a26335b18df2471aa373124a5a02b21b` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:40.612742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6e3b6-96eb-455f-b845-56c77f301085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26335b18df2471aa373124a5a02b21b)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:40.614659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6e3b6-96eb-455f-b845-56c77f301085 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:40.751455 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-62e6e3b6-96eb-455f-b845-56c77f301085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26335b18df2471aa373124a5a02b21b', 'request_id': 'req-62e6e3b6-96eb-455f-b845-56c77f301085'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:40.840896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-62e6e3b6-96eb-455f-b845-56c77f301085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26335b18df2471aa373124a5a02b21b', 'request_id': 'req-62e6e3b6-96eb-455f-b845-56c77f301085'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:40.847888 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-62e6e3b6-96eb-455f-b845-56c77f301085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26335b18df2471aa373124a5a02b21b', 'request_id': 'req-62e6e3b6-96eb-455f-b845-56c77f301085'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:40.858703 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-62e6e3b6-96eb-455f-b845-56c77f301085 admin admin] The token cache is being invalidate because project a26335b18df2471aa373124a5a02b21b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:02:40.858987 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-62e6e3b6-96eb-455f-b845-56c77f301085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:40.859726 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-62e6e3b6-96eb-455f-b845-56c77f301085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:40.861364 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1136/2283] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:02:40 2022] DELETE /identity/v3/projects/a26335b18df2471aa373124a5a02b21b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:40.866217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1ebcc-73ef-46eb-8f4c-43a98734c5bb None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:40.867936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1ebcc-73ef-46eb-8f4c-43a98734c5bb None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:40.867936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1ebcc-73ef-46eb-8f4c-43a98734c5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:40.887028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-14a1ebcc-73ef-46eb-8f4c-43a98734c5bb None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:40.888371 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-14a1ebcc-73ef-46eb-8f4c-43a98734c5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:40.945176 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1148/2284] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:02:40.954504 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f5000-6a39-48b3-a8d7-12a3dc781699 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:40.954788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f5000-6a39-48b3-a8d7-12a3dc781699 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:40.955064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f5000-6a39-48b3-a8d7-12a3dc781699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:40.973571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-6e1f5000-6a39-48b3-a8d7-12a3dc781699 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:40.974759 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-6e1f5000-6a39-48b3-a8d7-12a3dc781699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:40.982924 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1137/2285] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:40.987083 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1ebcc-73ef-46eb-8f4c-43a98734c5bb None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:40.997165 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1ebcc-73ef-46eb-8f4c-43a98734c5bb None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:41.001718 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6eb24-c869-4a73-a5df-0ff23cae6d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:41.002358 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6eb24-c869-4a73-a5df-0ff23cae6d16 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:41.002640 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6eb24-c869-4a73-a5df-0ff23cae6d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:41.002947 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6eb24-c869-4a73-a5df-0ff23cae6d16 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:41.003696 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6eb24-c869-4a73-a5df-0ff23cae6d16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:02:41.004005 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6eb24-c869-4a73-a5df-0ff23cae6d16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:41.005591 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6eb24-c869-4a73-a5df-0ff23cae6d16 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:41.017185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1149/2286] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:02:41.021277 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f5000-6a39-48b3-a8d7-12a3dc781699 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:41.030430 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f5000-6a39-48b3-a8d7-12a3dc781699 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:41.035028 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db1e5f-d362-47ec-bae6-01ea865a8c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:41.035695 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db1e5f-d362-47ec-bae6-01ea865a8c18 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:41.035979 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db1e5f-d362-47ec-bae6-01ea865a8c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:41.036252 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db1e5f-d362-47ec-bae6-01ea865a8c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:41.036941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db1e5f-d362-47ec-bae6-01ea865a8c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:41.038815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db1e5f-d362-47ec-bae6-01ea865a8c18 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:41.150010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1138/2287] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:02:41 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:02:41.162471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6eb24-c869-4a73-a5df-0ff23cae6d16 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:41.172451 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6eb24-c869-4a73-a5df-0ff23cae6d16 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:41.227651 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11e59b-2a60-44d9-ac12-0f153114f8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:41.235241 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11e59b-2a60-44d9-ac12-0f153114f8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:41.235241 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11e59b-2a60-44d9-ac12-0f153114f8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:41.235241 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11e59b-2a60-44d9-ac12-0f153114f8b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:41.235241 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11e59b-2a60-44d9-ac12-0f153114f8b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:41.235241 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11e59b-2a60-44d9-ac12-0f153114f8b6 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:41.309568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1150/2288] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:02:41 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:41.313914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db1e5f-d362-47ec-bae6-01ea865a8c18 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:41.324866 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db1e5f-d362-47ec-bae6-01ea865a8c18 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:41.333164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10a567-0248-47fc-acd0-9d52e770f5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:41.333164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10a567-0248-47fc-acd0-9d52e770f5bd admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:41.333164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10a567-0248-47fc-acd0-9d52e770f5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:41.333164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10a567-0248-47fc-acd0-9d52e770f5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:41.333508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10a567-0248-47fc-acd0-9d52e770f5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:41.333508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10a567-0248-47fc-acd0-9d52e770f5bd admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:41.347265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1139/2289] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:41.348578 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11e59b-2a60-44d9-ac12-0f153114f8b6 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:41.359582 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11e59b-2a60-44d9-ac12-0f153114f8b6 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:41.364297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c93d9-f414-4ecc-8196-6c5a43c3c09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:41.367258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c93d9-f414-4ecc-8196-6c5a43c3c09e admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:41.367258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c93d9-f414-4ecc-8196-6c5a43c3c09e admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:41.367258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c93d9-f414-4ecc-8196-6c5a43c3c09e admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:41.367258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c93d9-f414-4ecc-8196-6c5a43c3c09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:41.367811 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c93d9-f414-4ecc-8196-6c5a43c3c09e admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:41.378722 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1151/2290] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:41.383293 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10a567-0248-47fc-acd0-9d52e770f5bd admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:41.393561 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10a567-0248-47fc-acd0-9d52e770f5bd admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:41.398255 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51c24d-2455-4c61-a451-e74156aaafa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:41.399144 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c24d-2455-4c61-a451-e74156aaafa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:41.399421 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c24d-2455-4c61-a451-e74156aaafa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:41.399722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c24d-2455-4c61-a451-e74156aaafa2 admin admin] PATH_INFO: `/v3/projects/bc5c67803b184f6f8eef4edac3d7a858/users/71e34edf2dd54fba8b07cd7d2891cc4b/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:41.416377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51c24d-2455-4c61-a451-e74156aaafa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5c67803b184f6f8eef4edac3d7a858, user_id=71e34edf2dd54fba8b07cd7d2891cc4b, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:41.419879 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51c24d-2455-4c61-a451-e74156aaafa2 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:41.503272 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1140/2291] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:41 2022] PUT /identity/v3/projects/bc5c67803b184f6f8eef4edac3d7a858/users/71e34edf2dd54fba8b07cd7d2891cc4b/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:41.513483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf9650-7a4d-4ed1-8d2c-f1223eef8251 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:41.513883 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf9650-7a4d-4ed1-8d2c-f1223eef8251 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:41.514169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf9650-7a4d-4ed1-8d2c-f1223eef8251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:41.540363 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-59bf9650-7a4d-4ed1-8d2c-f1223eef8251 None None] MFA Rules not processed for user `71e34edf2dd54fba8b07cd7d2891cc4b`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:41.542096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-59bf9650-7a4d-4ed1-8d2c-f1223eef8251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:41.602531 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1152/2292] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:41.608053 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51c24d-2455-4c61-a451-e74156aaafa2 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:41.667709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51c24d-2455-4c61-a451-e74156aaafa2 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:41.672370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fce897-6b40-4022-ac3c-aa903d92f3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:41.673026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fce897-6b40-4022-ac3c-aa903d92f3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:41.673308 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fce897-6b40-4022-ac3c-aa903d92f3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:41.673585 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fce897-6b40-4022-ac3c-aa903d92f3d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:41.674281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fce897-6b40-4022-ac3c-aa903d92f3d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:41.676215 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fce897-6b40-4022-ac3c-aa903d92f3d9 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:41.759484 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1141/2293] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:02:41 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:41.761308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf9650-7a4d-4ed1-8d2c-f1223eef8251 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:41.772534 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf9650-7a4d-4ed1-8d2c-f1223eef8251 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:41.837896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075b214-3d12-4e35-99df-a5a0b8cb716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:41.838690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075b214-3d12-4e35-99df-a5a0b8cb716e admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:41.838972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075b214-3d12-4e35-99df-a5a0b8cb716e admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:41.839210 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075b214-3d12-4e35-99df-a5a0b8cb716e admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:41.839939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075b214-3d12-4e35-99df-a5a0b8cb716e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:41.841872 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075b214-3d12-4e35-99df-a5a0b8cb716e admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:41.909424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1153/2294] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:02:41 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:02:41.913581 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fce897-6b40-4022-ac3c-aa903d92f3d9 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:41.924651 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fce897-6b40-4022-ac3c-aa903d92f3d9 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:41.929066 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cc248-5d2d-4f26-905f-9465aa730c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:41.929823 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cc248-5d2d-4f26-905f-9465aa730c57 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:41.930172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cc248-5d2d-4f26-905f-9465aa730c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:41.930525 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cc248-5d2d-4f26-905f-9465aa730c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:41.931326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cc248-5d2d-4f26-905f-9465aa730c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:41.933943 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cc248-5d2d-4f26-905f-9465aa730c57 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:41.946417 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1142/2295] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:02:41.951266 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075b214-3d12-4e35-99df-a5a0b8cb716e admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:41.961082 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075b214-3d12-4e35-99df-a5a0b8cb716e admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:41.965928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1616c-51e4-4684-8be7-8894bb196a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:41.966643 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1616c-51e4-4684-8be7-8894bb196a92 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:41.966928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1616c-51e4-4684-8be7-8894bb196a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:41.967241 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1616c-51e4-4684-8be7-8894bb196a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:41.968008 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1616c-51e4-4684-8be7-8894bb196a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:41.969676 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1616c-51e4-4684-8be7-8894bb196a92 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:41.980625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1154/2296] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:41.985501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cc248-5d2d-4f26-905f-9465aa730c57 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:41.999445 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cc248-5d2d-4f26-905f-9465aa730c57 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:42.003576 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a78fd0-f7b1-4b6b-9cca-8c3129ccd0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:42.004210 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a78fd0-f7b1-4b6b-9cca-8c3129ccd0d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:42.004352 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a78fd0-f7b1-4b6b-9cca-8c3129ccd0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:42.004715 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a78fd0-f7b1-4b6b-9cca-8c3129ccd0d2 admin admin] PATH_INFO: `/v3/projects/033c76b9ef5e4503a51e7c3052743715/users/cb91f3b76b32495685b041fd48dc4061/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:42.042394 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a78fd0-f7b1-4b6b-9cca-8c3129ccd0d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033c76b9ef5e4503a51e7c3052743715, user_id=cb91f3b76b32495685b041fd48dc4061, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:42.045402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a78fd0-f7b1-4b6b-9cca-8c3129ccd0d2 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:42.179277 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1143/2297] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:41 2022] PUT /identity/v3/projects/033c76b9ef5e4503a51e7c3052743715/users/cb91f3b76b32495685b041fd48dc4061/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:02:42.191894 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02733be-3433-4aa6-a2e4-0b6cd8253ff9 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:42.192524 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02733be-3433-4aa6-a2e4-0b6cd8253ff9 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:42.193129 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02733be-3433-4aa6-a2e4-0b6cd8253ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:42.228688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c02733be-3433-4aa6-a2e4-0b6cd8253ff9 None None] MFA Rules not processed for user `cb91f3b76b32495685b041fd48dc4061`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:42.230434 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c02733be-3433-4aa6-a2e4-0b6cd8253ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:42.298054 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1155/2298] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:42.310889 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a78fd0-f7b1-4b6b-9cca-8c3129ccd0d2 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:42.387308 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a78fd0-f7b1-4b6b-9cca-8c3129ccd0d2 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:42.392005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc845fd4-9368-4f18-827b-699115bfc2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:42.392668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc845fd4-9368-4f18-827b-699115bfc2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:42.392950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc845fd4-9368-4f18-827b-699115bfc2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:42.393226 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc845fd4-9368-4f18-827b-699115bfc2b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:42.393914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc845fd4-9368-4f18-827b-699115bfc2b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:42.395829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc845fd4-9368-4f18-827b-699115bfc2b1 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:42.516419 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1144/2299] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:02:42 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:42.520270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02733be-3433-4aa6-a2e4-0b6cd8253ff9 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:42.545341 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02733be-3433-4aa6-a2e4-0b6cd8253ff9 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:42.617735 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b2609-bb64-4601-ae6d-6a552a265872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:42.618762 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b2609-bb64-4601-ae6d-6a552a265872 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:42.619277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b2609-bb64-4601-ae6d-6a552a265872 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:42.620349 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b2609-bb64-4601-ae6d-6a552a265872 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:42.623787 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b2609-bb64-4601-ae6d-6a552a265872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:42.624561 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b2609-bb64-4601-ae6d-6a552a265872 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:42.726658 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1156/2300] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:02:42 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:02:42.728311 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc845fd4-9368-4f18-827b-699115bfc2b1 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:42.753441 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc845fd4-9368-4f18-827b-699115bfc2b1 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:42.766095 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17d918-7b1b-4613-9fcd-195816a5199a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:42.767089 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17d918-7b1b-4613-9fcd-195816a5199a admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:42.773071 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17d918-7b1b-4613-9fcd-195816a5199a admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:42.773796 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17d918-7b1b-4613-9fcd-195816a5199a admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:42.774831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17d918-7b1b-4613-9fcd-195816a5199a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:42.791784 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17d918-7b1b-4613-9fcd-195816a5199a admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:42.819508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1145/2301] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:42.824439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b2609-bb64-4601-ae6d-6a552a265872 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:42.837080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b2609-bb64-4601-ae6d-6a552a265872 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:42.843994 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de780b5-a2e5-4014-8ae7-ea93138acfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:42.849111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de780b5-a2e5-4014-8ae7-ea93138acfaa admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:42.849111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de780b5-a2e5-4014-8ae7-ea93138acfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:42.849111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de780b5-a2e5-4014-8ae7-ea93138acfaa admin admin] PATH_INFO: `/v3/projects/50c4b750f51545f586a84938968a2536/users/1e8e27f856564ae593ef7ca4c449f2dc/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:42.865505 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de780b5-a2e5-4014-8ae7-ea93138acfaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c4b750f51545f586a84938968a2536, user_id=1e8e27f856564ae593ef7ca4c449f2dc, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:42.869243 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de780b5-a2e5-4014-8ae7-ea93138acfaa admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:43.009430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1157/2302] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:42 2022] PUT /identity/v3/projects/50c4b750f51545f586a84938968a2536/users/1e8e27f856564ae593ef7ca4c449f2dc/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:02:43.014215 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17d918-7b1b-4613-9fcd-195816a5199a admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:43.028986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17d918-7b1b-4613-9fcd-195816a5199a admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:43.097643 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ed9d5-57d2-470d-bb48-2be6c4e0bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:43.098361 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ed9d5-57d2-470d-bb48-2be6c4e0bfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:43.098642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ed9d5-57d2-470d-bb48-2be6c4e0bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:43.098916 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ed9d5-57d2-470d-bb48-2be6c4e0bfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:43.099693 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ed9d5-57d2-470d-bb48-2be6c4e0bfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:43.101443 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ed9d5-57d2-470d-bb48-2be6c4e0bfa9 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:43.115578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1146/2303] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:02:43.119771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de780b5-a2e5-4014-8ae7-ea93138acfaa admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:43.133982 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de780b5-a2e5-4014-8ae7-ea93138acfaa admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:43.141048 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a98cbd-b206-417c-a0a4-59bf8234de9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:43.142294 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a98cbd-b206-417c-a0a4-59bf8234de9c admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:43.142805 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a98cbd-b206-417c-a0a4-59bf8234de9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:43.143277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a98cbd-b206-417c-a0a4-59bf8234de9c admin admin] PATH_INFO: `/v3/projects/50c4b750f51545f586a84938968a2536/users/1e8e27f856564ae593ef7ca4c449f2dc/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:43.146889 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a98cbd-b206-417c-a0a4-59bf8234de9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c4b750f51545f586a84938968a2536, user_id=1e8e27f856564ae593ef7ca4c449f2dc, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:43.149867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a98cbd-b206-417c-a0a4-59bf8234de9c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:43.221168 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1158/2304] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:02:43 2022] PUT /identity/v3/projects/50c4b750f51545f586a84938968a2536/users/1e8e27f856564ae593ef7ca4c449f2dc/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:02:43.223304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748a9cb-71c0-48f3-a012-836f37ca6f45 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:43.223741 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748a9cb-71c0-48f3-a012-836f37ca6f45 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:43.224173 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748a9cb-71c0-48f3-a012-836f37ca6f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:43.264425 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-d748a9cb-71c0-48f3-a012-836f37ca6f45 None None] MFA Rules not processed for user `1e8e27f856564ae593ef7ca4c449f2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:43.266022 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d748a9cb-71c0-48f3-a012-836f37ca6f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:43.409312 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1147/2305] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:02:43.417690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a98cbd-b206-417c-a0a4-59bf8234de9c admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:43.419424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-e5a98cbd-b206-417c-a0a4-59bf8234de9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:43.506026 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a98cbd-b206-417c-a0a4-59bf8234de9c admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:43.511888 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a9283-4ef1-440d-8f0d-49f1d4191eeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:43.513135 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a9283-4ef1-440d-8f0d-49f1d4191eeb service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:43.513927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a9283-4ef1-440d-8f0d-49f1d4191eeb service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:43.514511 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a9283-4ef1-440d-8f0d-49f1d4191eeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:43.592126 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a9283-4ef1-440d-8f0d-49f1d4191eeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:43.593707 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a9283-4ef1-440d-8f0d-49f1d4191eeb service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:43.604797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1159/2306] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:02:44.468664 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e42c5-5453-4005-bd96-872298a4af99 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:44.469185 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e42c5-5453-4005-bd96-872298a4af99 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:44.469265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e42c5-5453-4005-bd96-872298a4af99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:44.517494 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-be0e42c5-5453-4005-bd96-872298a4af99 None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:44.519832 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-be0e42c5-5453-4005-bd96-872298a4af99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:44.607835 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1148/2307] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 12:02:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:44.627335 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a9283-4ef1-440d-8f0d-49f1d4191eeb service cinder] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:44.635076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c19a9283-4ef1-440d-8f0d-49f1d4191eeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:44.715596 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a9283-4ef1-440d-8f0d-49f1d4191eeb service cinder] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:44.722034 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83ed37-aec4-4df5-b43e-a1c5e75c53b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:44.722771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83ed37-aec4-4df5-b43e-a1c5e75c53b7 service swift] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:44.723050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83ed37-aec4-4df5-b43e-a1c5e75c53b7 service swift] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:44.723327 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83ed37-aec4-4df5-b43e-a1c5e75c53b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:44.739912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83ed37-aec4-4df5-b43e-a1c5e75c53b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:44.741925 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83ed37-aec4-4df5-b43e-a1c5e75c53b7 service swift] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:44.751704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1160/2308] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:02:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 12:02:45.977376 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4def8-6454-43ff-bae4-46842e2913be None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:45.977882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4def8-6454-43ff-bae4-46842e2913be None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:45.978077 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4def8-6454-43ff-bae4-46842e2913be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:45.997351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-efa4def8-6454-43ff-bae4-46842e2913be None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:45.998324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-efa4def8-6454-43ff-bae4-46842e2913be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:46.005532 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1149/2309] 10.222.0.52 () {58 vars in 967 bytes} [Tue Mar 8 12:02:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:02:46.018572 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83ed37-aec4-4df5-b43e-a1c5e75c53b7 service swift] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:46.028797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83ed37-aec4-4df5-b43e-a1c5e75c53b7 service swift] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:46.033696 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da652d1d-b78e-4c23-8b73-c0f6cf498b39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:46.034320 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da652d1d-b78e-4c23-8b73-c0f6cf498b39 service swift] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:46.034598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da652d1d-b78e-4c23-8b73-c0f6cf498b39 service swift] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:46.034869 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da652d1d-b78e-4c23-8b73-c0f6cf498b39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:46.043157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da652d1d-b78e-4c23-8b73-c0f6cf498b39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:46.044723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da652d1d-b78e-4c23-8b73-c0f6cf498b39 service swift] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:46.052513 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1161/2310] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:02:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 12:02:46.815380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2148ea-5a9c-4021-b905-3781ef860a46 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:46.815692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2148ea-5a9c-4021-b905-3781ef860a46 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:46.815970 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2148ea-5a9c-4021-b905-3781ef860a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:46.837597 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-cc2148ea-5a9c-4021-b905-3781ef860a46 None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:46.840248 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-cc2148ea-5a9c-4021-b905-3781ef860a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:46.854399 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1150/2311] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 12:02:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:46.863010 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da652d1d-b78e-4c23-8b73-c0f6cf498b39 service swift] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:46.885549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da652d1d-b78e-4c23-8b73-c0f6cf498b39 service swift] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:46.897759 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77ad9a-69ce-4afa-b8c2-23fd30169010 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:46.898678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77ad9a-69ce-4afa-b8c2-23fd30169010 service swift] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:46.899438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77ad9a-69ce-4afa-b8c2-23fd30169010 service swift] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:46.899926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77ad9a-69ce-4afa-b8c2-23fd30169010 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:46.920659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77ad9a-69ce-4afa-b8c2-23fd30169010 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:46.924700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77ad9a-69ce-4afa-b8c2-23fd30169010 service swift] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:46.951194 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1162/2312] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:02:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 12:02:47.707706 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0f524-9688-414b-9ca9-350533269252 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:47.713735 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0f524-9688-414b-9ca9-350533269252 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:47.713735 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0f524-9688-414b-9ca9-350533269252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:47.727828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-72d0f524-9688-414b-9ca9-350533269252 None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:47.729043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-72d0f524-9688-414b-9ca9-350533269252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:47.737701 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1151/2313] 10.222.0.52 () {58 vars in 967 bytes} [Tue Mar 8 12:02:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:02:47.750512 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77ad9a-69ce-4afa-b8c2-23fd30169010 service swift] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:47.760993 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77ad9a-69ce-4afa-b8c2-23fd30169010 service swift] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:47.766649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd6604-e591-48cc-a8c1-07ff5a90f864 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:47.767270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd6604-e591-48cc-a8c1-07ff5a90f864 service swift] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:47.767579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd6604-e591-48cc-a8c1-07ff5a90f864 service swift] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:47.767856 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd6604-e591-48cc-a8c1-07ff5a90f864 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:47.775681 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd6604-e591-48cc-a8c1-07ff5a90f864 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:47.777429 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd6604-e591-48cc-a8c1-07ff5a90f864 service swift] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:47.785152 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1163/2314] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:02:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 08 12:02:54.382325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0f524-9688-414b-9ca9-350533269252 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:54.383845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-72d0f524-9688-414b-9ca9-350533269252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:54.416104 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0f524-9688-414b-9ca9-350533269252 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:54.421170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ab7c8-5635-4e7e-a0ed-a3f51e2fe09f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:54.421804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ab7c8-5635-4e7e-a0ed-a3f51e2fe09f service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:54.422087 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ab7c8-5635-4e7e-a0ed-a3f51e2fe09f service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:54.422364 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ab7c8-5635-4e7e-a0ed-a3f51e2fe09f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:54.478048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ab7c8-5635-4e7e-a0ed-a3f51e2fe09f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:54.479490 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ab7c8-5635-4e7e-a0ed-a3f51e2fe09f service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:54.489744 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1152/2315] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:02:57.217351 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd6604-e591-48cc-a8c1-07ff5a90f864 service swift] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:57.228516 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd6604-e591-48cc-a8c1-07ff5a90f864 service swift] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:57.233797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195faaa-6d3d-4168-b91a-bfc528dc4dfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:57.234438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195faaa-6d3d-4168-b91a-bfc528dc4dfe service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:57.234902 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195faaa-6d3d-4168-b91a-bfc528dc4dfe service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:57.235180 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195faaa-6d3d-4168-b91a-bfc528dc4dfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:57.248414 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195faaa-6d3d-4168-b91a-bfc528dc4dfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:57.250178 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195faaa-6d3d-4168-b91a-bfc528dc4dfe service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:57.260609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1164/2316] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:02:57.900115 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ab7c8-5635-4e7e-a0ed-a3f51e2fe09f service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:57.901792 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-089ab7c8-5635-4e7e-a0ed-a3f51e2fe09f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:57.980612 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ab7c8-5635-4e7e-a0ed-a3f51e2fe09f service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:57.986172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ad201-175a-446b-b994-720ecd402c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:57.988728 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ad201-175a-446b-b994-720ecd402c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:57.988728 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ad201-175a-446b-b994-720ecd402c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:57.988728 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ad201-175a-446b-b994-720ecd402c2b admin admin] PATH_INFO: `/v3/users/fa99a27f6cb94850a9f2cbdf0c0ca353` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:57.989010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ad201-175a-446b-b994-720ecd402c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa99a27f6cb94850a9f2cbdf0c0ca353)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:57.991024 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ad201-175a-446b-b994-720ecd402c2b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:58.181689 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b09ad201-175a-446b-b994-720ecd402c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa99a27f6cb94850a9f2cbdf0c0ca353'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:58.182608 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b09ad201-175a-446b-b994-720ecd402c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa99a27f6cb94850a9f2cbdf0c0ca353'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:58.266167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b09ad201-175a-446b-b994-720ecd402c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa99a27f6cb94850a9f2cbdf0c0ca353'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:58.286531 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b09ad201-175a-446b-b994-720ecd402c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa99a27f6cb94850a9f2cbdf0c0ca353'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:58.293190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b09ad201-175a-446b-b994-720ecd402c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa99a27f6cb94850a9f2cbdf0c0ca353'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:58.299653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1153/2317] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:02:57 2022] DELETE /identity/v3/users/fa99a27f6cb94850a9f2cbdf0c0ca353 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:02:58.304436 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70ba34-5e23-4589-b4f7-3140d27c4e9f None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:58.304931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70ba34-5e23-4589-b4f7-3140d27c4e9f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:58.304931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70ba34-5e23-4589-b4f7-3140d27c4e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:58.326492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-3c70ba34-5e23-4589-b4f7-3140d27c4e9f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:02:58.328019 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3c70ba34-5e23-4589-b4f7-3140d27c4e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:58.414016 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1165/2318] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:02:58.424000 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ad201-175a-446b-b994-720ecd402c2b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:58.426397 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b09ad201-175a-446b-b994-720ecd402c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:58.514595 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ad201-175a-446b-b994-720ecd402c2b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:58.519546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7d270-17ef-41f3-a7f4-10b8110fca65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:58.522598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7d270-17ef-41f3-a7f4-10b8110fca65 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:58.522598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7d270-17ef-41f3-a7f4-10b8110fca65 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:58.522598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7d270-17ef-41f3-a7f4-10b8110fca65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:58.541902 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7d270-17ef-41f3-a7f4-10b8110fca65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:58.543869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7d270-17ef-41f3-a7f4-10b8110fca65 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:58.561692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1154/2319] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:02:59.107046 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70ba34-5e23-4589-b4f7-3140d27c4e9f None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:02:59.109207 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3c70ba34-5e23-4589-b4f7-3140d27c4e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:02:59.121041 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70ba34-5e23-4589-b4f7-3140d27c4e9f None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:02:59.129105 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:02:59.130056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:02:59.130400 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:02:59.130781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46 admin admin] PATH_INFO: `/v3/projects/1e3b02ffef16499f8e59905a9641bcef` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:02:59.132232 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3b02ffef16499f8e59905a9641bcef)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:02:59.134814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:02:59.242119 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3b02ffef16499f8e59905a9641bcef', 'request_id': 'req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:59.248519 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3b02ffef16499f8e59905a9641bcef', 'request_id': 'req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:59.317001 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3b02ffef16499f8e59905a9641bcef', 'request_id': 'req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:59.328496 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46 admin admin] The token cache is being invalidate because project 1e3b02ffef16499f8e59905a9641bcef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:02:59.328784 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:59.329406 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:02:59.331266 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1166/2320] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:02:59 2022] DELETE /identity/v3/projects/1e3b02ffef16499f8e59905a9641bcef => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:02.069054 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b014405-140a-4f00-94d4-536a8da2dda5 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:02.069414 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b014405-140a-4f00-94d4-536a8da2dda5 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:02.069510 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b014405-140a-4f00-94d4-536a8da2dda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:02.087670 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-5b014405-140a-4f00-94d4-536a8da2dda5 None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:02.088951 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5b014405-140a-4f00-94d4-536a8da2dda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:02.147757 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1155/2321] 10.222.0.52 () {58 vars in 967 bytes} [Tue Mar 8 12:03:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:02.162215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:02.163739 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:02.264919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c3455-892a-4bf6-a79c-ed50f1c48a46 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:02.272166 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2afd1-975e-4c29-85c6-719c29dd8464 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:02.273817 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2afd1-975e-4c29-85c6-719c29dd8464 service swift] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:02.274300 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2afd1-975e-4c29-85c6-719c29dd8464 service swift] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:02.274742 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2afd1-975e-4c29-85c6-719c29dd8464 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:02.291426 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2afd1-975e-4c29-85c6-719c29dd8464 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:02.293146 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2afd1-975e-4c29-85c6-719c29dd8464 service swift] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:02.304983 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1167/2322] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:03:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 12:03:04.217162 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b014405-140a-4f00-94d4-536a8da2dda5 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:04.218653 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5b014405-140a-4f00-94d4-536a8da2dda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:04.285515 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b014405-140a-4f00-94d4-536a8da2dda5 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:04.290236 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce82bf-9ae6-4e6f-84fc-582ca2e6c0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:04.291138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce82bf-9ae6-4e6f-84fc-582ca2e6c0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:04.291416 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce82bf-9ae6-4e6f-84fc-582ca2e6c0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:04.291725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce82bf-9ae6-4e6f-84fc-582ca2e6c0ed admin admin] PATH_INFO: `/v3/users/71e34edf2dd54fba8b07cd7d2891cc4b` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:04.292920 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce82bf-9ae6-4e6f-84fc-582ca2e6c0ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e34edf2dd54fba8b07cd7d2891cc4b)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:04.295503 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce82bf-9ae6-4e6f-84fc-582ca2e6c0ed admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:04.525203 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-69ce82bf-9ae6-4e6f-84fc-582ca2e6c0ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e34edf2dd54fba8b07cd7d2891cc4b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:04.525925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-69ce82bf-9ae6-4e6f-84fc-582ca2e6c0ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e34edf2dd54fba8b07cd7d2891cc4b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:04.603298 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-69ce82bf-9ae6-4e6f-84fc-582ca2e6c0ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e34edf2dd54fba8b07cd7d2891cc4b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:04.616202 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-69ce82bf-9ae6-4e6f-84fc-582ca2e6c0ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e34edf2dd54fba8b07cd7d2891cc4b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:04.622910 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-69ce82bf-9ae6-4e6f-84fc-582ca2e6c0ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e34edf2dd54fba8b07cd7d2891cc4b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:04.628834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1156/2323] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:03:04 2022] DELETE /identity/v3/users/71e34edf2dd54fba8b07cd7d2891cc4b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:04.633323 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b41da-c8b4-4b4f-9c0c-402d4139214f None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:04.642595 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b41da-c8b4-4b4f-9c0c-402d4139214f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:04.642595 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b41da-c8b4-4b4f-9c0c-402d4139214f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:04.651602 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-376b41da-c8b4-4b4f-9c0c-402d4139214f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:04.652799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-376b41da-c8b4-4b4f-9c0c-402d4139214f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:04.720041 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1168/2324] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:04.729923 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce82bf-9ae6-4e6f-84fc-582ca2e6c0ed admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:04.731325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-69ce82bf-9ae6-4e6f-84fc-582ca2e6c0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:04.789294 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce82bf-9ae6-4e6f-84fc-582ca2e6c0ed admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:04.792908 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b1dd4-6d2a-4539-8c10-be24b6e338aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:04.793554 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b1dd4-6d2a-4539-8c10-be24b6e338aa service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:04.793836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b1dd4-6d2a-4539-8c10-be24b6e338aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:04.794113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b1dd4-6d2a-4539-8c10-be24b6e338aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:04.803005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b1dd4-6d2a-4539-8c10-be24b6e338aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:04.804465 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b1dd4-6d2a-4539-8c10-be24b6e338aa service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:04.814062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1157/2325] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:03:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:03:05.312083 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b41da-c8b4-4b4f-9c0c-402d4139214f None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:05.314169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-376b41da-c8b4-4b4f-9c0c-402d4139214f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:05.341903 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b41da-c8b4-4b4f-9c0c-402d4139214f None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:05.357085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a56d4-3770-4f95-bf83-12203cd4bd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:05.359130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a56d4-3770-4f95-bf83-12203cd4bd22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:05.359712 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a56d4-3770-4f95-bf83-12203cd4bd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:05.359999 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a56d4-3770-4f95-bf83-12203cd4bd22 admin admin] PATH_INFO: `/v3/projects/bc5c67803b184f6f8eef4edac3d7a858` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:05.370084 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a56d4-3770-4f95-bf83-12203cd4bd22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5c67803b184f6f8eef4edac3d7a858)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:05.371922 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a56d4-3770-4f95-bf83-12203cd4bd22 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:05.485054 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5c3a56d4-3770-4f95-bf83-12203cd4bd22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5c67803b184f6f8eef4edac3d7a858', 'request_id': 'req-5c3a56d4-3770-4f95-bf83-12203cd4bd22'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:05.491255 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5c3a56d4-3770-4f95-bf83-12203cd4bd22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5c67803b184f6f8eef4edac3d7a858', 'request_id': 'req-5c3a56d4-3770-4f95-bf83-12203cd4bd22'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:05.552319 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5c3a56d4-3770-4f95-bf83-12203cd4bd22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5c67803b184f6f8eef4edac3d7a858', 'request_id': 'req-5c3a56d4-3770-4f95-bf83-12203cd4bd22'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:05.563939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5c3a56d4-3770-4f95-bf83-12203cd4bd22 admin admin] The token cache is being invalidate because project bc5c67803b184f6f8eef4edac3d7a858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:03:05.564282 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5c3a56d4-3770-4f95-bf83-12203cd4bd22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:05.564958 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5c3a56d4-3770-4f95-bf83-12203cd4bd22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:05.566527 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1169/2326] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:03:05 2022] DELETE /identity/v3/projects/bc5c67803b184f6f8eef4edac3d7a858 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:05.570539 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b1dd4-6d2a-4539-8c10-be24b6e338aa service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:05.580638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b1dd4-6d2a-4539-8c10-be24b6e338aa service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:05.630611 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a56d4-3770-4f95-bf83-12203cd4bd22 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:05.632533 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-5c3a56d4-3770-4f95-bf83-12203cd4bd22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:05.646110 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d94ca-22fd-45d2-a721-1a2920383b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:05.647036 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d94ca-22fd-45d2-a721-1a2920383b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:05.647316 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d94ca-22fd-45d2-a721-1a2920383b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:05.647621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d94ca-22fd-45d2-a721-1a2920383b59 admin admin] PATH_INFO: `/v3/users/cb91f3b76b32495685b041fd48dc4061` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:05.648832 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d94ca-22fd-45d2-a721-1a2920383b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb91f3b76b32495685b041fd48dc4061)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:05.650964 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d94ca-22fd-45d2-a721-1a2920383b59 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:05.709133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a56d4-3770-4f95-bf83-12203cd4bd22 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:05.713753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd04fcf-ae49-47a2-9308-f30cf47cc3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:05.714651 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd04fcf-ae49-47a2-9308-f30cf47cc3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:05.714914 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd04fcf-ae49-47a2-9308-f30cf47cc3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:05.715188 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd04fcf-ae49-47a2-9308-f30cf47cc3c1 admin admin] PATH_INFO: `/v3/users/2d616b3ce8ee49f6bfca34111f3f2b63` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:05.716472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd04fcf-ae49-47a2-9308-f30cf47cc3c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d616b3ce8ee49f6bfca34111f3f2b63)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:05.718996 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd04fcf-ae49-47a2-9308-f30cf47cc3c1 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:05.863750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f59d94ca-22fd-45d2-a721-1a2920383b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb91f3b76b32495685b041fd48dc4061'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:05.864434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f59d94ca-22fd-45d2-a721-1a2920383b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb91f3b76b32495685b041fd48dc4061'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:05.919569 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9dd04fcf-ae49-47a2-9308-f30cf47cc3c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d616b3ce8ee49f6bfca34111f3f2b63'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:05.920785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9dd04fcf-ae49-47a2-9308-f30cf47cc3c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d616b3ce8ee49f6bfca34111f3f2b63'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:05.928382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9dd04fcf-ae49-47a2-9308-f30cf47cc3c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d616b3ce8ee49f6bfca34111f3f2b63'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:05.934999 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f59d94ca-22fd-45d2-a721-1a2920383b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb91f3b76b32495685b041fd48dc4061'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:05.946994 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f59d94ca-22fd-45d2-a721-1a2920383b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb91f3b76b32495685b041fd48dc4061'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:05.954480 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f59d94ca-22fd-45d2-a721-1a2920383b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb91f3b76b32495685b041fd48dc4061'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:05.961235 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1158/2327] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:03:05 2022] DELETE /identity/v3/users/cb91f3b76b32495685b041fd48dc4061 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:06.032087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9dd04fcf-ae49-47a2-9308-f30cf47cc3c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d616b3ce8ee49f6bfca34111f3f2b63'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:06.051647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9dd04fcf-ae49-47a2-9308-f30cf47cc3c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d616b3ce8ee49f6bfca34111f3f2b63'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:06.059958 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1170/2328] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:03:05 2022] DELETE /identity/v3/users/2d616b3ce8ee49f6bfca34111f3f2b63 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:03:06.454242 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d94ca-22fd-45d2-a721-1a2920383b59 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:06.454242 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f59d94ca-22fd-45d2-a721-1a2920383b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:06.508300 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd04fcf-ae49-47a2-9308-f30cf47cc3c1 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:06.510173 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-9dd04fcf-ae49-47a2-9308-f30cf47cc3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:06.516269 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d94ca-22fd-45d2-a721-1a2920383b59 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:06.572190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ea39b-e9e8-406e-b761-04d1f01411ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:06.573060 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ea39b-e9e8-406e-b761-04d1f01411ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:06.573345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ea39b-e9e8-406e-b761-04d1f01411ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:06.573623 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ea39b-e9e8-406e-b761-04d1f01411ac admin admin] PATH_INFO: `/v3/projects/4b33a45757a84006a1a05085631b22c0` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:06.574853 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ea39b-e9e8-406e-b761-04d1f01411ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b33a45757a84006a1a05085631b22c0)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:06.577512 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ea39b-e9e8-406e-b761-04d1f01411ac admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:06.580336 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd04fcf-ae49-47a2-9308-f30cf47cc3c1 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:06.582782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397af8e9-1c64-439f-be19-3a1d7f01cf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:06.583712 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397af8e9-1c64-439f-be19-3a1d7f01cf84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:06.583996 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397af8e9-1c64-439f-be19-3a1d7f01cf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:06.584270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397af8e9-1c64-439f-be19-3a1d7f01cf84 admin admin] PATH_INFO: `/v3/projects/033c76b9ef5e4503a51e7c3052743715` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:06.585416 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397af8e9-1c64-439f-be19-3a1d7f01cf84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=033c76b9ef5e4503a51e7c3052743715)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:06.587717 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397af8e9-1c64-439f-be19-3a1d7f01cf84 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:06.693050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3e4ea39b-e9e8-406e-b761-04d1f01411ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b33a45757a84006a1a05085631b22c0', 'request_id': 'req-3e4ea39b-e9e8-406e-b761-04d1f01411ac'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:06.693584 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-397af8e9-1c64-439f-be19-3a1d7f01cf84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033c76b9ef5e4503a51e7c3052743715', 'request_id': 'req-397af8e9-1c64-439f-be19-3a1d7f01cf84'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:06.700076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-397af8e9-1c64-439f-be19-3a1d7f01cf84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033c76b9ef5e4503a51e7c3052743715', 'request_id': 'req-397af8e9-1c64-439f-be19-3a1d7f01cf84'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:06.786936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3e4ea39b-e9e8-406e-b761-04d1f01411ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b33a45757a84006a1a05085631b22c0', 'request_id': 'req-3e4ea39b-e9e8-406e-b761-04d1f01411ac'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:06.795437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3e4ea39b-e9e8-406e-b761-04d1f01411ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b33a45757a84006a1a05085631b22c0', 'request_id': 'req-3e4ea39b-e9e8-406e-b761-04d1f01411ac'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:06.808097 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3e4ea39b-e9e8-406e-b761-04d1f01411ac admin admin] The token cache is being invalidate because project 4b33a45757a84006a1a05085631b22c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:03:06.809754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3e4ea39b-e9e8-406e-b761-04d1f01411ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:06.809754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-3e4ea39b-e9e8-406e-b761-04d1f01411ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:06.811787 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1159/2329] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:03:06 2022] DELETE /identity/v3/projects/4b33a45757a84006a1a05085631b22c0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:06.816752 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7f823-f2aa-465b-a352-ffc3162f5408 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:06.817079 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7f823-f2aa-465b-a352-ffc3162f5408 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:06.817540 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7f823-f2aa-465b-a352-ffc3162f5408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:06.838489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-0eb7f823-f2aa-465b-a352-ffc3162f5408 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:06.839824 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0eb7f823-f2aa-465b-a352-ffc3162f5408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:06.843843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-397af8e9-1c64-439f-be19-3a1d7f01cf84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033c76b9ef5e4503a51e7c3052743715', 'request_id': 'req-397af8e9-1c64-439f-be19-3a1d7f01cf84'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:06.858765 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-397af8e9-1c64-439f-be19-3a1d7f01cf84 admin admin] The token cache is being invalidate because project 033c76b9ef5e4503a51e7c3052743715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:03:06.859348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-397af8e9-1c64-439f-be19-3a1d7f01cf84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:06.860490 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-397af8e9-1c64-439f-be19-3a1d7f01cf84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:06.862834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1171/2330] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:03:06 2022] DELETE /identity/v3/projects/033c76b9ef5e4503a51e7c3052743715 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:06.869136 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397af8e9-1c64-439f-be19-3a1d7f01cf84 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:06.870712 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-397af8e9-1c64-439f-be19-3a1d7f01cf84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:06.911003 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1160/2331] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:06.919289 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e2114-a2de-4deb-8c09-6ae98abcf593 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:06.919716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e2114-a2de-4deb-8c09-6ae98abcf593 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:06.921114 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e2114-a2de-4deb-8c09-6ae98abcf593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:06.941913 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-017e2114-a2de-4deb-8c09-6ae98abcf593 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:06.943486 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-017e2114-a2de-4deb-8c09-6ae98abcf593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:06.948343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397af8e9-1c64-439f-be19-3a1d7f01cf84 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:06.953552 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1161/2332] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:03:06.953791 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe97a06-14af-423b-8423-d3d13b1dc882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:06.954233 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe97a06-14af-423b-8423-d3d13b1dc882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:06.954518 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe97a06-14af-423b-8423-d3d13b1dc882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:06.954798 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe97a06-14af-423b-8423-d3d13b1dc882 admin admin] PATH_INFO: `/v3/users/1e8e27f856564ae593ef7ca4c449f2dc` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:06.956051 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe97a06-14af-423b-8423-d3d13b1dc882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8e27f856564ae593ef7ca4c449f2dc)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:06.958048 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe97a06-14af-423b-8423-d3d13b1dc882 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:06.958165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e2114-a2de-4deb-8c09-6ae98abcf593 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:06.968892 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e2114-a2de-4deb-8c09-6ae98abcf593 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:06.973996 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35594e-45c2-4c45-8907-a3dce9729b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:06.974652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35594e-45c2-4c45-8907-a3dce9729b9f admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:06.974963 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35594e-45c2-4c45-8907-a3dce9729b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:06.975238 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35594e-45c2-4c45-8907-a3dce9729b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:06.975998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35594e-45c2-4c45-8907-a3dce9729b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:03:06.976300 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35594e-45c2-4c45-8907-a3dce9729b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:06.978463 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35594e-45c2-4c45-8907-a3dce9729b9f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:06.991108 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1162/2333] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:03:06.995679 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35594e-45c2-4c45-8907-a3dce9729b9f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:07.006501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35594e-45c2-4c45-8907-a3dce9729b9f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:07.011140 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e3dc3-5b7e-422e-9e88-697ac7bffd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:07.011808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e3dc3-5b7e-422e-9e88-697ac7bffd83 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:07.012086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e3dc3-5b7e-422e-9e88-697ac7bffd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:07.012359 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e3dc3-5b7e-422e-9e88-697ac7bffd83 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:07.013031 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e3dc3-5b7e-422e-9e88-697ac7bffd83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:07.014922 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e3dc3-5b7e-422e-9e88-697ac7bffd83 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:07.119041 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1163/2334] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:03:06 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:03:07.126730 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e3dc3-5b7e-422e-9e88-697ac7bffd83 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:07.126874 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-bfe97a06-14af-423b-8423-d3d13b1dc882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8e27f856564ae593ef7ca4c449f2dc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:07.127335 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-bfe97a06-14af-423b-8423-d3d13b1dc882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8e27f856564ae593ef7ca4c449f2dc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:07.134493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-bfe97a06-14af-423b-8423-d3d13b1dc882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8e27f856564ae593ef7ca4c449f2dc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:07.185444 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e3dc3-5b7e-422e-9e88-697ac7bffd83 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:07.191211 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfecc7-701a-4bb4-b86e-9b4f7b9d9cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:07.191915 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfecc7-701a-4bb4-b86e-9b4f7b9d9cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:07.192198 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfecc7-701a-4bb4-b86e-9b4f7b9d9cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:07.192473 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfecc7-701a-4bb4-b86e-9b4f7b9d9cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:07.193161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfecc7-701a-4bb4-b86e-9b4f7b9d9cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:07.195076 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfecc7-701a-4bb4-b86e-9b4f7b9d9cd4 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:07.204200 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-bfe97a06-14af-423b-8423-d3d13b1dc882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8e27f856564ae593ef7ca4c449f2dc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:07.216595 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-bfe97a06-14af-423b-8423-d3d13b1dc882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8e27f856564ae593ef7ca4c449f2dc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:07.223690 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1172/2335] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:03:06 2022] DELETE /identity/v3/users/1e8e27f856564ae593ef7ca4c449f2dc => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:07.296895 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1164/2336] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:03:07 2022] POST /identity/v3/users => generated 284 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:03:07.301275 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe97a06-14af-423b-8423-d3d13b1dc882 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:07.302826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-bfe97a06-14af-423b-8423-d3d13b1dc882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:07.367278 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe97a06-14af-423b-8423-d3d13b1dc882 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:07.372501 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb717f-1e01-41fa-a440-d95889f896da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:07.373175 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb717f-1e01-41fa-a440-d95889f896da admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:07.373470 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb717f-1e01-41fa-a440-d95889f896da admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:07.373742 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb717f-1e01-41fa-a440-d95889f896da admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:07.374533 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb717f-1e01-41fa-a440-d95889f896da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:07.376439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb717f-1e01-41fa-a440-d95889f896da admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:07.380222 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfecc7-701a-4bb4-b86e-9b4f7b9d9cd4 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:07.386078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-28cfecc7-701a-4bb4-b86e-9b4f7b9d9cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:07.387155 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1173/2337] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:03:07.391440 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb717f-1e01-41fa-a440-d95889f896da admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:07.395324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfecc7-701a-4bb4-b86e-9b4f7b9d9cd4 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:07.400542 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da398f1-82fc-4361-ab64-ad70f58f2d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:07.401691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb717f-1e01-41fa-a440-d95889f896da admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:07.401812 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da398f1-82fc-4361-ab64-ad70f58f2d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:07.402031 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da398f1-82fc-4361-ab64-ad70f58f2d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:07.402317 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da398f1-82fc-4361-ab64-ad70f58f2d29 admin admin] PATH_INFO: `/v3/users/88b3173f84834cbb99b92cba4d3d7df1` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:07.404287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da398f1-82fc-4361-ab64-ad70f58f2d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b3173f84834cbb99b92cba4d3d7df1)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:07.407206 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da398f1-82fc-4361-ab64-ad70f58f2d29 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:07.408148 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df723b7d-48e2-4a24-aba1-874ce4081bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:07.408819 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723b7d-48e2-4a24-aba1-874ce4081bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:07.409101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723b7d-48e2-4a24-aba1-874ce4081bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:07.409372 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723b7d-48e2-4a24-aba1-874ce4081bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:07.410524 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df723b7d-48e2-4a24-aba1-874ce4081bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:07.412417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df723b7d-48e2-4a24-aba1-874ce4081bb8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:07.423981 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1174/2338] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:03:07.428091 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df723b7d-48e2-4a24-aba1-874ce4081bb8 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:07.438333 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df723b7d-48e2-4a24-aba1-874ce4081bb8 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:07.443371 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ef514-36ad-4e3d-a0ef-35addbcca465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:07.445189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ef514-36ad-4e3d-a0ef-35addbcca465 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:07.445493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ef514-36ad-4e3d-a0ef-35addbcca465 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:07.445759 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ef514-36ad-4e3d-a0ef-35addbcca465 admin admin] PATH_INFO: `/v3/projects/3a65b26d61c14a3ca7b7cb6843ecdb1e/users/693cf828718e4b55bc3b8c4191b62ea6/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:07.461144 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ef514-36ad-4e3d-a0ef-35addbcca465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a65b26d61c14a3ca7b7cb6843ecdb1e, user_id=693cf828718e4b55bc3b8c4191b62ea6, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:07.463945 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ef514-36ad-4e3d-a0ef-35addbcca465 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:07.557494 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1175/2339] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:03:07 2022] PUT /identity/v3/projects/3a65b26d61c14a3ca7b7cb6843ecdb1e/users/693cf828718e4b55bc3b8c4191b62ea6/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:07.568092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8126fb-8f7d-4363-afac-126adac93143 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:07.568367 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8126fb-8f7d-4363-afac-126adac93143 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:07.568641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8126fb-8f7d-4363-afac-126adac93143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:07.596736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-6a8126fb-8f7d-4363-afac-126adac93143 None None] MFA Rules not processed for user `693cf828718e4b55bc3b8c4191b62ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:07.597445 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8da398f1-82fc-4361-ab64-ad70f58f2d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b3173f84834cbb99b92cba4d3d7df1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:07.597973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-6a8126fb-8f7d-4363-afac-126adac93143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:07.598125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8da398f1-82fc-4361-ab64-ad70f58f2d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b3173f84834cbb99b92cba4d3d7df1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:07.660988 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8da398f1-82fc-4361-ab64-ad70f58f2d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b3173f84834cbb99b92cba4d3d7df1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:07.664466 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1176/2340] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:03:07.665279 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8126fb-8f7d-4363-afac-126adac93143 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:07.666599 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-6a8126fb-8f7d-4363-afac-126adac93143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:07.677918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8da398f1-82fc-4361-ab64-ad70f58f2d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b3173f84834cbb99b92cba4d3d7df1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:07.685251 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8da398f1-82fc-4361-ab64-ad70f58f2d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b3173f84834cbb99b92cba4d3d7df1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:07.691843 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1165/2341] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:03:07 2022] DELETE /identity/v3/users/88b3173f84834cbb99b92cba4d3d7df1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:07.693109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da398f1-82fc-4361-ab64-ad70f58f2d29 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:07.694950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-8da398f1-82fc-4361-ab64-ad70f58f2d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:07.732277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8126fb-8f7d-4363-afac-126adac93143 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:07.752548 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da398f1-82fc-4361-ab64-ad70f58f2d29 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:07.756180 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20a763-8ed1-47b8-9620-6d7f16c1251d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65583446d2e40a69dff534b73e8fa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:07.756815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20a763-8ed1-47b8-9620-6d7f16c1251d service glance] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:07.757094 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20a763-8ed1-47b8-9620-6d7f16c1251d service glance] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:07.757357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20a763-8ed1-47b8-9620-6d7f16c1251d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:07.787601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf1b54-325e-4f90-9c79-222bc35c43a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:07.788461 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf1b54-325e-4f90-9c79-222bc35c43a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:07.788745 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf1b54-325e-4f90-9c79-222bc35c43a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:07.789022 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf1b54-325e-4f90-9c79-222bc35c43a4 admin admin] PATH_INFO: `/v3/projects/50c4b750f51545f586a84938968a2536` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:07.790216 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf1b54-325e-4f90-9c79-222bc35c43a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c4b750f51545f586a84938968a2536)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:07.792182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf1b54-325e-4f90-9c79-222bc35c43a4 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:07.818598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20a763-8ed1-47b8-9620-6d7f16c1251d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:07.820112 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20a763-8ed1-47b8-9620-6d7f16c1251d service glance] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:07.829159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1166/2342] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:03:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:03:07.830572 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605405-2a17-407a-8a83-30a381c795ab None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:07.830866 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605405-2a17-407a-8a83-30a381c795ab None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:07.831147 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605405-2a17-407a-8a83-30a381c795ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:07.849180 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-b0605405-2a17-407a-8a83-30a381c795ab None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:07.849380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b0605405-2a17-407a-8a83-30a381c795ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:07.861037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1167/2343] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:07.869656 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0605405-2a17-407a-8a83-30a381c795ab None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:07.871081 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b0605405-2a17-407a-8a83-30a381c795ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:07.898666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a9bf1b54-325e-4f90-9c79-222bc35c43a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c4b750f51545f586a84938968a2536', 'request_id': 'req-a9bf1b54-325e-4f90-9c79-222bc35c43a4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:07.909197 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a9bf1b54-325e-4f90-9c79-222bc35c43a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c4b750f51545f586a84938968a2536', 'request_id': 'req-a9bf1b54-325e-4f90-9c79-222bc35c43a4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:07.947659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0605405-2a17-407a-8a83-30a381c795ab None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:07.981059 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a9bf1b54-325e-4f90-9c79-222bc35c43a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c4b750f51545f586a84938968a2536', 'request_id': 'req-a9bf1b54-325e-4f90-9c79-222bc35c43a4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:07.997460 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a9bf1b54-325e-4f90-9c79-222bc35c43a4 admin admin] The token cache is being invalidate because project 50c4b750f51545f586a84938968a2536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:03:07.997881 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a9bf1b54-325e-4f90-9c79-222bc35c43a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:07.998184 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292b51c-412a-446d-9ef8-56b999fb9af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:07.998883 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a9bf1b54-325e-4f90-9c79-222bc35c43a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:07.999070 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b51c-412a-446d-9ef8-56b999fb9af5 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:07.999354 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b51c-412a-446d-9ef8-56b999fb9af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:07.999660 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b51c-412a-446d-9ef8-56b999fb9af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:08.004435 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5292b51c-412a-446d-9ef8-56b999fb9af5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:08.010752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1177/2344] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:03:07 2022] DELETE /identity/v3/projects/50c4b750f51545f586a84938968a2536 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:08.010752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b20db0-8a19-40bd-a6c9-f78a034d7793 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:08.010752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b20db0-8a19-40bd-a6c9-f78a034d7793 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:08.010752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b20db0-8a19-40bd-a6c9-f78a034d7793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:08.039567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-66b20db0-8a19-40bd-a6c9-f78a034d7793 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:08.040801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-66b20db0-8a19-40bd-a6c9-f78a034d7793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:08.084931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292b51c-412a-446d-9ef8-56b999fb9af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:08.087354 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292b51c-412a-446d-9ef8-56b999fb9af5 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:08.099635 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1168/2345] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:03:08.133319 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1178/2346] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:08.141084 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6853c3-60f8-4713-ac10-c893191955c5 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:08.141377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6853c3-60f8-4713-ac10-c893191955c5 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:08.141681 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6853c3-60f8-4713-ac10-c893191955c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:08.159755 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-0a6853c3-60f8-4713-ac10-c893191955c5 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:08.160933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0a6853c3-60f8-4713-ac10-c893191955c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:08.168942 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1169/2347] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:08.173830 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b20db0-8a19-40bd-a6c9-f78a034d7793 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:08.183447 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b20db0-8a19-40bd-a6c9-f78a034d7793 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:08.188967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bad1b-3ea9-4140-97ec-397dfb0e7236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:08.189509 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bad1b-3ea9-4140-97ec-397dfb0e7236 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:08.189793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bad1b-3ea9-4140-97ec-397dfb0e7236 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:08.190071 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bad1b-3ea9-4140-97ec-397dfb0e7236 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:08.190830 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bad1b-3ea9-4140-97ec-397dfb0e7236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:03:08.191100 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bad1b-3ea9-4140-97ec-397dfb0e7236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:08.192758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bad1b-3ea9-4140-97ec-397dfb0e7236 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:08.207856 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1179/2348] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:03:08.208992 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6853c3-60f8-4713-ac10-c893191955c5 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:08.219325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6853c3-60f8-4713-ac10-c893191955c5 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:08.223922 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a22d8-cb65-4466-a702-346b45240393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:08.224577 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a22d8-cb65-4466-a702-346b45240393 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:08.224857 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a22d8-cb65-4466-a702-346b45240393 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:08.225136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a22d8-cb65-4466-a702-346b45240393 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:08.225828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a22d8-cb65-4466-a702-346b45240393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:08.227764 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a22d8-cb65-4466-a702-346b45240393 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:08.330469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1170/2349] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:03:08 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:03:08.334830 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bad1b-3ea9-4140-97ec-397dfb0e7236 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:08.346037 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bad1b-3ea9-4140-97ec-397dfb0e7236 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:08.405657 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e1794-7d4c-40ba-a16a-ab183b055717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:08.407790 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e1794-7d4c-40ba-a16a-ab183b055717 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:08.408255 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e1794-7d4c-40ba-a16a-ab183b055717 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:08.408538 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e1794-7d4c-40ba-a16a-ab183b055717 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:08.409934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e1794-7d4c-40ba-a16a-ab183b055717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:08.411613 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e1794-7d4c-40ba-a16a-ab183b055717 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:08.519253 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1180/2350] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:03:08 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:03:08.523258 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a22d8-cb65-4466-a702-346b45240393 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:08.534526 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a22d8-cb65-4466-a702-346b45240393 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:08.539852 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d167bb-6953-480d-bd4a-0a0220169f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:08.540539 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d167bb-6953-480d-bd4a-0a0220169f87 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:08.540825 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d167bb-6953-480d-bd4a-0a0220169f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:08.541571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d167bb-6953-480d-bd4a-0a0220169f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:08.541936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d167bb-6953-480d-bd4a-0a0220169f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:08.543657 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d167bb-6953-480d-bd4a-0a0220169f87 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:08.545023 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e1794-7d4c-40ba-a16a-ab183b055717 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:08.546959 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-e90e1794-7d4c-40ba-a16a-ab183b055717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:08.560966 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e1794-7d4c-40ba-a16a-ab183b055717 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:08.562540 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1171/2351] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:03:08.567005 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93e34f-2d8b-4113-9fd3-fe20e62e34fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:08.568084 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93e34f-2d8b-4113-9fd3-fe20e62e34fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:08.568421 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93e34f-2d8b-4113-9fd3-fe20e62e34fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:08.568892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93e34f-2d8b-4113-9fd3-fe20e62e34fb admin admin] PATH_INFO: `/v3/projects/2b4c572d2825408f93a7e5fbba463627` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:08.570178 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93e34f-2d8b-4113-9fd3-fe20e62e34fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4c572d2825408f93a7e5fbba463627)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:08.571543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d167bb-6953-480d-bd4a-0a0220169f87 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:08.572167 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93e34f-2d8b-4113-9fd3-fe20e62e34fb admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:08.583189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d167bb-6953-480d-bd4a-0a0220169f87 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:08.588812 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccea86-47a2-4ed0-88dd-eb6669fbb87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:08.589625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccea86-47a2-4ed0-88dd-eb6669fbb87b admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:08.589917 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccea86-47a2-4ed0-88dd-eb6669fbb87b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:08.590193 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccea86-47a2-4ed0-88dd-eb6669fbb87b admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:08.591369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccea86-47a2-4ed0-88dd-eb6669fbb87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:08.594356 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccea86-47a2-4ed0-88dd-eb6669fbb87b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:08.606977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1172/2352] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:03:08.618395 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccea86-47a2-4ed0-88dd-eb6669fbb87b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:08.634544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccea86-47a2-4ed0-88dd-eb6669fbb87b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:08.641947 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe49a56-c9fe-4fab-91c0-26231dbf69cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:08.643338 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe49a56-c9fe-4fab-91c0-26231dbf69cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:08.643839 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe49a56-c9fe-4fab-91c0-26231dbf69cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:08.644303 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe49a56-c9fe-4fab-91c0-26231dbf69cd admin admin] PATH_INFO: `/v3/projects/7d9d63b3b1034d15a8bdbc844089751e/users/48de21ec60e64474a783099931b286bf/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:08.672078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe49a56-c9fe-4fab-91c0-26231dbf69cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9d63b3b1034d15a8bdbc844089751e, user_id=48de21ec60e64474a783099931b286bf, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:08.679369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe49a56-c9fe-4fab-91c0-26231dbf69cd admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:08.686974 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cf93e34f-2d8b-4113-9fd3-fe20e62e34fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4c572d2825408f93a7e5fbba463627', 'request_id': 'req-cf93e34f-2d8b-4113-9fd3-fe20e62e34fb'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:08.693716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cf93e34f-2d8b-4113-9fd3-fe20e62e34fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4c572d2825408f93a7e5fbba463627', 'request_id': 'req-cf93e34f-2d8b-4113-9fd3-fe20e62e34fb'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:08.773339 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1173/2353] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:03:08 2022] PUT /identity/v3/projects/7d9d63b3b1034d15a8bdbc844089751e/users/48de21ec60e64474a783099931b286bf/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:08.784517 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997021a-b257-4bb8-a69a-7ad1105d8a79 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:08.784804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997021a-b257-4bb8-a69a-7ad1105d8a79 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:08.785081 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997021a-b257-4bb8-a69a-7ad1105d8a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:08.798013 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cf93e34f-2d8b-4113-9fd3-fe20e62e34fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4c572d2825408f93a7e5fbba463627', 'request_id': 'req-cf93e34f-2d8b-4113-9fd3-fe20e62e34fb'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:08.809763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cf93e34f-2d8b-4113-9fd3-fe20e62e34fb admin admin] The token cache is being invalidate because project 2b4c572d2825408f93a7e5fbba463627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:03:08.810063 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cf93e34f-2d8b-4113-9fd3-fe20e62e34fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:08.810746 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cf93e34f-2d8b-4113-9fd3-fe20e62e34fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:08.812909 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-c997021a-b257-4bb8-a69a-7ad1105d8a79 None None] MFA Rules not processed for user `48de21ec60e64474a783099931b286bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:08.814229 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c997021a-b257-4bb8-a69a-7ad1105d8a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:08.815750 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1181/2354] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:03:08 2022] DELETE /identity/v3/projects/2b4c572d2825408f93a7e5fbba463627 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:03:08.817994 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5942c-1019-4868-987d-74a7c4e7390d None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:08.818283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5942c-1019-4868-987d-74a7c4e7390d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:08.818599 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5942c-1019-4868-987d-74a7c4e7390d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:08.837609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-bce5942c-1019-4868-987d-74a7c4e7390d None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:08.838975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-bce5942c-1019-4868-987d-74a7c4e7390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:08.890354 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1174/2355] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:03:08.902414 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997021a-b257-4bb8-a69a-7ad1105d8a79 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:08.904057 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c997021a-b257-4bb8-a69a-7ad1105d8a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:08.932892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1182/2356] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:03:08.935663 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a0dd2-5d03-4036-84f5-7daa0655ae00 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:08.936704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a0dd2-5d03-4036-84f5-7daa0655ae00 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:08.936704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a0dd2-5d03-4036-84f5-7daa0655ae00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:08.959682 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-2f9a0dd2-5d03-4036-84f5-7daa0655ae00 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:08.962109 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-2f9a0dd2-5d03-4036-84f5-7daa0655ae00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:08.972032 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1183/2357] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:03:08.976503 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a0dd2-5d03-4036-84f5-7daa0655ae00 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:08.986116 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997021a-b257-4bb8-a69a-7ad1105d8a79 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:08.989207 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a0dd2-5d03-4036-84f5-7daa0655ae00 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:08.990315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e45b5c-e0f1-4c2b-a57a-9f2fa109101a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:08.991264 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e45b5c-e0f1-4c2b-a57a-9f2fa109101a service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:08.991264 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e45b5c-e0f1-4c2b-a57a-9f2fa109101a service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:08.991563 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e45b5c-e0f1-4c2b-a57a-9f2fa109101a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:08.994284 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50140640-77e8-44a7-8353-24662c2cc823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:08.994999 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50140640-77e8-44a7-8353-24662c2cc823 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:08.995363 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50140640-77e8-44a7-8353-24662c2cc823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:08.995935 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50140640-77e8-44a7-8353-24662c2cc823 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:08.996784 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50140640-77e8-44a7-8353-24662c2cc823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:03:08.997160 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50140640-77e8-44a7-8353-24662c2cc823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:08.999382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50140640-77e8-44a7-8353-24662c2cc823 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:09.001508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e45b5c-e0f1-4c2b-a57a-9f2fa109101a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:09.003187 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e45b5c-e0f1-4c2b-a57a-9f2fa109101a service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:09.014671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1175/2358] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:03:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:03:09.018065 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1184/2359] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:03:09.019057 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e45b5c-e0f1-4c2b-a57a-9f2fa109101a service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:09.031122 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e45b5c-e0f1-4c2b-a57a-9f2fa109101a service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:09.036046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dec6df-517d-49c1-af1e-c7b4828c4ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:09.038105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dec6df-517d-49c1-af1e-c7b4828c4ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:09.038402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dec6df-517d-49c1-af1e-c7b4828c4ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:09.038666 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dec6df-517d-49c1-af1e-c7b4828c4ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:09.039479 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dec6df-517d-49c1-af1e-c7b4828c4ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:09.041334 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dec6df-517d-49c1-af1e-c7b4828c4ef7 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:09.172159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1176/2360] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:03:09 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:03:09.176450 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50140640-77e8-44a7-8353-24662c2cc823 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:09.188399 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50140640-77e8-44a7-8353-24662c2cc823 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:09.271358 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb4ad7-38d3-49f0-a698-479a383fd8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:09.272277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb4ad7-38d3-49f0-a698-479a383fd8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:09.272711 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb4ad7-38d3-49f0-a698-479a383fd8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:09.273082 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb4ad7-38d3-49f0-a698-479a383fd8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:09.273793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb4ad7-38d3-49f0-a698-479a383fd8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:09.275999 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb4ad7-38d3-49f0-a698-479a383fd8a1 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:09.414165 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1185/2361] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:03:09 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:03:09.416310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dec6df-517d-49c1-af1e-c7b4828c4ef7 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:09.427266 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dec6df-517d-49c1-af1e-c7b4828c4ef7 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:09.432353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f519c2f-4f62-47da-b139-e125af3c0cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:09.433092 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f519c2f-4f62-47da-b139-e125af3c0cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:09.433438 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f519c2f-4f62-47da-b139-e125af3c0cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:09.433776 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f519c2f-4f62-47da-b139-e125af3c0cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:09.434584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f519c2f-4f62-47da-b139-e125af3c0cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:09.438043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f519c2f-4f62-47da-b139-e125af3c0cf9 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:09.455169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1177/2362] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:03:09.456512 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb4ad7-38d3-49f0-a698-479a383fd8a1 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:09.469920 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb4ad7-38d3-49f0-a698-479a383fd8a1 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:09.477305 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571433b-c228-4d1d-bb5a-822ad193209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:09.478215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571433b-c228-4d1d-bb5a-822ad193209c admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:09.478514 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571433b-c228-4d1d-bb5a-822ad193209c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:09.478788 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571433b-c228-4d1d-bb5a-822ad193209c admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:09.480260 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571433b-c228-4d1d-bb5a-822ad193209c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:09.481511 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571433b-c228-4d1d-bb5a-822ad193209c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:09.498379 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1186/2363] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:03:09.499498 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f519c2f-4f62-47da-b139-e125af3c0cf9 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:09.510611 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f519c2f-4f62-47da-b139-e125af3c0cf9 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:09.517549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa2661-9344-4424-a839-8d86721cfbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:09.519044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa2661-9344-4424-a839-8d86721cfbbd admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:09.519044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa2661-9344-4424-a839-8d86721cfbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:09.519044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa2661-9344-4424-a839-8d86721cfbbd admin admin] PATH_INFO: `/v3/projects/5699872c8cb440dd860801aa699d0699/users/a918aee2dc2d4024ad3d9d0f9646a1fc/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:09.539607 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa2661-9344-4424-a839-8d86721cfbbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5699872c8cb440dd860801aa699d0699, user_id=a918aee2dc2d4024ad3d9d0f9646a1fc, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:09.542164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa2661-9344-4424-a839-8d86721cfbbd admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:09.626491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1178/2364] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:03:09 2022] PUT /identity/v3/projects/5699872c8cb440dd860801aa699d0699/users/a918aee2dc2d4024ad3d9d0f9646a1fc/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:09.631674 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e50507-bef4-4473-bd6c-04c7e12bdf15 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:09.631965 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e50507-bef4-4473-bd6c-04c7e12bdf15 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:09.632372 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e50507-bef4-4473-bd6c-04c7e12bdf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:09.650558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-25e50507-bef4-4473-bd6c-04c7e12bdf15 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:09.651907 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-25e50507-bef4-4473-bd6c-04c7e12bdf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:09.715755 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1187/2365] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:09.726621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa2661-9344-4424-a839-8d86721cfbbd admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:09.729216 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-6baa2661-9344-4424-a839-8d86721cfbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:09.826276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa2661-9344-4424-a839-8d86721cfbbd admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:09.830623 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158224c-fa53-498f-b777-329641c9dfa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:09.843205 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158224c-fa53-498f-b777-329641c9dfa2 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:09.843205 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158224c-fa53-498f-b777-329641c9dfa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:09.843205 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158224c-fa53-498f-b777-329641c9dfa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:09.844884 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158224c-fa53-498f-b777-329641c9dfa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:09.846575 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158224c-fa53-498f-b777-329641c9dfa2 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:09.860317 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1179/2366] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:03:16.120200 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3b6ba-302d-4e59-85d2-13b0e1b32ce1 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:16.120685 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3b6ba-302d-4e59-85d2-13b0e1b32ce1 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:16.121103 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3b6ba-302d-4e59-85d2-13b0e1b32ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:16.149683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-08c3b6ba-302d-4e59-85d2-13b0e1b32ce1 None None] MFA Rules not processed for user `a918aee2dc2d4024ad3d9d0f9646a1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:16.151110 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-08c3b6ba-302d-4e59-85d2-13b0e1b32ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:16.231573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1188/2367] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:16.231837 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158224c-fa53-498f-b777-329641c9dfa2 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:16.233853 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-4158224c-fa53-498f-b777-329641c9dfa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:16.236660 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3b6ba-302d-4e59-85d2-13b0e1b32ce1 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:16.248412 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3b6ba-302d-4e59-85d2-13b0e1b32ce1 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:16.253474 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b955163-72ab-495f-b79d-bf40e83d83dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:16.254135 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b955163-72ab-495f-b79d-bf40e83d83dd admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:16.254422 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b955163-72ab-495f-b79d-bf40e83d83dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:16.254701 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b955163-72ab-495f-b79d-bf40e83d83dd admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:16.255398 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b955163-72ab-495f-b79d-bf40e83d83dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:16.257359 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b955163-72ab-495f-b79d-bf40e83d83dd admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:16.326914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158224c-fa53-498f-b777-329641c9dfa2 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:16.332073 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504435e-e5f0-4337-aadf-f919b4365423 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8855284b10c64b8ca367e3c30b5f66fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:16.332753 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504435e-e5f0-4337-aadf-f919b4365423 service placement] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:16.333040 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504435e-e5f0-4337-aadf-f919b4365423 service placement] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:16.333310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504435e-e5f0-4337-aadf-f919b4365423 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:16.335137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-6504435e-e5f0-4337-aadf-f919b4365423 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:16.347900 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504435e-e5f0-4337-aadf-f919b4365423 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:16.349428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504435e-e5f0-4337-aadf-f919b4365423 service placement] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:16.359946 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1180/2368] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:03:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:03:16.365630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1189/2369] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:03:16 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:03:16.369954 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504435e-e5f0-4337-aadf-f919b4365423 service placement] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:16.381760 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504435e-e5f0-4337-aadf-f919b4365423 service placement] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:16.438747 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940b690-017c-435b-8547-f4cd141a13fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:16.439488 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940b690-017c-435b-8547-f4cd141a13fe admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:16.439733 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940b690-017c-435b-8547-f4cd141a13fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:16.440011 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940b690-017c-435b-8547-f4cd141a13fe admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:16.440712 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940b690-017c-435b-8547-f4cd141a13fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:16.442686 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940b690-017c-435b-8547-f4cd141a13fe admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:16.553740 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1181/2370] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:03:16 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:03:16.557975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b955163-72ab-495f-b79d-bf40e83d83dd admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:16.568384 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b955163-72ab-495f-b79d-bf40e83d83dd admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:16.573053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f172d5-823c-44fb-a77f-3fa7fd0b47cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:16.573809 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f172d5-823c-44fb-a77f-3fa7fd0b47cb admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:16.574049 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f172d5-823c-44fb-a77f-3fa7fd0b47cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:16.574329 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f172d5-823c-44fb-a77f-3fa7fd0b47cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:16.575061 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f172d5-823c-44fb-a77f-3fa7fd0b47cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:16.579119 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f172d5-823c-44fb-a77f-3fa7fd0b47cb admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:16.590151 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1190/2371] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:03:16.595017 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940b690-017c-435b-8547-f4cd141a13fe admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:16.607717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940b690-017c-435b-8547-f4cd141a13fe admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:16.614523 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb6a4b-e70a-46f9-b645-a16817f6aff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:16.615882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb6a4b-e70a-46f9-b645-a16817f6aff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:16.616227 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb6a4b-e70a-46f9-b645-a16817f6aff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:16.616570 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb6a4b-e70a-46f9-b645-a16817f6aff5 admin admin] PATH_INFO: `/v3/projects/ae3a46736932438bb0983a426a703469/users/5c57c3b0b4c7457bb818f9f5c19aed66/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:16.642769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb6a4b-e70a-46f9-b645-a16817f6aff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3a46736932438bb0983a426a703469, user_id=5c57c3b0b4c7457bb818f9f5c19aed66, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:16.644999 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb6a4b-e70a-46f9-b645-a16817f6aff5 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:16.714388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1182/2372] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:03:16 2022] PUT /identity/v3/projects/ae3a46736932438bb0983a426a703469/users/5c57c3b0b4c7457bb818f9f5c19aed66/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:03:16.718714 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f172d5-823c-44fb-a77f-3fa7fd0b47cb admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:16.729481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f172d5-823c-44fb-a77f-3fa7fd0b47cb admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:16.799639 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775131e-8ec2-4634-99da-0eb163f8a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:16.799639 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775131e-8ec2-4634-99da-0eb163f8a7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:16.799639 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775131e-8ec2-4634-99da-0eb163f8a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:16.799639 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775131e-8ec2-4634-99da-0eb163f8a7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:16.799994 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775131e-8ec2-4634-99da-0eb163f8a7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:16.799994 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775131e-8ec2-4634-99da-0eb163f8a7a7 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:16.806332 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1191/2373] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:03:16.810315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb6a4b-e70a-46f9-b645-a16817f6aff5 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:16.821281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb6a4b-e70a-46f9-b645-a16817f6aff5 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:16.826566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07e541-4eec-4870-968d-040739e1bf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:16.826922 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07e541-4eec-4870-968d-040739e1bf11 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:16.827204 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07e541-4eec-4870-968d-040739e1bf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:16.827507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07e541-4eec-4870-968d-040739e1bf11 admin admin] PATH_INFO: `/v3/projects/ae3a46736932438bb0983a426a703469/users/5c57c3b0b4c7457bb818f9f5c19aed66/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:16.829527 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07e541-4eec-4870-968d-040739e1bf11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3a46736932438bb0983a426a703469, user_id=5c57c3b0b4c7457bb818f9f5c19aed66, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:16.832192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07e541-4eec-4870-968d-040739e1bf11 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:16.846378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1183/2374] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:03:16 2022] PUT /identity/v3/projects/ae3a46736932438bb0983a426a703469/users/5c57c3b0b4c7457bb818f9f5c19aed66/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:22.597757 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94520f7-7847-49e0-a08c-dc6a36a003a0 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:22.599393 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94520f7-7847-49e0-a08c-dc6a36a003a0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:22.599923 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94520f7-7847-49e0-a08c-dc6a36a003a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:22.623907 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-d94520f7-7847-49e0-a08c-dc6a36a003a0 None None] MFA Rules not processed for user `ff1dfe51ba0d4b0d938d7fa10e154eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:22.625958 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d94520f7-7847-49e0-a08c-dc6a36a003a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:22.691950 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1192/2375] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:23.441107 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d9f70-9d33-4dca-bdec-fb7bd426986b None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:23.441978 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d9f70-9d33-4dca-bdec-fb7bd426986b None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:23.442427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d9f70-9d33-4dca-bdec-fb7bd426986b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:23.537745 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-de2d9f70-9d33-4dca-bdec-fb7bd426986b None None] MFA Rules not processed for user `5c57c3b0b4c7457bb818f9f5c19aed66`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:23.539336 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-de2d9f70-9d33-4dca-bdec-fb7bd426986b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:23.725358 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1184/2376] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:23.737066 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94520f7-7847-49e0-a08c-dc6a36a003a0 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:23.738953 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d94520f7-7847-49e0-a08c-dc6a36a003a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:23.875953 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94520f7-7847-49e0-a08c-dc6a36a003a0 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:23.884747 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa295c-849c-4bad-9e8d-72c4f9a1c031 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:23.885548 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa295c-849c-4bad-9e8d-72c4f9a1c031 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:23.885958 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa295c-849c-4bad-9e8d-72c4f9a1c031 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:23.886329 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa295c-849c-4bad-9e8d-72c4f9a1c031 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:23.949901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa295c-849c-4bad-9e8d-72c4f9a1c031 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:23.951631 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa295c-849c-4bad-9e8d-72c4f9a1c031 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:23.965983 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1193/2377] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:03:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:03:34.678868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d9f70-9d33-4dca-bdec-fb7bd426986b None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:34.680522 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-de2d9f70-9d33-4dca-bdec-fb7bd426986b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:34.750206 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d9f70-9d33-4dca-bdec-fb7bd426986b None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:34.755184 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5ae97-1579-44d6-9742-10834acea439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:34.756227 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5ae97-1579-44d6-9742-10834acea439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:34.756514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5ae97-1579-44d6-9742-10834acea439 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:34.756844 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5ae97-1579-44d6-9742-10834acea439 admin admin] PATH_INFO: `/v3/users/f98ed54ebbfd4c10aeff826dd1765150` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:34.758040 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5ae97-1579-44d6-9742-10834acea439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98ed54ebbfd4c10aeff826dd1765150)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:34.760115 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5ae97-1579-44d6-9742-10834acea439 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:34.941099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-0ff5ae97-1579-44d6-9742-10834acea439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98ed54ebbfd4c10aeff826dd1765150'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:34.941792 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-0ff5ae97-1579-44d6-9742-10834acea439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98ed54ebbfd4c10aeff826dd1765150'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:35.019694 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-0ff5ae97-1579-44d6-9742-10834acea439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98ed54ebbfd4c10aeff826dd1765150'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:35.031965 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-0ff5ae97-1579-44d6-9742-10834acea439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98ed54ebbfd4c10aeff826dd1765150'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:35.040880 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-0ff5ae97-1579-44d6-9742-10834acea439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98ed54ebbfd4c10aeff826dd1765150'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:35.047689 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1185/2378] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:03:34 2022] DELETE /identity/v3/users/f98ed54ebbfd4c10aeff826dd1765150 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:35.318674 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa295c-849c-4bad-9e8d-72c4f9a1c031 service nova] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:35.330498 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa295c-849c-4bad-9e8d-72c4f9a1c031 service nova] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:35.397396 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74813459-70db-4e1f-9787-ed9339fdf06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:35.398265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74813459-70db-4e1f-9787-ed9339fdf06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:35.398546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74813459-70db-4e1f-9787-ed9339fdf06d admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:35.398823 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74813459-70db-4e1f-9787-ed9339fdf06d admin admin] PATH_INFO: `/v3/projects/960767a629b04fc39736132776c6b2e1` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:35.400082 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74813459-70db-4e1f-9787-ed9339fdf06d admin admin] RBAC: Authorizing `identity:delete_project(project_id=960767a629b04fc39736132776c6b2e1)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:35.401980 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74813459-70db-4e1f-9787-ed9339fdf06d admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:35.501565 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-74813459-70db-4e1f-9787-ed9339fdf06d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960767a629b04fc39736132776c6b2e1', 'request_id': 'req-74813459-70db-4e1f-9787-ed9339fdf06d'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:35.510166 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-74813459-70db-4e1f-9787-ed9339fdf06d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960767a629b04fc39736132776c6b2e1', 'request_id': 'req-74813459-70db-4e1f-9787-ed9339fdf06d'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:35.580927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-74813459-70db-4e1f-9787-ed9339fdf06d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960767a629b04fc39736132776c6b2e1', 'request_id': 'req-74813459-70db-4e1f-9787-ed9339fdf06d'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:35.592773 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-74813459-70db-4e1f-9787-ed9339fdf06d admin admin] The token cache is being invalidate because project 960767a629b04fc39736132776c6b2e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:03:35.593748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-74813459-70db-4e1f-9787-ed9339fdf06d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:35.594092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-74813459-70db-4e1f-9787-ed9339fdf06d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:35.595948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1194/2379] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:03:35 2022] DELETE /identity/v3/projects/960767a629b04fc39736132776c6b2e1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:35.601234 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e966a19-f22a-44d8-bc53-0ac362433faa None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:35.601528 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e966a19-f22a-44d8-bc53-0ac362433faa None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:35.601843 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e966a19-f22a-44d8-bc53-0ac362433faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:35.622799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-0e966a19-f22a-44d8-bc53-0ac362433faa None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:35.624154 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0e966a19-f22a-44d8-bc53-0ac362433faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:35.700380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1186/2380] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:03:35.712924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682247c3-cd9b-49a5-a1e9-2863c8770af7 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:35.713483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682247c3-cd9b-49a5-a1e9-2863c8770af7 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:35.713792 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682247c3-cd9b-49a5-a1e9-2863c8770af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:35.734227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-682247c3-cd9b-49a5-a1e9-2863c8770af7 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:35.735614 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-682247c3-cd9b-49a5-a1e9-2863c8770af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:35.744420 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1195/2381] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:35.748791 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e966a19-f22a-44d8-bc53-0ac362433faa None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:35.758824 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e966a19-f22a-44d8-bc53-0ac362433faa None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:35.763536 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22212c44-a114-4d1c-adb8-db18749fc39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:35.764230 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22212c44-a114-4d1c-adb8-db18749fc39f admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:35.764525 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22212c44-a114-4d1c-adb8-db18749fc39f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:35.768338 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22212c44-a114-4d1c-adb8-db18749fc39f admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:35.768338 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22212c44-a114-4d1c-adb8-db18749fc39f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:03:35.768338 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22212c44-a114-4d1c-adb8-db18749fc39f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:35.768338 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22212c44-a114-4d1c-adb8-db18749fc39f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:35.779466 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1187/2382] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:03:35.784089 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682247c3-cd9b-49a5-a1e9-2863c8770af7 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:35.794764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682247c3-cd9b-49a5-a1e9-2863c8770af7 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:35.800853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d4026-1703-4587-acc8-9b5251487c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:35.801521 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d4026-1703-4587-acc8-9b5251487c21 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:35.801808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d4026-1703-4587-acc8-9b5251487c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:35.802113 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d4026-1703-4587-acc8-9b5251487c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:35.802926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d4026-1703-4587-acc8-9b5251487c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:35.804877 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d4026-1703-4587-acc8-9b5251487c21 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:35.879056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1196/2383] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:03:35 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:03:35.883167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22212c44-a114-4d1c-adb8-db18749fc39f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:35.893309 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22212c44-a114-4d1c-adb8-db18749fc39f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:35.953771 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500583f-b59e-4309-a7f7-be38f1dc3b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:35.954565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500583f-b59e-4309-a7f7-be38f1dc3b14 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:35.955032 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500583f-b59e-4309-a7f7-be38f1dc3b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:35.955405 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500583f-b59e-4309-a7f7-be38f1dc3b14 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:35.956329 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500583f-b59e-4309-a7f7-be38f1dc3b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:35.958295 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500583f-b59e-4309-a7f7-be38f1dc3b14 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:36.069140 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1188/2384] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:03:35 2022] POST /identity/v3/users => generated 283 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:03:36.073680 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d4026-1703-4587-acc8-9b5251487c21 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:36.085380 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d4026-1703-4587-acc8-9b5251487c21 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:36.090129 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4de64-a8ec-46a1-ac08-6c4292f83008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:36.090802 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4de64-a8ec-46a1-ac08-6c4292f83008 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:36.091084 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4de64-a8ec-46a1-ac08-6c4292f83008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:36.091360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4de64-a8ec-46a1-ac08-6c4292f83008 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:36.092111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4de64-a8ec-46a1-ac08-6c4292f83008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:36.093815 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4de64-a8ec-46a1-ac08-6c4292f83008 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:36.105818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1197/2385] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:03:36.110261 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500583f-b59e-4309-a7f7-be38f1dc3b14 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:36.122478 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500583f-b59e-4309-a7f7-be38f1dc3b14 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:36.127091 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef7a2a-bed2-4ae1-91e5-345637054f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:36.127788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef7a2a-bed2-4ae1-91e5-345637054f56 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:36.128125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef7a2a-bed2-4ae1-91e5-345637054f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:36.128544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef7a2a-bed2-4ae1-91e5-345637054f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:36.129338 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef7a2a-bed2-4ae1-91e5-345637054f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:36.130863 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef7a2a-bed2-4ae1-91e5-345637054f56 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:36.144359 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1189/2386] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:03:36.146361 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4de64-a8ec-46a1-ac08-6c4292f83008 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:36.156423 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4de64-a8ec-46a1-ac08-6c4292f83008 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:36.161825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e4cdc-3def-40a5-a1fa-083a1e4fafea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:36.162778 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e4cdc-3def-40a5-a1fa-083a1e4fafea admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:36.163093 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e4cdc-3def-40a5-a1fa-083a1e4fafea admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:36.163384 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e4cdc-3def-40a5-a1fa-083a1e4fafea admin admin] PATH_INFO: `/v3/projects/c59cde09cbd64712a87e8faa6112228a/users/15c3aac64e024b51b40b709d1d721f6d/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:36.178108 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e4cdc-3def-40a5-a1fa-083a1e4fafea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c59cde09cbd64712a87e8faa6112228a, user_id=15c3aac64e024b51b40b709d1d721f6d, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:36.180823 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e4cdc-3def-40a5-a1fa-083a1e4fafea admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:36.256814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1198/2387] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:03:36 2022] PUT /identity/v3/projects/c59cde09cbd64712a87e8faa6112228a/users/15c3aac64e024b51b40b709d1d721f6d/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:36.266859 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245430a2-fe9c-48cf-bcd5-cd84627dbde2 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:36.267165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245430a2-fe9c-48cf-bcd5-cd84627dbde2 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:36.267482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245430a2-fe9c-48cf-bcd5-cd84627dbde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:36.297215 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-245430a2-fe9c-48cf-bcd5-cd84627dbde2 None None] MFA Rules not processed for user `15c3aac64e024b51b40b709d1d721f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:36.298439 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-245430a2-fe9c-48cf-bcd5-cd84627dbde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:36.365113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1190/2388] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:36.371461 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e4cdc-3def-40a5-a1fa-083a1e4fafea admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:36.450318 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e4cdc-3def-40a5-a1fa-083a1e4fafea admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:36.461075 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57373b67-86e9-490f-b6fa-0fb208728b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:36.461882 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57373b67-86e9-490f-b6fa-0fb208728b43 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:36.462332 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57373b67-86e9-490f-b6fa-0fb208728b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:36.462766 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57373b67-86e9-490f-b6fa-0fb208728b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:36.463504 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57373b67-86e9-490f-b6fa-0fb208728b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:36.465447 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57373b67-86e9-490f-b6fa-0fb208728b43 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:36.569265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1199/2389] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:03:36 2022] POST /identity/v3/projects => generated 367 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:03:36.573379 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245430a2-fe9c-48cf-bcd5-cd84627dbde2 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:36.584656 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245430a2-fe9c-48cf-bcd5-cd84627dbde2 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:36.640547 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dd77d-242f-41e0-b3ee-fe67c993f75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:36.641213 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dd77d-242f-41e0-b3ee-fe67c993f75b admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:36.641493 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dd77d-242f-41e0-b3ee-fe67c993f75b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:36.641768 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dd77d-242f-41e0-b3ee-fe67c993f75b admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:36.642463 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314dd77d-242f-41e0-b3ee-fe67c993f75b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:36.645031 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314dd77d-242f-41e0-b3ee-fe67c993f75b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:36.751554 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1191/2390] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:03:36 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:03:36.755282 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57373b67-86e9-490f-b6fa-0fb208728b43 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:36.766620 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57373b67-86e9-490f-b6fa-0fb208728b43 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:36.772879 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db39a9c-54f8-4442-86c4-6b96f9561714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:36.775124 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db39a9c-54f8-4442-86c4-6b96f9561714 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:36.775637 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db39a9c-54f8-4442-86c4-6b96f9561714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:36.776113 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db39a9c-54f8-4442-86c4-6b96f9561714 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:36.776990 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db39a9c-54f8-4442-86c4-6b96f9561714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:36.778763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db39a9c-54f8-4442-86c4-6b96f9561714 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:36.791103 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1200/2391] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:03:36.795612 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dd77d-242f-41e0-b3ee-fe67c993f75b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:36.808374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dd77d-242f-41e0-b3ee-fe67c993f75b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:36.814856 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82056da-6775-4833-995c-650128b1722a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:36.816540 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82056da-6775-4833-995c-650128b1722a admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:36.820663 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82056da-6775-4833-995c-650128b1722a admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:36.820663 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82056da-6775-4833-995c-650128b1722a admin admin] PATH_INFO: `/v3/projects/c26fc863c0904090877c29e9cf6a1059/users/4a811e74204847768829e8ecbde03d84/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:36.832463 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82056da-6775-4833-995c-650128b1722a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26fc863c0904090877c29e9cf6a1059, user_id=4a811e74204847768829e8ecbde03d84, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:36.835192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82056da-6775-4833-995c-650128b1722a admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:36.937724 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1192/2392] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:03:36 2022] PUT /identity/v3/projects/c26fc863c0904090877c29e9cf6a1059/users/4a811e74204847768829e8ecbde03d84/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:36.942599 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db39a9c-54f8-4442-86c4-6b96f9561714 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:36.954677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db39a9c-54f8-4442-86c4-6b96f9561714 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:37.015551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd9a6e-ae7a-498b-a286-9fe096f965f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:37.015551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd9a6e-ae7a-498b-a286-9fe096f965f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:37.015551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd9a6e-ae7a-498b-a286-9fe096f965f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:37.015551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd9a6e-ae7a-498b-a286-9fe096f965f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:37.016258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd9a6e-ae7a-498b-a286-9fe096f965f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:37.017896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd9a6e-ae7a-498b-a286-9fe096f965f6 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:37.028193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1201/2393] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:03:37.032427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82056da-6775-4833-995c-650128b1722a admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:37.044825 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82056da-6775-4833-995c-650128b1722a admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:37.053228 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4897ec1-badd-4c25-a082-d5268fad4b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:37.054408 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4897ec1-badd-4c25-a082-d5268fad4b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:37.054752 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4897ec1-badd-4c25-a082-d5268fad4b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:37.055030 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4897ec1-badd-4c25-a082-d5268fad4b75 admin admin] PATH_INFO: `/v3/projects/c26fc863c0904090877c29e9cf6a1059/users/4a811e74204847768829e8ecbde03d84/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:37.057134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4897ec1-badd-4c25-a082-d5268fad4b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26fc863c0904090877c29e9cf6a1059, user_id=4a811e74204847768829e8ecbde03d84, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:37.060037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4897ec1-badd-4c25-a082-d5268fad4b75 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:37.073881 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1193/2394] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:03:37 2022] PUT /identity/v3/projects/c26fc863c0904090877c29e9cf6a1059/users/4a811e74204847768829e8ecbde03d84/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:03:37.084663 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb0113-6f01-446a-affb-a11fb6b09b5e None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:37.084948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb0113-6f01-446a-affb-a11fb6b09b5e None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:37.085227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb0113-6f01-446a-affb-a11fb6b09b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:37.111764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-38bb0113-6f01-446a-affb-a11fb6b09b5e None None] MFA Rules not processed for user `4a811e74204847768829e8ecbde03d84`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:37.113855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-38bb0113-6f01-446a-affb-a11fb6b09b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:37.181754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1202/2395] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:37.193848 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4897ec1-badd-4c25-a082-d5268fad4b75 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:37.195758 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b4897ec1-badd-4c25-a082-d5268fad4b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:37.261433 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4897ec1-badd-4c25-a082-d5268fad4b75 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:37.265103 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607f235-f53b-4deb-9eab-6b463e4049a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:37.265822 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607f235-f53b-4deb-9eab-6b463e4049a2 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:37.266150 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607f235-f53b-4deb-9eab-6b463e4049a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:37.266430 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607f235-f53b-4deb-9eab-6b463e4049a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:37.281301 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607f235-f53b-4deb-9eab-6b463e4049a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:37.282753 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607f235-f53b-4deb-9eab-6b463e4049a2 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:37.292717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1194/2396] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:03:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:03:40.131358 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb0113-6f01-446a-affb-a11fb6b09b5e None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:40.196936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb0113-6f01-446a-affb-a11fb6b09b5e None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:40.201727 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9516c-9c48-416b-a937-1deeed552803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:40.202352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9516c-9c48-416b-a937-1deeed552803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:40.202632 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9516c-9c48-416b-a937-1deeed552803 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:40.202937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9516c-9c48-416b-a937-1deeed552803 admin admin] PATH_INFO: `/v3/users/15c3aac64e024b51b40b709d1d721f6d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:40.204583 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9516c-9c48-416b-a937-1deeed552803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c3aac64e024b51b40b709d1d721f6d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:40.207995 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9516c-9c48-416b-a937-1deeed552803 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:40.430093 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b3a9516c-9c48-416b-a937-1deeed552803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c3aac64e024b51b40b709d1d721f6d'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:40.430898 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b3a9516c-9c48-416b-a937-1deeed552803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c3aac64e024b51b40b709d1d721f6d'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:40.444429 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b3a9516c-9c48-416b-a937-1deeed552803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c3aac64e024b51b40b709d1d721f6d'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:40.543559 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b3a9516c-9c48-416b-a937-1deeed552803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c3aac64e024b51b40b709d1d721f6d'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:40.558373 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b3a9516c-9c48-416b-a937-1deeed552803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c3aac64e024b51b40b709d1d721f6d'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:40.565285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1203/2397] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:03:40 2022] DELETE /identity/v3/users/15c3aac64e024b51b40b709d1d721f6d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:40.570726 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8d0d9-0599-4cfb-9e06-31ae1c9a09db None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:40.571244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8d0d9-0599-4cfb-9e06-31ae1c9a09db None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:40.571343 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8d0d9-0599-4cfb-9e06-31ae1c9a09db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:40.591219 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-f5e8d0d9-0599-4cfb-9e06-31ae1c9a09db None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:40.592489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f5e8d0d9-0599-4cfb-9e06-31ae1c9a09db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:40.654724 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1195/2398] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:03:40.664944 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9516c-9c48-416b-a937-1deeed552803 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:40.666367 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-b3a9516c-9c48-416b-a937-1deeed552803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:40.724256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9516c-9c48-416b-a937-1deeed552803 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:40.727864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ad615-bd5c-452b-a441-fb3f175dc4ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:40.728514 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ad615-bd5c-452b-a441-fb3f175dc4ab service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:40.728798 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ad615-bd5c-452b-a441-fb3f175dc4ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:40.729078 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ad615-bd5c-452b-a441-fb3f175dc4ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:40.739142 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ad615-bd5c-452b-a441-fb3f175dc4ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:40.740688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ad615-bd5c-452b-a441-fb3f175dc4ab service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:40.750751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1204/2399] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:03:41.170199 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8d0d9-0599-4cfb-9e06-31ae1c9a09db None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:41.171773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f5e8d0d9-0599-4cfb-9e06-31ae1c9a09db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:41.190065 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8d0d9-0599-4cfb-9e06-31ae1c9a09db None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:41.199950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:41.200868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:41.201148 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:41.201565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69 admin admin] PATH_INFO: `/v3/projects/c59cde09cbd64712a87e8faa6112228a` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:41.202765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c59cde09cbd64712a87e8faa6112228a)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:41.205063 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:41.365646 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c59cde09cbd64712a87e8faa6112228a', 'request_id': 'req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:41.419673 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c59cde09cbd64712a87e8faa6112228a', 'request_id': 'req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:41.427027 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c59cde09cbd64712a87e8faa6112228a', 'request_id': 'req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:41.438205 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69 admin admin] The token cache is being invalidate because project c59cde09cbd64712a87e8faa6112228a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:03:41.438476 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:41.439139 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:41.440709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1196/2400] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:03:41 2022] DELETE /identity/v3/projects/c59cde09cbd64712a87e8faa6112228a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:41.444715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ad615-bd5c-452b-a441-fb3f175dc4ab service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:41.454513 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ad615-bd5c-452b-a441-fb3f175dc4ab service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:41.517209 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac05dd4-0cbd-4435-9a0f-952d15ceb601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:41.518087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac05dd4-0cbd-4435-9a0f-952d15ceb601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:41.518370 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac05dd4-0cbd-4435-9a0f-952d15ceb601 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:41.518649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac05dd4-0cbd-4435-9a0f-952d15ceb601 admin admin] PATH_INFO: `/v3/users/4a811e74204847768829e8ecbde03d84` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:41.520627 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac05dd4-0cbd-4435-9a0f-952d15ceb601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a811e74204847768829e8ecbde03d84)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:41.522586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac05dd4-0cbd-4435-9a0f-952d15ceb601 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:41.754467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-fac05dd4-0cbd-4435-9a0f-952d15ceb601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a811e74204847768829e8ecbde03d84'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:41.755189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-fac05dd4-0cbd-4435-9a0f-952d15ceb601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a811e74204847768829e8ecbde03d84'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:41.762269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-fac05dd4-0cbd-4435-9a0f-952d15ceb601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a811e74204847768829e8ecbde03d84'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:41.857576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-fac05dd4-0cbd-4435-9a0f-952d15ceb601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a811e74204847768829e8ecbde03d84'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:41.871954 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-fac05dd4-0cbd-4435-9a0f-952d15ceb601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a811e74204847768829e8ecbde03d84'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:41.877871 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1205/2401] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:03:41 2022] DELETE /identity/v3/users/4a811e74204847768829e8ecbde03d84 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:42.288191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:42.289659 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:42.306655 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e9940-6ce2-4b02-be89-0a942f3d7e69 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:42.378167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f5216-c07c-40a3-b5e7-03efd7bc2aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:42.378963 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5216-c07c-40a3-b5e7-03efd7bc2aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:42.379241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5216-c07c-40a3-b5e7-03efd7bc2aed admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:42.380262 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5216-c07c-40a3-b5e7-03efd7bc2aed admin admin] PATH_INFO: `/v3/projects/c26fc863c0904090877c29e9cf6a1059` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:42.387681 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f5216-c07c-40a3-b5e7-03efd7bc2aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26fc863c0904090877c29e9cf6a1059)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:42.387681 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f5216-c07c-40a3-b5e7-03efd7bc2aed admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:42.516468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-760f5216-c07c-40a3-b5e7-03efd7bc2aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26fc863c0904090877c29e9cf6a1059', 'request_id': 'req-760f5216-c07c-40a3-b5e7-03efd7bc2aed'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:42.562333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-760f5216-c07c-40a3-b5e7-03efd7bc2aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26fc863c0904090877c29e9cf6a1059', 'request_id': 'req-760f5216-c07c-40a3-b5e7-03efd7bc2aed'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:42.569823 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-760f5216-c07c-40a3-b5e7-03efd7bc2aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26fc863c0904090877c29e9cf6a1059', 'request_id': 'req-760f5216-c07c-40a3-b5e7-03efd7bc2aed'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:42.580988 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-760f5216-c07c-40a3-b5e7-03efd7bc2aed admin admin] The token cache is being invalidate because project c26fc863c0904090877c29e9cf6a1059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:03:42.581280 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-760f5216-c07c-40a3-b5e7-03efd7bc2aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:42.581941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-760f5216-c07c-40a3-b5e7-03efd7bc2aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:42.584333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1197/2402] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:03:42 2022] DELETE /identity/v3/projects/c26fc863c0904090877c29e9cf6a1059 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:42.589091 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b2298-728c-43e9-9a02-2ed21dd901e1 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:42.589600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b2298-728c-43e9-9a02-2ed21dd901e1 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:42.589696 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b2298-728c-43e9-9a02-2ed21dd901e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:42.610070 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-cd4b2298-728c-43e9-9a02-2ed21dd901e1 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:42.611651 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-cd4b2298-728c-43e9-9a02-2ed21dd901e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:42.677357 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1206/2403] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:42.690112 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f13d52-caa4-4d21-84d1-e2612a0c73a7 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:42.690392 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f13d52-caa4-4d21-84d1-e2612a0c73a7 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:42.690668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f13d52-caa4-4d21-84d1-e2612a0c73a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:42.710901 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-f1f13d52-caa4-4d21-84d1-e2612a0c73a7 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:42.712172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f1f13d52-caa4-4d21-84d1-e2612a0c73a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:42.721277 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1198/2404] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:42.725615 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b2298-728c-43e9-9a02-2ed21dd901e1 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:42.735927 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b2298-728c-43e9-9a02-2ed21dd901e1 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:42.741290 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95918d08-5678-44fd-a6df-8ebf528436cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:42.742184 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95918d08-5678-44fd-a6df-8ebf528436cf admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:42.742494 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95918d08-5678-44fd-a6df-8ebf528436cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:42.742779 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95918d08-5678-44fd-a6df-8ebf528436cf admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:42.743512 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95918d08-5678-44fd-a6df-8ebf528436cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:03:42.743855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95918d08-5678-44fd-a6df-8ebf528436cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:42.745967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95918d08-5678-44fd-a6df-8ebf528436cf admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:42.762453 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1207/2405] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:03:42.766430 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f13d52-caa4-4d21-84d1-e2612a0c73a7 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:42.776631 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f13d52-caa4-4d21-84d1-e2612a0c73a7 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:42.781451 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949187b-8a33-4ef5-acae-309f89773e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:42.782102 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949187b-8a33-4ef5-acae-309f89773e65 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:42.782389 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949187b-8a33-4ef5-acae-309f89773e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:42.782670 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949187b-8a33-4ef5-acae-309f89773e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:42.783400 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949187b-8a33-4ef5-acae-309f89773e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:42.785356 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949187b-8a33-4ef5-acae-309f89773e65 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:42.849868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1199/2406] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:03:42 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:03:42.854661 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95918d08-5678-44fd-a6df-8ebf528436cf admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:42.865843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95918d08-5678-44fd-a6df-8ebf528436cf admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:42.920597 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae7fba-ed5b-4ac6-869e-55b6db8c1949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:42.921190 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae7fba-ed5b-4ac6-869e-55b6db8c1949 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:42.921475 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae7fba-ed5b-4ac6-869e-55b6db8c1949 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:42.921754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae7fba-ed5b-4ac6-869e-55b6db8c1949 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:42.922441 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae7fba-ed5b-4ac6-869e-55b6db8c1949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:42.924408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae7fba-ed5b-4ac6-869e-55b6db8c1949 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:43.001058 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1208/2407] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:03:42 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:03:43.005838 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949187b-8a33-4ef5-acae-309f89773e65 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:43.016570 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949187b-8a33-4ef5-acae-309f89773e65 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:43.021354 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366818b-7098-4cd5-9566-b5074b0fdc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:43.022019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366818b-7098-4cd5-9566-b5074b0fdc50 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:43.022298 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366818b-7098-4cd5-9566-b5074b0fdc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:43.022572 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366818b-7098-4cd5-9566-b5074b0fdc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:43.023292 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366818b-7098-4cd5-9566-b5074b0fdc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:43.024955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366818b-7098-4cd5-9566-b5074b0fdc50 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:43.035645 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1200/2408] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:03:43.039948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae7fba-ed5b-4ac6-869e-55b6db8c1949 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:43.050864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae7fba-ed5b-4ac6-869e-55b6db8c1949 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:43.056494 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abefd11-4f48-4a6a-9c69-0fa1c73b23fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:43.057169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abefd11-4f48-4a6a-9c69-0fa1c73b23fa admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:43.057451 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abefd11-4f48-4a6a-9c69-0fa1c73b23fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:43.057734 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abefd11-4f48-4a6a-9c69-0fa1c73b23fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:43.058491 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abefd11-4f48-4a6a-9c69-0fa1c73b23fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:43.060168 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abefd11-4f48-4a6a-9c69-0fa1c73b23fa admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:43.071347 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1209/2409] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:03:43.075712 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366818b-7098-4cd5-9566-b5074b0fdc50 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:43.086629 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366818b-7098-4cd5-9566-b5074b0fdc50 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:43.091881 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0c83a-af85-4a5b-b3d4-d6a1f721b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:43.092914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0c83a-af85-4a5b-b3d4-d6a1f721b873 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:43.093393 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0c83a-af85-4a5b-b3d4-d6a1f721b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:43.093679 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0c83a-af85-4a5b-b3d4-d6a1f721b873 admin admin] PATH_INFO: `/v3/projects/6387b912f2904cb1ae5b8865c542ad33/users/1da33f979af946dabb58f1fc8de0549d/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:43.108356 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0c83a-af85-4a5b-b3d4-d6a1f721b873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6387b912f2904cb1ae5b8865c542ad33, user_id=1da33f979af946dabb58f1fc8de0549d, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:43.111023 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0c83a-af85-4a5b-b3d4-d6a1f721b873 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:43.211634 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1201/2410] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:03:43 2022] PUT /identity/v3/projects/6387b912f2904cb1ae5b8865c542ad33/users/1da33f979af946dabb58f1fc8de0549d/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:43.220205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2337391-5425-4da8-9b52-5692a6b91d77 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:43.220625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2337391-5425-4da8-9b52-5692a6b91d77 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:43.220915 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2337391-5425-4da8-9b52-5692a6b91d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:43.249406 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-b2337391-5425-4da8-9b52-5692a6b91d77 None None] MFA Rules not processed for user `1da33f979af946dabb58f1fc8de0549d`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:43.250632 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-b2337391-5425-4da8-9b52-5692a6b91d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:43.316946 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1210/2411] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:43.321657 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0c83a-af85-4a5b-b3d4-d6a1f721b873 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:43.402706 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0c83a-af85-4a5b-b3d4-d6a1f721b873 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:43.412434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebf951-a8bd-4a1d-b019-0b684c164a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:43.412434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebf951-a8bd-4a1d-b019-0b684c164a3e admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:43.412434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebf951-a8bd-4a1d-b019-0b684c164a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:43.412434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebf951-a8bd-4a1d-b019-0b684c164a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:43.412803 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebf951-a8bd-4a1d-b019-0b684c164a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:43.413227 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebf951-a8bd-4a1d-b019-0b684c164a3e admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:43.533876 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1202/2412] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:03:43 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:03:43.538152 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2337391-5425-4da8-9b52-5692a6b91d77 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:43.550112 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2337391-5425-4da8-9b52-5692a6b91d77 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:43.639754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c6da6-3cd2-4c7c-9043-4ca4ff2feb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:43.640452 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c6da6-3cd2-4c7c-9043-4ca4ff2feb7a admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:43.640693 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c6da6-3cd2-4c7c-9043-4ca4ff2feb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:43.640966 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c6da6-3cd2-4c7c-9043-4ca4ff2feb7a admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:43.641731 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c6da6-3cd2-4c7c-9043-4ca4ff2feb7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:43.643721 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c6da6-3cd2-4c7c-9043-4ca4ff2feb7a admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:43.770220 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1211/2413] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:03:43 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:03:43.771509 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebf951-a8bd-4a1d-b019-0b684c164a3e admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:43.781965 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebf951-a8bd-4a1d-b019-0b684c164a3e admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:43.788138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2331379-34a4-4b4e-996a-3b12f7839cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:43.788937 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2331379-34a4-4b4e-996a-3b12f7839cbd admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:43.789316 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2331379-34a4-4b4e-996a-3b12f7839cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:43.790077 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2331379-34a4-4b4e-996a-3b12f7839cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:43.790607 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2331379-34a4-4b4e-996a-3b12f7839cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:43.792371 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2331379-34a4-4b4e-996a-3b12f7839cbd admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:43.807199 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1203/2414] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:03:43.809949 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c6da6-3cd2-4c7c-9043-4ca4ff2feb7a admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:43.827241 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c6da6-3cd2-4c7c-9043-4ca4ff2feb7a admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:43.832413 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a2e3c-9c9e-4128-9eb1-94261a785a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:43.833100 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a2e3c-9c9e-4128-9eb1-94261a785a92 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:43.833369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a2e3c-9c9e-4128-9eb1-94261a785a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:43.833639 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a2e3c-9c9e-4128-9eb1-94261a785a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:43.834424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a2e3c-9c9e-4128-9eb1-94261a785a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:43.836158 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a2e3c-9c9e-4128-9eb1-94261a785a92 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:43.847569 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1212/2415] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:03:43.851453 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2331379-34a4-4b4e-996a-3b12f7839cbd admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:43.865633 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2331379-34a4-4b4e-996a-3b12f7839cbd admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:43.870765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfa1cd-68fa-4af4-9c16-487648f98e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:43.871788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfa1cd-68fa-4af4-9c16-487648f98e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:43.872165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfa1cd-68fa-4af4-9c16-487648f98e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:43.872391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfa1cd-68fa-4af4-9c16-487648f98e0a admin admin] PATH_INFO: `/v3/projects/3f2f52af25994896a9c8a839829f5a4c/users/3b3c0da9e2774ac4865ae0bb32f8c9b1/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:43.889380 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfa1cd-68fa-4af4-9c16-487648f98e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2f52af25994896a9c8a839829f5a4c, user_id=3b3c0da9e2774ac4865ae0bb32f8c9b1, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:43.892109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfa1cd-68fa-4af4-9c16-487648f98e0a admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:43.967542 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1204/2416] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:03:43 2022] PUT /identity/v3/projects/3f2f52af25994896a9c8a839829f5a4c/users/3b3c0da9e2774ac4865ae0bb32f8c9b1/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:43.979395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64440819-c439-4c3c-bfc3-f54d35e34493 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:43.979792 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64440819-c439-4c3c-bfc3-f54d35e34493 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:43.980072 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64440819-c439-4c3c-bfc3-f54d35e34493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:44.007093 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-64440819-c439-4c3c-bfc3-f54d35e34493 None None] MFA Rules not processed for user `3b3c0da9e2774ac4865ae0bb32f8c9b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:44.008525 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-64440819-c439-4c3c-bfc3-f54d35e34493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:44.078620 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1213/2417] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:44.083084 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfa1cd-68fa-4af4-9c16-487648f98e0a admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:44.144465 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfa1cd-68fa-4af4-9c16-487648f98e0a admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:44.149395 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f1e4f-15af-428d-b35e-ffe3504b0bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:44.150085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f1e4f-15af-428d-b35e-ffe3504b0bda admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:44.150365 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f1e4f-15af-428d-b35e-ffe3504b0bda admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:44.150639 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f1e4f-15af-428d-b35e-ffe3504b0bda admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:44.151367 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f1e4f-15af-428d-b35e-ffe3504b0bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:44.153294 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f1e4f-15af-428d-b35e-ffe3504b0bda admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:44.250242 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1205/2418] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:03:44 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:03:44.254432 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64440819-c439-4c3c-bfc3-f54d35e34493 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:44.265869 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64440819-c439-4c3c-bfc3-f54d35e34493 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:44.323626 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92798b62-348f-426c-b788-b89c8ff6e264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:44.329242 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92798b62-348f-426c-b788-b89c8ff6e264 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:44.329242 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92798b62-348f-426c-b788-b89c8ff6e264 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:44.329242 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92798b62-348f-426c-b788-b89c8ff6e264 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:44.329242 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92798b62-348f-426c-b788-b89c8ff6e264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:44.329242 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92798b62-348f-426c-b788-b89c8ff6e264 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:44.436586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1214/2419] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:03:44 2022] POST /identity/v3/users => generated 295 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:03:44.441221 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f1e4f-15af-428d-b35e-ffe3504b0bda admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:44.453697 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f1e4f-15af-428d-b35e-ffe3504b0bda admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:44.459241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e4c18-a8d1-4629-8b6d-a35f4dbde9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:44.459940 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e4c18-a8d1-4629-8b6d-a35f4dbde9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:44.460221 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e4c18-a8d1-4629-8b6d-a35f4dbde9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:44.460496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e4c18-a8d1-4629-8b6d-a35f4dbde9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:44.461213 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e4c18-a8d1-4629-8b6d-a35f4dbde9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:44.462869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e4c18-a8d1-4629-8b6d-a35f4dbde9a1 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:44.475362 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1206/2420] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:03:44.480647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92798b62-348f-426c-b788-b89c8ff6e264 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:44.492422 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92798b62-348f-426c-b788-b89c8ff6e264 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:44.497302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa95f08-9425-4ce3-bbe9-83e30e2ae814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:44.498196 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa95f08-9425-4ce3-bbe9-83e30e2ae814 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:44.498481 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa95f08-9425-4ce3-bbe9-83e30e2ae814 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:44.498755 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa95f08-9425-4ce3-bbe9-83e30e2ae814 admin admin] PATH_INFO: `/v3/projects/d7daca51fb8e49cb915020056146cb66/users/6d20a00cad524363905fb3351de98f03/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:44.513582 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa95f08-9425-4ce3-bbe9-83e30e2ae814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7daca51fb8e49cb915020056146cb66, user_id=6d20a00cad524363905fb3351de98f03, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:44.516276 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa95f08-9425-4ce3-bbe9-83e30e2ae814 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:44.592661 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1215/2421] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:03:44 2022] PUT /identity/v3/projects/d7daca51fb8e49cb915020056146cb66/users/6d20a00cad524363905fb3351de98f03/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:44.596678 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e4c18-a8d1-4629-8b6d-a35f4dbde9a1 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:44.607156 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e4c18-a8d1-4629-8b6d-a35f4dbde9a1 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:44.665962 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d9a68-99f6-4fc5-9ff9-15248363e79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:44.666656 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d9a68-99f6-4fc5-9ff9-15248363e79b admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:44.666938 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d9a68-99f6-4fc5-9ff9-15248363e79b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:44.667211 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d9a68-99f6-4fc5-9ff9-15248363e79b admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:44.667969 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d9a68-99f6-4fc5-9ff9-15248363e79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:44.669593 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d9a68-99f6-4fc5-9ff9-15248363e79b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:44.680670 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1207/2422] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:03:44.685116 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa95f08-9425-4ce3-bbe9-83e30e2ae814 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:44.696301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa95f08-9425-4ce3-bbe9-83e30e2ae814 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:44.701574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f0dea-36e0-4d23-b934-12f7f6160199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:44.702486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f0dea-36e0-4d23-b934-12f7f6160199 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:44.702850 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f0dea-36e0-4d23-b934-12f7f6160199 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:44.703051 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f0dea-36e0-4d23-b934-12f7f6160199 admin admin] PATH_INFO: `/v3/projects/d7daca51fb8e49cb915020056146cb66/users/6d20a00cad524363905fb3351de98f03/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:44.705106 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f0dea-36e0-4d23-b934-12f7f6160199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7daca51fb8e49cb915020056146cb66, user_id=6d20a00cad524363905fb3351de98f03, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:44.708554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f0dea-36e0-4d23-b934-12f7f6160199 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:44.722561 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1216/2423] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:03:44 2022] PUT /identity/v3/projects/d7daca51fb8e49cb915020056146cb66/users/6d20a00cad524363905fb3351de98f03/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:44.732838 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92b283-390b-46b7-81f8-023f3e5c498f None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:44.733181 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92b283-390b-46b7-81f8-023f3e5c498f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:44.733476 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92b283-390b-46b7-81f8-023f3e5c498f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:44.764000 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-3a92b283-390b-46b7-81f8-023f3e5c498f None None] MFA Rules not processed for user `6d20a00cad524363905fb3351de98f03`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:44.766033 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-3a92b283-390b-46b7-81f8-023f3e5c498f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:44.850562 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1208/2424] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:44.861633 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f0dea-36e0-4d23-b934-12f7f6160199 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:44.863478 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-443f0dea-36e0-4d23-b934-12f7f6160199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:44.922893 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f0dea-36e0-4d23-b934-12f7f6160199 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:44.926507 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a8cf1-caeb-4528-a10b-5c587a4104e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:44.927948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a8cf1-caeb-4528-a10b-5c587a4104e9 service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:44.928235 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a8cf1-caeb-4528-a10b-5c587a4104e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:44.928516 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a8cf1-caeb-4528-a10b-5c587a4104e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:44.938074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a8cf1-caeb-4528-a10b-5c587a4104e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:44.939508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a8cf1-caeb-4528-a10b-5c587a4104e9 service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:44.949919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1217/2425] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:03:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:03:45.071202 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92b283-390b-46b7-81f8-023f3e5c498f None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:45.084946 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92b283-390b-46b7-81f8-023f3e5c498f None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:45.088567 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f650b-a69e-4c7e-ba2f-661cababbca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:45.089225 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f650b-a69e-4c7e-ba2f-661cababbca7 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:45.089508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f650b-a69e-4c7e-ba2f-661cababbca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:45.089788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f650b-a69e-4c7e-ba2f-661cababbca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:45.176100 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f650b-a69e-4c7e-ba2f-661cababbca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:45.178261 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f650b-a69e-4c7e-ba2f-661cababbca7 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:45.187121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1209/2426] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:03:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:03:54.384867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a8cf1-caeb-4528-a10b-5c587a4104e9 service cinder] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:54.445203 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a8cf1-caeb-4528-a10b-5c587a4104e9 service cinder] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:54.449824 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11903622-afb3-4e6f-a23b-494625659c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:54.450678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11903622-afb3-4e6f-a23b-494625659c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:54.450958 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11903622-afb3-4e6f-a23b-494625659c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:54.451233 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11903622-afb3-4e6f-a23b-494625659c5e admin admin] PATH_INFO: `/v3/users/1da33f979af946dabb58f1fc8de0549d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:54.452458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11903622-afb3-4e6f-a23b-494625659c5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da33f979af946dabb58f1fc8de0549d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:54.454445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11903622-afb3-4e6f-a23b-494625659c5e admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:54.604552 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-11903622-afb3-4e6f-a23b-494625659c5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da33f979af946dabb58f1fc8de0549d'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:54.605152 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-11903622-afb3-4e6f-a23b-494625659c5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da33f979af946dabb58f1fc8de0549d'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:54.612563 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-11903622-afb3-4e6f-a23b-494625659c5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da33f979af946dabb58f1fc8de0549d'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:54.689416 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-11903622-afb3-4e6f-a23b-494625659c5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da33f979af946dabb58f1fc8de0549d'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:54.702318 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-11903622-afb3-4e6f-a23b-494625659c5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da33f979af946dabb58f1fc8de0549d'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:54.708119 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1218/2427] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:03:54 2022] DELETE /identity/v3/users/1da33f979af946dabb58f1fc8de0549d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:54.713484 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5708a-68a6-4383-a3bc-79b947bb3b07 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:54.713979 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5708a-68a6-4383-a3bc-79b947bb3b07 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:54.714082 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5708a-68a6-4383-a3bc-79b947bb3b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:54.731229 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-b7f5708a-68a6-4383-a3bc-79b947bb3b07 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:54.732452 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b7f5708a-68a6-4383-a3bc-79b947bb3b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:54.789139 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1210/2428] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:54.807185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11903622-afb3-4e6f-a23b-494625659c5e admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:54.808667 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-11903622-afb3-4e6f-a23b-494625659c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:54.869499 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11903622-afb3-4e6f-a23b-494625659c5e admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:54.874201 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927d303-18d3-4a6e-a090-89b06b893464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:54.874938 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927d303-18d3-4a6e-a090-89b06b893464 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:54.875513 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927d303-18d3-4a6e-a090-89b06b893464 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:54.875679 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927d303-18d3-4a6e-a090-89b06b893464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:54.887634 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927d303-18d3-4a6e-a090-89b06b893464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:54.889104 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927d303-18d3-4a6e-a090-89b06b893464 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:54.898912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1219/2429] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:03:55.293260 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5708a-68a6-4383-a3bc-79b947bb3b07 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:55.293767 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b7f5708a-68a6-4383-a3bc-79b947bb3b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:55.313245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5708a-68a6-4383-a3bc-79b947bb3b07 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:55.318662 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842c426-1e76-48e2-8ac8-164640bba393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:55.322015 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842c426-1e76-48e2-8ac8-164640bba393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:55.322015 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842c426-1e76-48e2-8ac8-164640bba393 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:55.322015 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842c426-1e76-48e2-8ac8-164640bba393 admin admin] PATH_INFO: `/v3/projects/6387b912f2904cb1ae5b8865c542ad33` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:55.322307 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842c426-1e76-48e2-8ac8-164640bba393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6387b912f2904cb1ae5b8865c542ad33)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:55.324839 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842c426-1e76-48e2-8ac8-164640bba393 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:55.445841 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191368c-de59-46f7-9350-16354134418f None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:55.446878 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191368c-de59-46f7-9350-16354134418f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:55.446878 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191368c-de59-46f7-9350-16354134418f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:55.485200 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-9191368c-de59-46f7-9350-16354134418f None None] MFA Rules not processed for user `a918aee2dc2d4024ad3d9d0f9646a1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:55.486475 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-9191368c-de59-46f7-9350-16354134418f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:55.491606 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6842c426-1e76-48e2-8ac8-164640bba393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6387b912f2904cb1ae5b8865c542ad33', 'request_id': 'req-6842c426-1e76-48e2-8ac8-164640bba393'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:55.556480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1220/2430] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:55.564633 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6842c426-1e76-48e2-8ac8-164640bba393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6387b912f2904cb1ae5b8865c542ad33', 'request_id': 'req-6842c426-1e76-48e2-8ac8-164640bba393'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:55.590319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6842c426-1e76-48e2-8ac8-164640bba393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6387b912f2904cb1ae5b8865c542ad33', 'request_id': 'req-6842c426-1e76-48e2-8ac8-164640bba393'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:55.609014 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6842c426-1e76-48e2-8ac8-164640bba393 admin admin] The token cache is being invalidate because project 6387b912f2904cb1ae5b8865c542ad33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:03:55.609304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6842c426-1e76-48e2-8ac8-164640bba393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:55.609956 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6842c426-1e76-48e2-8ac8-164640bba393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:55.611492 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1211/2431] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:03:55 2022] DELETE /identity/v3/projects/6387b912f2904cb1ae5b8865c542ad33 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:55.615834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191368c-de59-46f7-9350-16354134418f None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:55.713152 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191368c-de59-46f7-9350-16354134418f None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:55.717067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95504a6b-110e-45e6-bcd7-ae2290a29cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:55.718173 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95504a6b-110e-45e6-bcd7-ae2290a29cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:55.718528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95504a6b-110e-45e6-bcd7-ae2290a29cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:55.718898 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95504a6b-110e-45e6-bcd7-ae2290a29cd5 admin admin] PATH_INFO: `/v3/users/3b3c0da9e2774ac4865ae0bb32f8c9b1` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:55.720203 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95504a6b-110e-45e6-bcd7-ae2290a29cd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b3c0da9e2774ac4865ae0bb32f8c9b1)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:55.722304 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95504a6b-110e-45e6-bcd7-ae2290a29cd5 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:55.924482 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95504a6b-110e-45e6-bcd7-ae2290a29cd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b3c0da9e2774ac4865ae0bb32f8c9b1'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:55.925399 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95504a6b-110e-45e6-bcd7-ae2290a29cd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b3c0da9e2774ac4865ae0bb32f8c9b1'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:55.935570 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95504a6b-110e-45e6-bcd7-ae2290a29cd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b3c0da9e2774ac4865ae0bb32f8c9b1'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:56.010394 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95504a6b-110e-45e6-bcd7-ae2290a29cd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b3c0da9e2774ac4865ae0bb32f8c9b1'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:56.018647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-95504a6b-110e-45e6-bcd7-ae2290a29cd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b3c0da9e2774ac4865ae0bb32f8c9b1'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:56.025573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1221/2432] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:03:55 2022] DELETE /identity/v3/users/3b3c0da9e2774ac4865ae0bb32f8c9b1 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:56.452028 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842c426-1e76-48e2-8ac8-164640bba393 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:56.454888 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-6842c426-1e76-48e2-8ac8-164640bba393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:56.469060 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842c426-1e76-48e2-8ac8-164640bba393 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:56.534617 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:56.535423 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:56.535733 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:56.536009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b admin admin] PATH_INFO: `/v3/projects/3f2f52af25994896a9c8a839829f5a4c` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:56.537215 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f2f52af25994896a9c8a839829f5a4c)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:56.539109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:56.659822 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2f52af25994896a9c8a839829f5a4c', 'request_id': 'req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:56.747332 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2f52af25994896a9c8a839829f5a4c', 'request_id': 'req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:56.758522 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2f52af25994896a9c8a839829f5a4c', 'request_id': 'req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:56.781153 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b admin admin] The token cache is being invalidate because project 3f2f52af25994896a9c8a839829f5a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:03:56.781452 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:56.783910 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:56.788743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1212/2433] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:03:56 2022] DELETE /identity/v3/projects/3f2f52af25994896a9c8a839829f5a4c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:56.791920 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c56649-3166-49c0-acb6-96d2e66d0650 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:56.792727 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c56649-3166-49c0-acb6-96d2e66d0650 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:56.793793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c56649-3166-49c0-acb6-96d2e66d0650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:56.794478 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:56.795999 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:56.932961 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-60c56649-3166-49c0-acb6-96d2e66d0650 None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:56.932961 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-60c56649-3166-49c0-acb6-96d2e66d0650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:56.934231 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2e808-d872-41b3-b000-bcacc7c6dc0b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:56.934231 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd5601-1585-4ffc-a081-4c43da2f5e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:56.934231 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd5601-1585-4ffc-a081-4c43da2f5e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:56.934231 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd5601-1585-4ffc-a081-4c43da2f5e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:56.934768 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd5601-1585-4ffc-a081-4c43da2f5e14 admin admin] PATH_INFO: `/v3/users/6d20a00cad524363905fb3351de98f03` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:56.934768 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd5601-1585-4ffc-a081-4c43da2f5e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d20a00cad524363905fb3351de98f03)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:56.934768 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd5601-1585-4ffc-a081-4c43da2f5e14 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:57.004742 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1222/2434] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 12:03:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:57.027749 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c56649-3166-49c0-acb6-96d2e66d0650 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:57.029117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-60c56649-3166-49c0-acb6-96d2e66d0650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:57.117296 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c56649-3166-49c0-acb6-96d2e66d0650 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:57.122371 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17f570-b12b-4dc5-a9e2-91be056b17fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:57.123019 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17f570-b12b-4dc5-a9e2-91be056b17fa service swift] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:57.123308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17f570-b12b-4dc5-a9e2-91be056b17fa service swift] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:57.123658 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17f570-b12b-4dc5-a9e2-91be056b17fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:57.131613 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17f570-b12b-4dc5-a9e2-91be056b17fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:57.133243 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17f570-b12b-4dc5-a9e2-91be056b17fa service swift] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:57.141844 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1223/2435] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:03:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 12:03:57.177451 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f3bd5601-1585-4ffc-a081-4c43da2f5e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d20a00cad524363905fb3351de98f03'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:57.178113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f3bd5601-1585-4ffc-a081-4c43da2f5e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d20a00cad524363905fb3351de98f03'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:57.329775 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f3bd5601-1585-4ffc-a081-4c43da2f5e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d20a00cad524363905fb3351de98f03'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:57.347745 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f3bd5601-1585-4ffc-a081-4c43da2f5e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d20a00cad524363905fb3351de98f03'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:57.357322 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f3bd5601-1585-4ffc-a081-4c43da2f5e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d20a00cad524363905fb3351de98f03'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:57.367677 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1213/2436] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:03:56 2022] DELETE /identity/v3/users/6d20a00cad524363905fb3351de98f03 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:03:57.931949 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17f570-b12b-4dc5-a9e2-91be056b17fa service swift] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:57.964615 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17f570-b12b-4dc5-a9e2-91be056b17fa service swift] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:58.042493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ca03b-d732-491e-9678-115a36991135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:58.044293 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ca03b-d732-491e-9678-115a36991135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:58.045947 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ca03b-d732-491e-9678-115a36991135 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:58.046764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ca03b-d732-491e-9678-115a36991135 admin admin] PATH_INFO: `/v3/projects/d7daca51fb8e49cb915020056146cb66` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:58.048348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ca03b-d732-491e-9678-115a36991135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7daca51fb8e49cb915020056146cb66)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:58.051682 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ca03b-d732-491e-9678-115a36991135 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:58.218515 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9d2ca03b-d732-491e-9678-115a36991135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7daca51fb8e49cb915020056146cb66', 'request_id': 'req-9d2ca03b-d732-491e-9678-115a36991135'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:58.240255 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9d2ca03b-d732-491e-9678-115a36991135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7daca51fb8e49cb915020056146cb66', 'request_id': 'req-9d2ca03b-d732-491e-9678-115a36991135'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:58.400024 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9d2ca03b-d732-491e-9678-115a36991135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7daca51fb8e49cb915020056146cb66', 'request_id': 'req-9d2ca03b-d732-491e-9678-115a36991135'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:58.419323 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9d2ca03b-d732-491e-9678-115a36991135 admin admin] The token cache is being invalidate because project d7daca51fb8e49cb915020056146cb66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:03:58.419646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9d2ca03b-d732-491e-9678-115a36991135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:58.420547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9d2ca03b-d732-491e-9678-115a36991135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:03:58.422675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1224/2437] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:03:57 2022] DELETE /identity/v3/projects/d7daca51fb8e49cb915020056146cb66 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:58.429284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05442474-1e7c-4182-b347-19b6aad55712 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:58.429886 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05442474-1e7c-4182-b347-19b6aad55712 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:58.429886 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05442474-1e7c-4182-b347-19b6aad55712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:58.449336 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-05442474-1e7c-4182-b347-19b6aad55712 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:58.450566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-05442474-1e7c-4182-b347-19b6aad55712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:58.530209 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1214/2438] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:58.532076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3fe88-d215-4af8-823f-8f7f4ec84e85 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:58.532599 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3fe88-d215-4af8-823f-8f7f4ec84e85 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:58.533134 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3fe88-d215-4af8-823f-8f7f4ec84e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:58.561631 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-09e3fe88-d215-4af8-823f-8f7f4ec84e85 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:58.562889 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-09e3fe88-d215-4af8-823f-8f7f4ec84e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:58.576345 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1225/2439] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:58.577485 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05442474-1e7c-4182-b347-19b6aad55712 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:58.592351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05442474-1e7c-4182-b347-19b6aad55712 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:58.598410 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1785d3-17ba-4aef-9bcd-bf40c7e741ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:58.599414 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1785d3-17ba-4aef-9bcd-bf40c7e741ca admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:58.599828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1785d3-17ba-4aef-9bcd-bf40c7e741ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:58.600205 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1785d3-17ba-4aef-9bcd-bf40c7e741ca admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:58.601039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1785d3-17ba-4aef-9bcd-bf40c7e741ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:03:58.601609 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1785d3-17ba-4aef-9bcd-bf40c7e741ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:58.608682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1785d3-17ba-4aef-9bcd-bf40c7e741ca admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:58.624239 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1215/2440] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:03:58.635448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3fe88-d215-4af8-823f-8f7f4ec84e85 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:58.644732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3fe88-d215-4af8-823f-8f7f4ec84e85 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:58.652584 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf631cef-e096-423d-9360-d0fafe5e1302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:58.652584 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf631cef-e096-423d-9360-d0fafe5e1302 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:58.652584 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf631cef-e096-423d-9360-d0fafe5e1302 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:58.652584 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf631cef-e096-423d-9360-d0fafe5e1302 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:58.655407 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf631cef-e096-423d-9360-d0fafe5e1302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:58.655407 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf631cef-e096-423d-9360-d0fafe5e1302 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:58.761433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1226/2441] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:03:58 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:03:58.764050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1785d3-17ba-4aef-9bcd-bf40c7e741ca admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:58.775663 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1785d3-17ba-4aef-9bcd-bf40c7e741ca admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:58.889155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b91433-b8f9-4be7-8e8a-227b9ac1ce16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:58.890018 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b91433-b8f9-4be7-8e8a-227b9ac1ce16 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:58.890366 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b91433-b8f9-4be7-8e8a-227b9ac1ce16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:58.890654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b91433-b8f9-4be7-8e8a-227b9ac1ce16 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:58.891455 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b91433-b8f9-4be7-8e8a-227b9ac1ce16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:58.898195 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b91433-b8f9-4be7-8e8a-227b9ac1ce16 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:58.992020 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1216/2442] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:03:58 2022] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:03:58.996926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf631cef-e096-423d-9360-d0fafe5e1302 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:59.012316 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf631cef-e096-423d-9360-d0fafe5e1302 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:59.030630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdccc5c-111f-479d-a387-212a48dea3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:59.030630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdccc5c-111f-479d-a387-212a48dea3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:59.030630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdccc5c-111f-479d-a387-212a48dea3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:59.030630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdccc5c-111f-479d-a387-212a48dea3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:59.031013 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdccc5c-111f-479d-a387-212a48dea3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:59.031013 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdccc5c-111f-479d-a387-212a48dea3e8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:59.056575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1227/2443] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:03:59.057668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b91433-b8f9-4be7-8e8a-227b9ac1ce16 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:59.075722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b91433-b8f9-4be7-8e8a-227b9ac1ce16 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:59.082697 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f114e8a-8a60-4fc9-9cd0-e961155f22a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:59.083384 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f114e8a-8a60-4fc9-9cd0-e961155f22a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:59.083708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f114e8a-8a60-4fc9-9cd0-e961155f22a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:59.083980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f114e8a-8a60-4fc9-9cd0-e961155f22a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:59.084809 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f114e8a-8a60-4fc9-9cd0-e961155f22a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:59.088428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f114e8a-8a60-4fc9-9cd0-e961155f22a9 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:59.119231 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1217/2444] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:03:59.123457 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdccc5c-111f-479d-a387-212a48dea3e8 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:59.139860 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdccc5c-111f-479d-a387-212a48dea3e8 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:59.153076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eac8cc-92cc-4b0a-aeac-e91262b34edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:59.155634 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eac8cc-92cc-4b0a-aeac-e91262b34edc admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:59.162769 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eac8cc-92cc-4b0a-aeac-e91262b34edc admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:59.162769 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eac8cc-92cc-4b0a-aeac-e91262b34edc admin admin] PATH_INFO: `/v3/projects/0c685d0b0b9c43f597327a49fadc1dc8/users/d4a0c8260e514efcbdd0be546a93f0d9/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:59.188649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eac8cc-92cc-4b0a-aeac-e91262b34edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c685d0b0b9c43f597327a49fadc1dc8, user_id=d4a0c8260e514efcbdd0be546a93f0d9, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:59.193650 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eac8cc-92cc-4b0a-aeac-e91262b34edc admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:59.319428 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1228/2445] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:03:59 2022] PUT /identity/v3/projects/0c685d0b0b9c43f597327a49fadc1dc8/users/d4a0c8260e514efcbdd0be546a93f0d9/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:03:59.333114 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832c69d-9458-4b45-8d8c-6dfa58b495be None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:59.333758 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832c69d-9458-4b45-8d8c-6dfa58b495be None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:59.334041 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832c69d-9458-4b45-8d8c-6dfa58b495be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:59.401086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-7832c69d-9458-4b45-8d8c-6dfa58b495be None None] MFA Rules not processed for user `d4a0c8260e514efcbdd0be546a93f0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:03:59.402638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-7832c69d-9458-4b45-8d8c-6dfa58b495be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:59.596723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1218/2446] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:03:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:03:59.601312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eac8cc-92cc-4b0a-aeac-e91262b34edc admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:59.752513 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832c69d-9458-4b45-8d8c-6dfa58b495be None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:03:59.755034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-7832c69d-9458-4b45-8d8c-6dfa58b495be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:03:59.807772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eac8cc-92cc-4b0a-aeac-e91262b34edc admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:59.818344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d86b0e-733a-4f24-a450-e25706ead186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:59.822360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d86b0e-733a-4f24-a450-e25706ead186 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:59.822360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d86b0e-733a-4f24-a450-e25706ead186 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:59.822360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d86b0e-733a-4f24-a450-e25706ead186 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:59.822360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d86b0e-733a-4f24-a450-e25706ead186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:59.825607 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d86b0e-733a-4f24-a450-e25706ead186 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:03:59.935203 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832c69d-9458-4b45-8d8c-6dfa58b495be None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:03:59.942704 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdebd9-d1e0-4b76-acf5-2a4dedce3c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:03:59.943716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdebd9-d1e0-4b76-acf5-2a4dedce3c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:03:59.943983 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdebd9-d1e0-4b76-acf5-2a4dedce3c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:03:59.944265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdebd9-d1e0-4b76-acf5-2a4dedce3c1c admin admin] PATH_INFO: `/v3/users/693cf828718e4b55bc3b8c4191b62ea6` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:03:59.947500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdebd9-d1e0-4b76-acf5-2a4dedce3c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=693cf828718e4b55bc3b8c4191b62ea6)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:03:59.951772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdebd9-d1e0-4b76-acf5-2a4dedce3c1c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:00.048062 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1229/2447] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:03:59 2022] POST /identity/v3/projects => generated 363 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:04:00.054193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d86b0e-733a-4f24-a450-e25706ead186 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:00.223162 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d86b0e-733a-4f24-a450-e25706ead186 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:00.227959 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e3fdebd9-d1e0-4b76-acf5-2a4dedce3c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693cf828718e4b55bc3b8c4191b62ea6'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:00.228930 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e3fdebd9-d1e0-4b76-acf5-2a4dedce3c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693cf828718e4b55bc3b8c4191b62ea6'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:00.240399 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedde30f-a2b9-4d0c-bf88-991488434e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:00.241625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedde30f-a2b9-4d0c-bf88-991488434e67 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:00.243199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedde30f-a2b9-4d0c-bf88-991488434e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:00.244382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedde30f-a2b9-4d0c-bf88-991488434e67 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:00.246133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedde30f-a2b9-4d0c-bf88-991488434e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:00.253726 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedde30f-a2b9-4d0c-bf88-991488434e67 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:00.305482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e3fdebd9-d1e0-4b76-acf5-2a4dedce3c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693cf828718e4b55bc3b8c4191b62ea6'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:00.338432 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e3fdebd9-d1e0-4b76-acf5-2a4dedce3c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693cf828718e4b55bc3b8c4191b62ea6'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:00.350666 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e3fdebd9-d1e0-4b76-acf5-2a4dedce3c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693cf828718e4b55bc3b8c4191b62ea6'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:00.368926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1219/2448] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:03:59 2022] DELETE /identity/v3/users/693cf828718e4b55bc3b8c4191b62ea6 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:00.374592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d461e9-7a16-4cb6-ad8a-9007fcecc36e None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:00.381487 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d461e9-7a16-4cb6-ad8a-9007fcecc36e None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:00.381487 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d461e9-7a16-4cb6-ad8a-9007fcecc36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:00.382114 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1230/2449] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:04:00 2022] POST /identity/v3/users => generated 288 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:04:00.382611 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedde30f-a2b9-4d0c-bf88-991488434e67 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:00.385068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-bedde30f-a2b9-4d0c-bf88-991488434e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:00.408070 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedde30f-a2b9-4d0c-bf88-991488434e67 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:00.432632 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-a4d461e9-7a16-4cb6-ad8a-9007fcecc36e None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:00.436831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a4d461e9-7a16-4cb6-ad8a-9007fcecc36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:00.549255 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286def9c-e187-4f62-b3eb-e79af7c7d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:00.550447 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286def9c-e187-4f62-b3eb-e79af7c7d425 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:00.550871 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286def9c-e187-4f62-b3eb-e79af7c7d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:00.551157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286def9c-e187-4f62-b3eb-e79af7c7d425 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:00.551922 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286def9c-e187-4f62-b3eb-e79af7c7d425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:00.555475 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286def9c-e187-4f62-b3eb-e79af7c7d425 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:00.579346 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1231/2450] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:04:00.586117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286def9c-e187-4f62-b3eb-e79af7c7d425 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:00.599439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286def9c-e187-4f62-b3eb-e79af7c7d425 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:00.632307 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c857618-5d41-480b-a550-33c8e659eb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:00.632847 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c857618-5d41-480b-a550-33c8e659eb44 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:00.633133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c857618-5d41-480b-a550-33c8e659eb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:00.633412 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c857618-5d41-480b-a550-33c8e659eb44 admin admin] PATH_INFO: `/v3/projects/38566c17057e4481aae028e8f95f4eb1/users/5f32319db24341f7a8b31c88833e3acc/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:00.641105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1220/2451] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:00.669568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c857618-5d41-480b-a550-33c8e659eb44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38566c17057e4481aae028e8f95f4eb1, user_id=5f32319db24341f7a8b31c88833e3acc, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:00.674794 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c857618-5d41-480b-a550-33c8e659eb44 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:00.696652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d461e9-7a16-4cb6-ad8a-9007fcecc36e None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:00.699086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a4d461e9-7a16-4cb6-ad8a-9007fcecc36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:00.901025 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d461e9-7a16-4cb6-ad8a-9007fcecc36e None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:00.922861 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954540e1-253c-4004-b5d5-e34180a9fec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:00.923709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954540e1-253c-4004-b5d5-e34180a9fec8 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:00.924116 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954540e1-253c-4004-b5d5-e34180a9fec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:00.925141 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954540e1-253c-4004-b5d5-e34180a9fec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:00.955853 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954540e1-253c-4004-b5d5-e34180a9fec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:00.957705 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954540e1-253c-4004-b5d5-e34180a9fec8 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:00.983577 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1221/2452] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:04:01.077128 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1232/2453] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:04:00 2022] PUT /identity/v3/projects/38566c17057e4481aae028e8f95f4eb1/users/5f32319db24341f7a8b31c88833e3acc/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:01.085183 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954540e1-253c-4004-b5d5-e34180a9fec8 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:01.102273 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954540e1-253c-4004-b5d5-e34180a9fec8 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:01.292189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076e0e2-78b6-4a18-87bb-6b4d933ba3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:01.297182 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076e0e2-78b6-4a18-87bb-6b4d933ba3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:01.297643 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076e0e2-78b6-4a18-87bb-6b4d933ba3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:01.298086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076e0e2-78b6-4a18-87bb-6b4d933ba3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:01.299351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076e0e2-78b6-4a18-87bb-6b4d933ba3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:01.301202 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076e0e2-78b6-4a18-87bb-6b4d933ba3d7 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:01.327356 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c857618-5d41-480b-a550-33c8e659eb44 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:01.327856 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1222/2454] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:04:01.347249 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c857618-5d41-480b-a550-33c8e659eb44 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:01.364698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5170172-66f3-461c-b9d5-cbdb26eb9545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:01.365622 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5170172-66f3-461c-b9d5-cbdb26eb9545 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:01.365898 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5170172-66f3-461c-b9d5-cbdb26eb9545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:01.366423 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5170172-66f3-461c-b9d5-cbdb26eb9545 admin admin] PATH_INFO: `/v3/projects/38566c17057e4481aae028e8f95f4eb1/users/5f32319db24341f7a8b31c88833e3acc/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:01.371688 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5170172-66f3-461c-b9d5-cbdb26eb9545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38566c17057e4481aae028e8f95f4eb1, user_id=5f32319db24341f7a8b31c88833e3acc, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:01.380117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5170172-66f3-461c-b9d5-cbdb26eb9545 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:01.394416 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1233/2455] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:04:01 2022] PUT /identity/v3/projects/38566c17057e4481aae028e8f95f4eb1/users/5f32319db24341f7a8b31c88833e3acc/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:04:01.406843 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cccf88-ce6a-48ce-875c-fed8a28d066a None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:01.407690 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cccf88-ce6a-48ce-875c-fed8a28d066a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:01.408155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cccf88-ce6a-48ce-875c-fed8a28d066a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:01.460207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-c9cccf88-ce6a-48ce-875c-fed8a28d066a None None] MFA Rules not processed for user `5f32319db24341f7a8b31c88833e3acc`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:01.461497 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c9cccf88-ce6a-48ce-875c-fed8a28d066a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:01.664245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1223/2456] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:01 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:01.964071 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5170172-66f3-461c-b9d5-cbdb26eb9545 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:01.970148 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f5170172-66f3-461c-b9d5-cbdb26eb9545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:02.069873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5170172-66f3-461c-b9d5-cbdb26eb9545 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:02.075508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b31e83-1139-4fa0-8947-095f571ed530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:02.083683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b31e83-1139-4fa0-8947-095f571ed530 service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:02.083683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b31e83-1139-4fa0-8947-095f571ed530 service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:02.083683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b31e83-1139-4fa0-8947-095f571ed530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:02.093438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b31e83-1139-4fa0-8947-095f571ed530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:02.095851 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b31e83-1139-4fa0-8947-095f571ed530 service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:02.124179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1234/2457] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:01 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:04:02.549850 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cccf88-ce6a-48ce-875c-fed8a28d066a None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:02.551300 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c9cccf88-ce6a-48ce-875c-fed8a28d066a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:02.688342 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cccf88-ce6a-48ce-875c-fed8a28d066a None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:02.694408 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161e527-7389-459a-9f35-106f608a6190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:02.695298 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161e527-7389-459a-9f35-106f608a6190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:02.695621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161e527-7389-459a-9f35-106f608a6190 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:02.695902 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161e527-7389-459a-9f35-106f608a6190 admin admin] PATH_INFO: `/v3/projects/3a65b26d61c14a3ca7b7cb6843ecdb1e` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:02.697153 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161e527-7389-459a-9f35-106f608a6190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a65b26d61c14a3ca7b7cb6843ecdb1e)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:02.699641 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161e527-7389-459a-9f35-106f608a6190 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:02.875045 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b31e83-1139-4fa0-8947-095f571ed530 service cinder] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:02.890657 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b31e83-1139-4fa0-8947-095f571ed530 service cinder] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:02.909646 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e161e527-7389-459a-9f35-106f608a6190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a65b26d61c14a3ca7b7cb6843ecdb1e', 'request_id': 'req-e161e527-7389-459a-9f35-106f608a6190'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:02.965046 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d1d5f-8779-48ad-bc36-dd6750e3c7d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:02.965949 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d1d5f-8779-48ad-bc36-dd6750e3c7d5 service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:02.966237 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d1d5f-8779-48ad-bc36-dd6750e3c7d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:02.966645 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d1d5f-8779-48ad-bc36-dd6750e3c7d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:02.968626 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f74d1d5f-8779-48ad-bc36-dd6750e3c7d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:03.002926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e161e527-7389-459a-9f35-106f608a6190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a65b26d61c14a3ca7b7cb6843ecdb1e', 'request_id': 'req-e161e527-7389-459a-9f35-106f608a6190'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:03.021154 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e161e527-7389-459a-9f35-106f608a6190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a65b26d61c14a3ca7b7cb6843ecdb1e', 'request_id': 'req-e161e527-7389-459a-9f35-106f608a6190'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:03.069913 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e161e527-7389-459a-9f35-106f608a6190 admin admin] The token cache is being invalidate because project 3a65b26d61c14a3ca7b7cb6843ecdb1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:04:03.069913 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e161e527-7389-459a-9f35-106f608a6190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:03.069913 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-e161e527-7389-459a-9f35-106f608a6190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:03.069913 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1224/2458] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:04:02 2022] DELETE /identity/v3/projects/3a65b26d61c14a3ca7b7cb6843ecdb1e => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:03.074938 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0d04d-584d-4d27-a60d-441c91e1f71c None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:03.075328 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0d04d-584d-4d27-a60d-441c91e1f71c None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:03.075654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0d04d-584d-4d27-a60d-441c91e1f71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:03.109127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d1d5f-8779-48ad-bc36-dd6750e3c7d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:03.110884 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d1d5f-8779-48ad-bc36-dd6750e3c7d5 service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:03.112134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-c3d0d04d-584d-4d27-a60d-441c91e1f71c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:03.113375 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c3d0d04d-584d-4d27-a60d-441c91e1f71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:03.133163 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1235/2459] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:04:03.235740 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1225/2460] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:04:03.241873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa3ff6-b192-48f3-a293-16d0b288fc9f None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:03.241873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa3ff6-b192-48f3-a293-16d0b288fc9f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:03.241873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa3ff6-b192-48f3-a293-16d0b288fc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:03.270461 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-16aa3ff6-b192-48f3-a293-16d0b288fc9f None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:03.271758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-16aa3ff6-b192-48f3-a293-16d0b288fc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:03.301719 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1236/2461] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:03.302445 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0d04d-584d-4d27-a60d-441c91e1f71c None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:03.317547 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0d04d-584d-4d27-a60d-441c91e1f71c None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:03.328238 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ecec1-5966-4df5-a781-6c71c6dc9d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:03.328921 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ecec1-5966-4df5-a781-6c71c6dc9d88 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:03.329204 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ecec1-5966-4df5-a781-6c71c6dc9d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:03.329480 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ecec1-5966-4df5-a781-6c71c6dc9d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:03.330237 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ecec1-5966-4df5-a781-6c71c6dc9d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:04:03.330546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ecec1-5966-4df5-a781-6c71c6dc9d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:03.336169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ecec1-5966-4df5-a781-6c71c6dc9d88 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:03.367863 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1226/2462] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:04:03.368980 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa3ff6-b192-48f3-a293-16d0b288fc9f None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:03.379176 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa3ff6-b192-48f3-a293-16d0b288fc9f None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:03.389637 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e71ca6-834d-42d5-a8a2-2a59228b2332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:03.393988 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71ca6-834d-42d5-a8a2-2a59228b2332 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:03.393988 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71ca6-834d-42d5-a8a2-2a59228b2332 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:03.393988 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71ca6-834d-42d5-a8a2-2a59228b2332 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:03.393988 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e71ca6-834d-42d5-a8a2-2a59228b2332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:03.393988 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e71ca6-834d-42d5-a8a2-2a59228b2332 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:03.514038 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1237/2463] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:04:03 2022] POST /identity/v3/projects => generated 395 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:04:03.515440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ecec1-5966-4df5-a781-6c71c6dc9d88 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:03.529605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ecec1-5966-4df5-a781-6c71c6dc9d88 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:03.620391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8417a0e-5db6-4216-9079-b69a4fd75f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:03.622241 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8417a0e-5db6-4216-9079-b69a4fd75f57 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:03.625379 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8417a0e-5db6-4216-9079-b69a4fd75f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:03.626858 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8417a0e-5db6-4216-9079-b69a4fd75f57 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:03.631834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8417a0e-5db6-4216-9079-b69a4fd75f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:03.633824 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8417a0e-5db6-4216-9079-b69a4fd75f57 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:03.723335 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1227/2464] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:04:03 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:04:03.729237 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e71ca6-834d-42d5-a8a2-2a59228b2332 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:03.744671 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e71ca6-834d-42d5-a8a2-2a59228b2332 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:03.750479 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0e6df-e2c0-4c1e-b7bc-f6fbd48dd0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:03.751571 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0e6df-e2c0-4c1e-b7bc-f6fbd48dd0ba admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:03.752077 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0e6df-e2c0-4c1e-b7bc-f6fbd48dd0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:03.752550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0e6df-e2c0-4c1e-b7bc-f6fbd48dd0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:03.753493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0e6df-e2c0-4c1e-b7bc-f6fbd48dd0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:03.755353 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0e6df-e2c0-4c1e-b7bc-f6fbd48dd0ba admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:03.779843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1238/2465] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:04:03.783823 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8417a0e-5db6-4216-9079-b69a4fd75f57 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:03.848306 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8417a0e-5db6-4216-9079-b69a4fd75f57 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:03.871539 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f64646-c0c1-4d69-adb6-d5048d6b794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:03.871836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f64646-c0c1-4d69-adb6-d5048d6b794b admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:03.872125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f64646-c0c1-4d69-adb6-d5048d6b794b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:03.875821 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f64646-c0c1-4d69-adb6-d5048d6b794b admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:03.876627 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f64646-c0c1-4d69-adb6-d5048d6b794b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:03.886088 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f64646-c0c1-4d69-adb6-d5048d6b794b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:03.949356 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0e6df-e2c0-4c1e-b7bc-f6fbd48dd0ba admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:03.951566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1228/2466] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:04:03.974946 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0e6df-e2c0-4c1e-b7bc-f6fbd48dd0ba admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:03.986930 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff48fe-d3ec-40e7-95f5-77c2eb5b4a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:03.989781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff48fe-d3ec-40e7-95f5-77c2eb5b4a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:03.989781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff48fe-d3ec-40e7-95f5-77c2eb5b4a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:03.989781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff48fe-d3ec-40e7-95f5-77c2eb5b4a22 admin admin] PATH_INFO: `/v3/projects/e52e9120d51e4c2b895764da9185d488/users/2bfadf232c01485380e49f97e2465e1f/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:04.036475 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff48fe-d3ec-40e7-95f5-77c2eb5b4a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52e9120d51e4c2b895764da9185d488, user_id=2bfadf232c01485380e49f97e2465e1f, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:04.039630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff48fe-d3ec-40e7-95f5-77c2eb5b4a22 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:04.144142 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1239/2467] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:04:03 2022] PUT /identity/v3/projects/e52e9120d51e4c2b895764da9185d488/users/2bfadf232c01485380e49f97e2465e1f/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:04.157808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb8430-c3ea-4600-88e5-25ff97064b33 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:04.158101 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb8430-c3ea-4600-88e5-25ff97064b33 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:04.158382 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb8430-c3ea-4600-88e5-25ff97064b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:04.218279 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-4feb8430-c3ea-4600-88e5-25ff97064b33 None None] MFA Rules not processed for user `2bfadf232c01485380e49f97e2465e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:04.219923 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-4feb8430-c3ea-4600-88e5-25ff97064b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:04.345603 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1229/2468] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:04.359323 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff48fe-d3ec-40e7-95f5-77c2eb5b4a22 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:04.362212 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-fdff48fe-d3ec-40e7-95f5-77c2eb5b4a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:04.457066 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff48fe-d3ec-40e7-95f5-77c2eb5b4a22 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:04.462064 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed2a8d-a8f0-4ac1-8bc4-a737f1ab202d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:04.463412 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed2a8d-a8f0-4ac1-8bc4-a737f1ab202d service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:04.463905 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed2a8d-a8f0-4ac1-8bc4-a737f1ab202d service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:04.464391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed2a8d-a8f0-4ac1-8bc4-a737f1ab202d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:04.475812 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed2a8d-a8f0-4ac1-8bc4-a737f1ab202d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:04.480115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed2a8d-a8f0-4ac1-8bc4-a737f1ab202d service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:04.511622 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1240/2469] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:04:14.926621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb8430-c3ea-4600-88e5-25ff97064b33 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:14.928069 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-4feb8430-c3ea-4600-88e5-25ff97064b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:15.029400 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb8430-c3ea-4600-88e5-25ff97064b33 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:15.034405 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a0b47-e04c-4e43-8843-1db5c964d032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:15.035604 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a0b47-e04c-4e43-8843-1db5c964d032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:15.038532 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a0b47-e04c-4e43-8843-1db5c964d032 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:15.038532 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a0b47-e04c-4e43-8843-1db5c964d032 admin admin] PATH_INFO: `/v3/users/48de21ec60e64474a783099931b286bf` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:15.038532 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a0b47-e04c-4e43-8843-1db5c964d032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48de21ec60e64474a783099931b286bf)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:15.039357 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a0b47-e04c-4e43-8843-1db5c964d032 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:15.152971 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed2a8d-a8f0-4ac1-8bc4-a737f1ab202d service cinder] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:15.156616 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-abed2a8d-a8f0-4ac1-8bc4-a737f1ab202d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:15.170484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed2a8d-a8f0-4ac1-8bc4-a737f1ab202d service cinder] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:15.174907 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7ee0d-1cc7-4126-954b-afcf2e340d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:15.175835 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7ee0d-1cc7-4126-954b-afcf2e340d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:15.176109 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7ee0d-1cc7-4126-954b-afcf2e340d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:15.176433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7ee0d-1cc7-4126-954b-afcf2e340d79 admin admin] PATH_INFO: `/v3/users/d4a0c8260e514efcbdd0be546a93f0d9` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:15.177536 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7ee0d-1cc7-4126-954b-afcf2e340d79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a0c8260e514efcbdd0be546a93f0d9)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:15.179604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7ee0d-1cc7-4126-954b-afcf2e340d79 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:15.219272 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-fd8a0b47-e04c-4e43-8843-1db5c964d032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48de21ec60e64474a783099931b286bf'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:15.219895 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-fd8a0b47-e04c-4e43-8843-1db5c964d032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48de21ec60e64474a783099931b286bf'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:15.312579 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-fd8a0b47-e04c-4e43-8843-1db5c964d032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48de21ec60e64474a783099931b286bf'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:15.325867 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-fd8a0b47-e04c-4e43-8843-1db5c964d032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48de21ec60e64474a783099931b286bf'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:15.333370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-fd8a0b47-e04c-4e43-8843-1db5c964d032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48de21ec60e64474a783099931b286bf'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:15.339576 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1230/2470] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:04:14 2022] DELETE /identity/v3/users/48de21ec60e64474a783099931b286bf => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:15.344306 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be3fb7-5d47-41ce-9f22-5f8078589f8b None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:15.344594 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be3fb7-5d47-41ce-9f22-5f8078589f8b None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:15.344955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be3fb7-5d47-41ce-9f22-5f8078589f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:15.362085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-94be3fb7-5d47-41ce-9f22-5f8078589f8b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:15.363293 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-94be3fb7-5d47-41ce-9f22-5f8078589f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:15.385067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3bf7ee0d-1cc7-4126-954b-afcf2e340d79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a0c8260e514efcbdd0be546a93f0d9'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:15.385709 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3bf7ee0d-1cc7-4126-954b-afcf2e340d79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a0c8260e514efcbdd0be546a93f0d9'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:15.393382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3bf7ee0d-1cc7-4126-954b-afcf2e340d79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a0c8260e514efcbdd0be546a93f0d9'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:15.423277 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1231/2471] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:04:15.433038 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be3fb7-5d47-41ce-9f22-5f8078589f8b None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:15.435093 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-94be3fb7-5d47-41ce-9f22-5f8078589f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:15.445684 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3bf7ee0d-1cc7-4126-954b-afcf2e340d79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a0c8260e514efcbdd0be546a93f0d9'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:15.458150 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3bf7ee0d-1cc7-4126-954b-afcf2e340d79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a0c8260e514efcbdd0be546a93f0d9'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:15.464079 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1241/2472] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:04:15 2022] DELETE /identity/v3/users/d4a0c8260e514efcbdd0be546a93f0d9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:04:15.468631 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93245d41-7c7b-43b3-b2bb-ff30f13cd760 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:15.468924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93245d41-7c7b-43b3-b2bb-ff30f13cd760 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:15.469205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93245d41-7c7b-43b3-b2bb-ff30f13cd760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:15.494757 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be3fb7-5d47-41ce-9f22-5f8078589f8b None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:15.502619 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-93245d41-7c7b-43b3-b2bb-ff30f13cd760 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:15.504183 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-93245d41-7c7b-43b3-b2bb-ff30f13cd760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:15.552188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558f4a7-9e4f-4356-b35d-eb409138a4d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:15.552893 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558f4a7-9e4f-4356-b35d-eb409138a4d1 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:15.553167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558f4a7-9e4f-4356-b35d-eb409138a4d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:15.553446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558f4a7-9e4f-4356-b35d-eb409138a4d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:15.573017 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1242/2473] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:04:15.584169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93245d41-7c7b-43b3-b2bb-ff30f13cd760 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:15.585575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-93245d41-7c7b-43b3-b2bb-ff30f13cd760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:15.598586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93245d41-7c7b-43b3-b2bb-ff30f13cd760 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:15.602842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ce75d-ccb3-47e6-b7b7-a0dc59e11d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:15.604309 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ce75d-ccb3-47e6-b7b7-a0dc59e11d90 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:15.604309 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ce75d-ccb3-47e6-b7b7-a0dc59e11d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:15.604309 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ce75d-ccb3-47e6-b7b7-a0dc59e11d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:15.615352 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ce75d-ccb3-47e6-b7b7-a0dc59e11d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:15.617060 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ce75d-ccb3-47e6-b7b7-a0dc59e11d90 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:15.628909 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1243/2474] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:04:15.633988 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558f4a7-9e4f-4356-b35d-eb409138a4d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:15.635486 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558f4a7-9e4f-4356-b35d-eb409138a4d1 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:15.646246 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1232/2475] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:04:16.131244 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ce75d-ccb3-47e6-b7b7-a0dc59e11d90 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:16.133140 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-054ce75d-ccb3-47e6-b7b7-a0dc59e11d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:16.148782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ce75d-ccb3-47e6-b7b7-a0dc59e11d90 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:16.156306 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355be7e-d788-4db3-a222-b0ec5044fdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:16.156864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355be7e-d788-4db3-a222-b0ec5044fdb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:16.157058 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355be7e-d788-4db3-a222-b0ec5044fdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:16.157558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355be7e-d788-4db3-a222-b0ec5044fdb7 admin admin] PATH_INFO: `/v3/projects/0c685d0b0b9c43f597327a49fadc1dc8` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:16.158852 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355be7e-d788-4db3-a222-b0ec5044fdb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c685d0b0b9c43f597327a49fadc1dc8)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:16.160976 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355be7e-d788-4db3-a222-b0ec5044fdb7 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:16.208055 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558f4a7-9e4f-4356-b35d-eb409138a4d1 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:16.215544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b558f4a7-9e4f-4356-b35d-eb409138a4d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:16.225874 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558f4a7-9e4f-4356-b35d-eb409138a4d1 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:16.234895 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabb5af-4929-4f7a-bad3-803b063ecf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:16.242021 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabb5af-4929-4f7a-bad3-803b063ecf67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:16.242021 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabb5af-4929-4f7a-bad3-803b063ecf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:16.242021 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabb5af-4929-4f7a-bad3-803b063ecf67 admin admin] PATH_INFO: `/v3/projects/7d9d63b3b1034d15a8bdbc844089751e` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:16.245532 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabb5af-4929-4f7a-bad3-803b063ecf67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9d63b3b1034d15a8bdbc844089751e)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:16.259543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabb5af-4929-4f7a-bad3-803b063ecf67 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:16.337828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4355be7e-d788-4db3-a222-b0ec5044fdb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c685d0b0b9c43f597327a49fadc1dc8', 'request_id': 'req-4355be7e-d788-4db3-a222-b0ec5044fdb7'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:16.345296 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4355be7e-d788-4db3-a222-b0ec5044fdb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c685d0b0b9c43f597327a49fadc1dc8', 'request_id': 'req-4355be7e-d788-4db3-a222-b0ec5044fdb7'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:16.390233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dbabb5af-4929-4f7a-bad3-803b063ecf67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9d63b3b1034d15a8bdbc844089751e', 'request_id': 'req-dbabb5af-4929-4f7a-bad3-803b063ecf67'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:16.461017 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4355be7e-d788-4db3-a222-b0ec5044fdb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c685d0b0b9c43f597327a49fadc1dc8', 'request_id': 'req-4355be7e-d788-4db3-a222-b0ec5044fdb7'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:16.473453 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4355be7e-d788-4db3-a222-b0ec5044fdb7 admin admin] The token cache is being invalidate because project 0c685d0b0b9c43f597327a49fadc1dc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:04:16.473747 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4355be7e-d788-4db3-a222-b0ec5044fdb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:16.474591 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4355be7e-d788-4db3-a222-b0ec5044fdb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:16.476324 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1244/2476] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:04:16 2022] DELETE /identity/v3/projects/0c685d0b0b9c43f597327a49fadc1dc8 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:16.480038 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355be7e-d788-4db3-a222-b0ec5044fdb7 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:16.482275 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-4355be7e-d788-4db3-a222-b0ec5044fdb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:16.540970 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dbabb5af-4929-4f7a-bad3-803b063ecf67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9d63b3b1034d15a8bdbc844089751e', 'request_id': 'req-dbabb5af-4929-4f7a-bad3-803b063ecf67'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:16.548915 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355be7e-d788-4db3-a222-b0ec5044fdb7 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:16.549846 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dbabb5af-4929-4f7a-bad3-803b063ecf67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9d63b3b1034d15a8bdbc844089751e', 'request_id': 'req-dbabb5af-4929-4f7a-bad3-803b063ecf67'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:16.563649 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dbabb5af-4929-4f7a-bad3-803b063ecf67 admin admin] The token cache is being invalidate because project 7d9d63b3b1034d15a8bdbc844089751e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:04:16.564100 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dbabb5af-4929-4f7a-bad3-803b063ecf67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:16.565675 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-dbabb5af-4929-4f7a-bad3-803b063ecf67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:16.567492 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1233/2477] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:04:16 2022] DELETE /identity/v3/projects/7d9d63b3b1034d15a8bdbc844089751e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:16.572304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4efb0-dd9d-48e0-8be0-df75db72fd82 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:16.572591 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4efb0-dd9d-48e0-8be0-df75db72fd82 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:16.572866 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4efb0-dd9d-48e0-8be0-df75db72fd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:16.593365 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-93b4efb0-dd9d-48e0-8be0-df75db72fd82 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:16.594580 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-93b4efb0-dd9d-48e0-8be0-df75db72fd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:16.612315 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d84c5-27a9-47c2-a2d8-2ee2222871a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:16.613195 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d84c5-27a9-47c2-a2d8-2ee2222871a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:16.613480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d84c5-27a9-47c2-a2d8-2ee2222871a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:16.613759 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d84c5-27a9-47c2-a2d8-2ee2222871a4 admin admin] PATH_INFO: `/v3/users/5f32319db24341f7a8b31c88833e3acc` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:16.615029 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d84c5-27a9-47c2-a2d8-2ee2222871a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f32319db24341f7a8b31c88833e3acc)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:16.616995 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d84c5-27a9-47c2-a2d8-2ee2222871a4 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:16.655456 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1234/2478] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:16.663157 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a23d6-96e1-44b5-876e-10ff657b73c6 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:16.663446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a23d6-96e1-44b5-876e-10ff657b73c6 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:16.663765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a23d6-96e1-44b5-876e-10ff657b73c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:16.682210 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-d57a23d6-96e1-44b5-876e-10ff657b73c6 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:16.683470 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d57a23d6-96e1-44b5-876e-10ff657b73c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:16.691555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1235/2479] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:04:16.701969 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a23d6-96e1-44b5-876e-10ff657b73c6 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:16.710872 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a23d6-96e1-44b5-876e-10ff657b73c6 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:16.716323 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a109fd3-4776-444f-9dfc-e59649b2056b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:16.722165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a109fd3-4776-444f-9dfc-e59649b2056b admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:16.722165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a109fd3-4776-444f-9dfc-e59649b2056b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:16.722165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a109fd3-4776-444f-9dfc-e59649b2056b admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:16.722165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a109fd3-4776-444f-9dfc-e59649b2056b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:04:16.722165 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a109fd3-4776-444f-9dfc-e59649b2056b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:16.727381 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a109fd3-4776-444f-9dfc-e59649b2056b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:16.745704 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1236/2480] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:04:16.746925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a109fd3-4776-444f-9dfc-e59649b2056b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:16.761699 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a109fd3-4776-444f-9dfc-e59649b2056b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:16.767325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae18ec-83df-4e8f-8d6c-5fb1e9bf69df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:16.768167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae18ec-83df-4e8f-8d6c-5fb1e9bf69df admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:16.768443 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae18ec-83df-4e8f-8d6c-5fb1e9bf69df admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:16.768728 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae18ec-83df-4e8f-8d6c-5fb1e9bf69df admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:16.769442 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae18ec-83df-4e8f-8d6c-5fb1e9bf69df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:16.771415 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae18ec-83df-4e8f-8d6c-5fb1e9bf69df admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:16.808561 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-711d84c5-27a9-47c2-a2d8-2ee2222871a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f32319db24341f7a8b31c88833e3acc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:16.809278 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-711d84c5-27a9-47c2-a2d8-2ee2222871a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f32319db24341f7a8b31c88833e3acc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:16.816226 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-711d84c5-27a9-47c2-a2d8-2ee2222871a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f32319db24341f7a8b31c88833e3acc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:16.897316 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-711d84c5-27a9-47c2-a2d8-2ee2222871a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f32319db24341f7a8b31c88833e3acc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:16.905711 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1237/2481] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:04:16 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:04:16.909794 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae18ec-83df-4e8f-8d6c-5fb1e9bf69df admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:16.911555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-74ae18ec-83df-4e8f-8d6c-5fb1e9bf69df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:16.914551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-711d84c5-27a9-47c2-a2d8-2ee2222871a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f32319db24341f7a8b31c88833e3acc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:16.927009 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1245/2482] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:04:16 2022] DELETE /identity/v3/users/5f32319db24341f7a8b31c88833e3acc => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:04:16.978035 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae18ec-83df-4e8f-8d6c-5fb1e9bf69df admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:17.041737 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de358b4-ab74-4ab2-a7ac-fad0ab566810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:17.042302 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de358b4-ab74-4ab2-a7ac-fad0ab566810 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:17.042582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de358b4-ab74-4ab2-a7ac-fad0ab566810 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:17.042856 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de358b4-ab74-4ab2-a7ac-fad0ab566810 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:17.044171 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de358b4-ab74-4ab2-a7ac-fad0ab566810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:17.046348 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de358b4-ab74-4ab2-a7ac-fad0ab566810 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:17.154353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1238/2483] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:04:16 2022] POST /identity/v3/users => generated 287 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:04:17.155349 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d84c5-27a9-47c2-a2d8-2ee2222871a4 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:17.174427 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d84c5-27a9-47c2-a2d8-2ee2222871a4 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:17.199191 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203b2e6-ebe4-4670-a6b5-6041e08c7656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:17.200760 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203b2e6-ebe4-4670-a6b5-6041e08c7656 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:17.201210 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203b2e6-ebe4-4670-a6b5-6041e08c7656 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:17.201648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203b2e6-ebe4-4670-a6b5-6041e08c7656 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:17.203939 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203b2e6-ebe4-4670-a6b5-6041e08c7656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:17.206798 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203b2e6-ebe4-4670-a6b5-6041e08c7656 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:17.228919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1246/2484] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:04:17.233186 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de358b4-ab74-4ab2-a7ac-fad0ab566810 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:17.247660 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de358b4-ab74-4ab2-a7ac-fad0ab566810 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:17.255037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb136f6-563b-4d40-bf7f-4c1efc096ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:17.256100 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb136f6-563b-4d40-bf7f-4c1efc096ecc admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:17.256620 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb136f6-563b-4d40-bf7f-4c1efc096ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:17.257495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb136f6-563b-4d40-bf7f-4c1efc096ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:17.258698 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb136f6-563b-4d40-bf7f-4c1efc096ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:17.260951 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb136f6-563b-4d40-bf7f-4c1efc096ecc admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:17.273282 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1239/2485] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:04:17.278828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203b2e6-ebe4-4670-a6b5-6041e08c7656 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:17.295123 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203b2e6-ebe4-4670-a6b5-6041e08c7656 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:17.310500 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145139a-963d-4784-b55b-559f7776ae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:17.311756 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145139a-963d-4784-b55b-559f7776ae45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:17.312459 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145139a-963d-4784-b55b-559f7776ae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:17.312926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145139a-963d-4784-b55b-559f7776ae45 admin admin] PATH_INFO: `/v3/projects/cfc28aa7473b41d7b1e2482c5f0695eb/users/e6deb8ac1c8344a6b3d737e51dbb4c2d/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:17.338579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145139a-963d-4784-b55b-559f7776ae45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc28aa7473b41d7b1e2482c5f0695eb, user_id=e6deb8ac1c8344a6b3d737e51dbb4c2d, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:17.346026 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145139a-963d-4784-b55b-559f7776ae45 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:17.354234 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb136f6-563b-4d40-bf7f-4c1efc096ecc admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:17.365883 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5cb136f6-563b-4d40-bf7f-4c1efc096ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:17.389114 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb136f6-563b-4d40-bf7f-4c1efc096ecc admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:17.394712 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade11f3e-8f25-40c7-9593-e58cf6ef577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:17.395811 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade11f3e-8f25-40c7-9593-e58cf6ef577c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:17.396197 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade11f3e-8f25-40c7-9593-e58cf6ef577c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:17.396667 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade11f3e-8f25-40c7-9593-e58cf6ef577c admin admin] PATH_INFO: `/v3/users/2bfadf232c01485380e49f97e2465e1f` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:17.398464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade11f3e-8f25-40c7-9593-e58cf6ef577c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bfadf232c01485380e49f97e2465e1f)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:17.402175 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade11f3e-8f25-40c7-9593-e58cf6ef577c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:17.470438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1247/2486] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:04:17 2022] PUT /identity/v3/projects/cfc28aa7473b41d7b1e2482c5f0695eb/users/e6deb8ac1c8344a6b3d737e51dbb4c2d/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:17.472514 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1688d-0d4c-46b7-bde8-2d47bc51d71c None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:17.473336 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1688d-0d4c-46b7-bde8-2d47bc51d71c None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:17.473899 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1688d-0d4c-46b7-bde8-2d47bc51d71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:17.508419 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-13c1688d-0d4c-46b7-bde8-2d47bc51d71c None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:17.509838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-13c1688d-0d4c-46b7-bde8-2d47bc51d71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:17.610712 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1248/2487] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:17.623416 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1688d-0d4c-46b7-bde8-2d47bc51d71c None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:17.624932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-13c1688d-0d4c-46b7-bde8-2d47bc51d71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:17.627122 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-ade11f3e-8f25-40c7-9593-e58cf6ef577c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bfadf232c01485380e49f97e2465e1f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:17.627913 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-ade11f3e-8f25-40c7-9593-e58cf6ef577c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bfadf232c01485380e49f97e2465e1f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:17.694718 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1688d-0d4c-46b7-bde8-2d47bc51d71c None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:17.698892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b8c34-5cad-4060-9865-01e5bb05ea51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:17.700113 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b8c34-5cad-4060-9865-01e5bb05ea51 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:17.701089 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b8c34-5cad-4060-9865-01e5bb05ea51 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:17.701089 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b8c34-5cad-4060-9865-01e5bb05ea51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:17.703246 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-499b8c34-5cad-4060-9865-01e5bb05ea51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:17.710510 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-ade11f3e-8f25-40c7-9593-e58cf6ef577c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bfadf232c01485380e49f97e2465e1f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:17.750537 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-ade11f3e-8f25-40c7-9593-e58cf6ef577c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bfadf232c01485380e49f97e2465e1f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:17.755750 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b8c34-5cad-4060-9865-01e5bb05ea51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:17.757064 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b8c34-5cad-4060-9865-01e5bb05ea51 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:17.769215 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-ade11f3e-8f25-40c7-9593-e58cf6ef577c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bfadf232c01485380e49f97e2465e1f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:17.776438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1249/2488] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:04:17.778116 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b8c34-5cad-4060-9865-01e5bb05ea51 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:17.779882 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-499b8c34-5cad-4060-9865-01e5bb05ea51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:17.787549 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1240/2489] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:04:17 2022] DELETE /identity/v3/users/2bfadf232c01485380e49f97e2465e1f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:17.792694 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d14934-93cb-4920-9448-7c16155bd4df None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:17.795031 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d14934-93cb-4920-9448-7c16155bd4df None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:17.795319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d14934-93cb-4920-9448-7c16155bd4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:17.800865 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b8c34-5cad-4060-9865-01e5bb05ea51 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:17.828802 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-80d14934-93cb-4920-9448-7c16155bd4df None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:17.830098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-80d14934-93cb-4920-9448-7c16155bd4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:17.922744 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1241/2490] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:17.930223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aae7d-e54d-433b-a4d0-5e3ca9f0048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:17.932389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aae7d-e54d-433b-a4d0-5e3ca9f0048b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:17.932389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aae7d-e54d-433b-a4d0-5e3ca9f0048b admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:17.932389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aae7d-e54d-433b-a4d0-5e3ca9f0048b admin admin] PATH_INFO: `/v3/projects/38566c17057e4481aae028e8f95f4eb1` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:17.943501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d14934-93cb-4920-9448-7c16155bd4df None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:17.943816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aae7d-e54d-433b-a4d0-5e3ca9f0048b admin admin] RBAC: Authorizing `identity:delete_project(project_id=38566c17057e4481aae028e8f95f4eb1)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:17.945610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-80d14934-93cb-4920-9448-7c16155bd4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:17.946092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aae7d-e54d-433b-a4d0-5e3ca9f0048b admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:18.037834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d14934-93cb-4920-9448-7c16155bd4df None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:18.042209 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fb295-fedc-43b0-96f0-70d8708d9220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:18.043229 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fb295-fedc-43b0-96f0-70d8708d9220 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:18.043612 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fb295-fedc-43b0-96f0-70d8708d9220 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:18.043896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fb295-fedc-43b0-96f0-70d8708d9220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:18.054245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fb295-fedc-43b0-96f0-70d8708d9220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:18.055764 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fb295-fedc-43b0-96f0-70d8708d9220 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:18.066212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1242/2491] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:04:18.154743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-715aae7d-e54d-433b-a4d0-5e3ca9f0048b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38566c17057e4481aae028e8f95f4eb1', 'request_id': 'req-715aae7d-e54d-433b-a4d0-5e3ca9f0048b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:18.169675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-715aae7d-e54d-433b-a4d0-5e3ca9f0048b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38566c17057e4481aae028e8f95f4eb1', 'request_id': 'req-715aae7d-e54d-433b-a4d0-5e3ca9f0048b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:18.271904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-715aae7d-e54d-433b-a4d0-5e3ca9f0048b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38566c17057e4481aae028e8f95f4eb1', 'request_id': 'req-715aae7d-e54d-433b-a4d0-5e3ca9f0048b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:18.291818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-715aae7d-e54d-433b-a4d0-5e3ca9f0048b admin admin] The token cache is being invalidate because project 38566c17057e4481aae028e8f95f4eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:04:18.292116 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-715aae7d-e54d-433b-a4d0-5e3ca9f0048b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:18.293038 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-715aae7d-e54d-433b-a4d0-5e3ca9f0048b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:18.297024 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1250/2492] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:04:17 2022] DELETE /identity/v3/projects/38566c17057e4481aae028e8f95f4eb1 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:18.301727 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa74aa6-4590-4d8a-98a2-6845b0205922 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:18.307481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa74aa6-4590-4d8a-98a2-6845b0205922 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:18.307481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa74aa6-4590-4d8a-98a2-6845b0205922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:18.344959 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-4aa74aa6-4590-4d8a-98a2-6845b0205922 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:18.344959 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-4aa74aa6-4590-4d8a-98a2-6845b0205922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:18.471072 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1243/2493] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:18.471880 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a0fed-398d-47ce-bf78-95fe7de3ef53 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:18.473527 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a0fed-398d-47ce-bf78-95fe7de3ef53 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:18.473527 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a0fed-398d-47ce-bf78-95fe7de3ef53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:18.508693 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-949a0fed-398d-47ce-bf78-95fe7de3ef53 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:18.511147 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-949a0fed-398d-47ce-bf78-95fe7de3ef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:18.521087 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1251/2494] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:04:18.525954 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa74aa6-4590-4d8a-98a2-6845b0205922 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:18.536554 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa74aa6-4590-4d8a-98a2-6845b0205922 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:18.543918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05dd34f-6e08-43d1-b143-ceeb4b964b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:18.544918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dd34f-6e08-43d1-b143-ceeb4b964b62 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:18.545550 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dd34f-6e08-43d1-b143-ceeb4b964b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:18.546554 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dd34f-6e08-43d1-b143-ceeb4b964b62 admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:18.547363 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05dd34f-6e08-43d1-b143-ceeb4b964b62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:04:18.547866 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05dd34f-6e08-43d1-b143-ceeb4b964b62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:18.551773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05dd34f-6e08-43d1-b143-ceeb4b964b62 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:18.562928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1244/2495] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:04:18.567627 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a0fed-398d-47ce-bf78-95fe7de3ef53 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:18.582868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a0fed-398d-47ce-bf78-95fe7de3ef53 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:18.588053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22e7c3-ced4-4584-9eb1-446554c518c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:18.588775 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e7c3-ced4-4584-9eb1-446554c518c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:18.589063 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e7c3-ced4-4584-9eb1-446554c518c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:18.589339 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e7c3-ced4-4584-9eb1-446554c518c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:18.590029 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22e7c3-ced4-4584-9eb1-446554c518c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:18.603014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22e7c3-ced4-4584-9eb1-446554c518c4 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:18.612865 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05dd34f-6e08-43d1-b143-ceeb4b964b62 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:18.615111 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c05dd34f-6e08-43d1-b143-ceeb4b964b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:18.630746 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05dd34f-6e08-43d1-b143-ceeb4b964b62 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:18.652095 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:18.653742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:18.654027 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:18.656711 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a admin admin] PATH_INFO: `/v3/projects/e52e9120d51e4c2b895764da9185d488` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:18.659378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e52e9120d51e4c2b895764da9185d488)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:18.662403 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:18.688798 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1252/2496] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:04:18 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:04:18.689842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22e7c3-ced4-4584-9eb1-446554c518c4 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:18.792002 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e52e9120d51e4c2b895764da9185d488', 'request_id': 'req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:18.800156 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22e7c3-ced4-4584-9eb1-446554c518c4 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:18.881589 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e52e9120d51e4c2b895764da9185d488', 'request_id': 'req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:18.896223 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e52e9120d51e4c2b895764da9185d488', 'request_id': 'req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:18.918334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279e550-cc4e-44ba-922d-a40260521a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:18.919778 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e550-cc4e-44ba-922d-a40260521a2e admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:18.920139 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e550-cc4e-44ba-922d-a40260521a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:18.920536 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e550-cc4e-44ba-922d-a40260521a2e admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:18.921646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279e550-cc4e-44ba-922d-a40260521a2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:18.923452 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a admin admin] The token cache is being invalidate because project e52e9120d51e4c2b895764da9185d488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:04:18.923771 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:18.924625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:18.924735 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279e550-cc4e-44ba-922d-a40260521a2e admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:18.926223 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1245/2497] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:04:18 2022] DELETE /identity/v3/projects/e52e9120d51e4c2b895764da9185d488 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:19.073577 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:19.074368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1253/2498] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:04:18 2022] POST /identity/v3/users => generated 293 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:04:19.076151 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:19.126742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60233ae0-0a6b-4a6a-b77a-2fea9a56c61a admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:19.147992 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f578220-2669-4ea8-8795-e68a221cec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:19.148775 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f578220-2669-4ea8-8795-e68a221cec23 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:19.149512 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f578220-2669-4ea8-8795-e68a221cec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:19.150633 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f578220-2669-4ea8-8795-e68a221cec23 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:19.152391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f578220-2669-4ea8-8795-e68a221cec23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:19.155705 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f578220-2669-4ea8-8795-e68a221cec23 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:19.189148 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1246/2499] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:04:19.194153 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279e550-cc4e-44ba-922d-a40260521a2e admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:19.207336 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279e550-cc4e-44ba-922d-a40260521a2e admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:19.214700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a7fd1-9bf3-4502-aa7d-6ae58cf93314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:19.216500 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a7fd1-9bf3-4502-aa7d-6ae58cf93314 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:19.216944 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a7fd1-9bf3-4502-aa7d-6ae58cf93314 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:19.217400 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a7fd1-9bf3-4502-aa7d-6ae58cf93314 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:19.218314 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a7fd1-9bf3-4502-aa7d-6ae58cf93314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:19.220184 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a7fd1-9bf3-4502-aa7d-6ae58cf93314 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:19.232993 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1254/2500] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:04:19.237540 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f578220-2669-4ea8-8795-e68a221cec23 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:19.248616 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f578220-2669-4ea8-8795-e68a221cec23 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:19.259804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3c7da-2d8b-40fb-8ae7-b93f680c9ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:19.260725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3c7da-2d8b-40fb-8ae7-b93f680c9ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:19.261991 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3c7da-2d8b-40fb-8ae7-b93f680c9ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:19.262812 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3c7da-2d8b-40fb-8ae7-b93f680c9ea7 admin admin] PATH_INFO: `/v3/projects/762e36752ee249f6be2c1e424823be4d/users/ecb04617daae4c4a868c32925eae77cd/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:19.282656 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3c7da-2d8b-40fb-8ae7-b93f680c9ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=762e36752ee249f6be2c1e424823be4d, user_id=ecb04617daae4c4a868c32925eae77cd, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:19.285628 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3c7da-2d8b-40fb-8ae7-b93f680c9ea7 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:19.424354 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1247/2501] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:04:19 2022] PUT /identity/v3/projects/762e36752ee249f6be2c1e424823be4d/users/ecb04617daae4c4a868c32925eae77cd/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:19.435565 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4c052-27fb-4693-ad5b-98375c8de4f9 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:19.436065 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4c052-27fb-4693-ad5b-98375c8de4f9 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:19.436171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4c052-27fb-4693-ad5b-98375c8de4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:19.481646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-3ba4c052-27fb-4693-ad5b-98375c8de4f9 None None] MFA Rules not processed for user `ecb04617daae4c4a868c32925eae77cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:19.482877 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3ba4c052-27fb-4693-ad5b-98375c8de4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:19.549837 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1255/2502] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:19.562493 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3c7da-2d8b-40fb-8ae7-b93f680c9ea7 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:19.564338 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-adb3c7da-2d8b-40fb-8ae7-b93f680c9ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:19.638374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3c7da-2d8b-40fb-8ae7-b93f680c9ea7 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:19.645067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c569f56-916b-467c-b167-490c7d8409ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:19.645067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c569f56-916b-467c-b167-490c7d8409ab service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:19.645067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c569f56-916b-467c-b167-490c7d8409ab service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:19.645067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c569f56-916b-467c-b167-490c7d8409ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:19.653406 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c569f56-916b-467c-b167-490c7d8409ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:19.655678 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c569f56-916b-467c-b167-490c7d8409ab service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:19.671504 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1248/2503] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:04:19.694048 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4c052-27fb-4693-ad5b-98375c8de4f9 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:19.785036 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4c052-27fb-4693-ad5b-98375c8de4f9 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:19.791257 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10671865-fd38-40e4-9391-85c0b5ade02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:19.792492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10671865-fd38-40e4-9391-85c0b5ade02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:19.792963 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10671865-fd38-40e4-9391-85c0b5ade02c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:19.793556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10671865-fd38-40e4-9391-85c0b5ade02c admin admin] PATH_INFO: `/v3/users/ecb04617daae4c4a868c32925eae77cd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:19.795756 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10671865-fd38-40e4-9391-85c0b5ade02c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb04617daae4c4a868c32925eae77cd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:19.799050 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10671865-fd38-40e4-9391-85c0b5ade02c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:20.005332 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-10671865-fd38-40e4-9391-85c0b5ade02c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb04617daae4c4a868c32925eae77cd'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:20.006892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-10671865-fd38-40e4-9391-85c0b5ade02c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb04617daae4c4a868c32925eae77cd'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:20.022157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-10671865-fd38-40e4-9391-85c0b5ade02c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb04617daae4c4a868c32925eae77cd'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:20.097643 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-10671865-fd38-40e4-9391-85c0b5ade02c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb04617daae4c4a868c32925eae77cd'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:20.111052 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-10671865-fd38-40e4-9391-85c0b5ade02c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb04617daae4c4a868c32925eae77cd'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:20.117357 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1256/2504] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:04:19 2022] DELETE /identity/v3/users/ecb04617daae4c4a868c32925eae77cd => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:04:20.122372 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927aef0-bc14-4f6c-8906-0818bf64e3b3 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:20.122668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927aef0-bc14-4f6c-8906-0818bf64e3b3 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:20.122936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927aef0-bc14-4f6c-8906-0818bf64e3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:20.141192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-6927aef0-bc14-4f6c-8906-0818bf64e3b3 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:20.142548 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-6927aef0-bc14-4f6c-8906-0818bf64e3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:20.223728 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1249/2505] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:20.232038 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10671865-fd38-40e4-9391-85c0b5ade02c admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:20.233532 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-10671865-fd38-40e4-9391-85c0b5ade02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:20.315926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10671865-fd38-40e4-9391-85c0b5ade02c admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:20.320317 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc507dbc-f89b-4ce0-8286-68ef41ce971a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:20.320882 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc507dbc-f89b-4ce0-8286-68ef41ce971a service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:20.321165 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc507dbc-f89b-4ce0-8286-68ef41ce971a service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:20.321441 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc507dbc-f89b-4ce0-8286-68ef41ce971a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:20.331701 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc507dbc-f89b-4ce0-8286-68ef41ce971a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:20.338822 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc507dbc-f89b-4ce0-8286-68ef41ce971a service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:20.350848 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1257/2506] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:04:20.445562 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3971b-2fe8-4793-891c-49291764d4b2 None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:20.446501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3971b-2fe8-4793-891c-49291764d4b2 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:20.447150 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3971b-2fe8-4793-891c-49291764d4b2 None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:20.449315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1250/2507] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 12:04:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:04:20.457379 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534821f-705c-428b-8457-a6d81d5c51ac None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:20.457893 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534821f-705c-428b-8457-a6d81d5c51ac None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:20.457979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534821f-705c-428b-8457-a6d81d5c51ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:20.501681 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-4534821f-705c-428b-8457-a6d81d5c51ac None None] MFA Rules not processed for user `534fd902f96043068e99ca0537cf57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:20.502916 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-4534821f-705c-428b-8457-a6d81d5c51ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:20.581552 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1258/2508] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 12:04:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:04:20.608918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3971b-2fe8-4793-891c-49291764d4b2 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:20.608918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a7e3971b-2fe8-4793-891c-49291764d4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:20.724767 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3971b-2fe8-4793-891c-49291764d4b2 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:20.737394 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97fed8-4c54-42e9-a9cc-ab7271c3e278 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65583446d2e40a69dff534b73e8fa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:20.738086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97fed8-4c54-42e9-a9cc-ab7271c3e278 service glance] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:20.738369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97fed8-4c54-42e9-a9cc-ab7271c3e278 service glance] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:20.738645 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97fed8-4c54-42e9-a9cc-ab7271c3e278 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:20.777683 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97fed8-4c54-42e9-a9cc-ab7271c3e278 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:20.779281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97fed8-4c54-42e9-a9cc-ab7271c3e278 service glance] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:20.826711 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1251/2509] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:04:21.052224 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df152573-3ef4-4637-831d-76006c0a7195 None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:21.058285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df152573-3ef4-4637-831d-76006c0a7195 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:21.058574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df152573-3ef4-4637-831d-76006c0a7195 None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:21.073449 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1259/2510] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 12:04:21 2022] GET /identity => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:04:21.086544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9e12-861e-45f5-90aa-1ee17927a410 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:21.086837 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9e12-861e-45f5-90aa-1ee17927a410 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:21.087341 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9e12-861e-45f5-90aa-1ee17927a410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:21.116048 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-5cfe9e12-861e-45f5-90aa-1ee17927a410 None None] MFA Rules not processed for user `a5f8507c0ae342f7a3e97b48363ad606`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:21.117309 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5cfe9e12-861e-45f5-90aa-1ee17927a410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:21.133894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1252/2511] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 12:04:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:21.161028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df152573-3ef4-4637-831d-76006c0a7195 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:21.163795 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-df152573-3ef4-4637-831d-76006c0a7195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:21.181945 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df152573-3ef4-4637-831d-76006c0a7195 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:21.185913 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb95407-12ca-4f02-b4f4-e1c89f68b236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:21.186627 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb95407-12ca-4f02-b4f4-e1c89f68b236 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:21.186854 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb95407-12ca-4f02-b4f4-e1c89f68b236 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:21.187130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb95407-12ca-4f02-b4f4-e1c89f68b236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:21.197961 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb95407-12ca-4f02-b4f4-e1c89f68b236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:21.199643 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb95407-12ca-4f02-b4f4-e1c89f68b236 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:21.209091 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1260/2512] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:04:21.261750 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe9e12-861e-45f5-90aa-1ee17927a410 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:21.264470 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5cfe9e12-861e-45f5-90aa-1ee17927a410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:21.282930 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe9e12-861e-45f5-90aa-1ee17927a410 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:21.289258 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b39920-8590-4e7f-8862-98bd2a34dbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:21.290384 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b39920-8590-4e7f-8862-98bd2a34dbf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:21.290877 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b39920-8590-4e7f-8862-98bd2a34dbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:21.291427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b39920-8590-4e7f-8862-98bd2a34dbf1 admin admin] PATH_INFO: `/v3/projects/762e36752ee249f6be2c1e424823be4d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:21.293063 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b39920-8590-4e7f-8862-98bd2a34dbf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=762e36752ee249f6be2c1e424823be4d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:21.296294 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b39920-8590-4e7f-8862-98bd2a34dbf1 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:21.383905 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858ed29-80ec-4ae9-a574-bd0ab4206c7a None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:21.384223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858ed29-80ec-4ae9-a574-bd0ab4206c7a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:21.384553 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858ed29-80ec-4ae9-a574-bd0ab4206c7a None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:21.386532 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1261/2513] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 12:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 12:04:21.393497 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68eac7d-c936-4300-a7e1-f078b0cdd202 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:21.393784 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68eac7d-c936-4300-a7e1-f078b0cdd202 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:21.394063 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68eac7d-c936-4300-a7e1-f078b0cdd202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:21.422508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-b68eac7d-c936-4300-a7e1-f078b0cdd202 None None] MFA Rules not processed for user `534fd902f96043068e99ca0537cf57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:21.427225 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-b68eac7d-c936-4300-a7e1-f078b0cdd202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:21.436523 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1262/2514] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 12:04:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:04:21.450865 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68eac7d-c936-4300-a7e1-f078b0cdd202 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:21.460916 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68eac7d-c936-4300-a7e1-f078b0cdd202 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:21.468436 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-81b39920-8590-4e7f-8862-98bd2a34dbf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '762e36752ee249f6be2c1e424823be4d', 'request_id': 'req-81b39920-8590-4e7f-8862-98bd2a34dbf1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:21.526424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88aaad-932a-4ed2-a9c9-7a5cd7986398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:21.536729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88aaad-932a-4ed2-a9c9-7a5cd7986398 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:21.536729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88aaad-932a-4ed2-a9c9-7a5cd7986398 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:21.536729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88aaad-932a-4ed2-a9c9-7a5cd7986398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:21.554974 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-81b39920-8590-4e7f-8862-98bd2a34dbf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '762e36752ee249f6be2c1e424823be4d', 'request_id': 'req-81b39920-8590-4e7f-8862-98bd2a34dbf1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:21.563121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-81b39920-8590-4e7f-8862-98bd2a34dbf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '762e36752ee249f6be2c1e424823be4d', 'request_id': 'req-81b39920-8590-4e7f-8862-98bd2a34dbf1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:21.589882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-81b39920-8590-4e7f-8862-98bd2a34dbf1 admin admin] The token cache is being invalidate because project 762e36752ee249f6be2c1e424823be4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:04:21.590179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-81b39920-8590-4e7f-8862-98bd2a34dbf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:21.593352 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-81b39920-8590-4e7f-8862-98bd2a34dbf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:21.593352 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1253/2515] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:04:21 2022] DELETE /identity/v3/projects/762e36752ee249f6be2c1e424823be4d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:21.597808 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36d03f-e040-46fe-aea6-712349dc3abd None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:21.598098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36d03f-e040-46fe-aea6-712349dc3abd None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:21.598522 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36d03f-e040-46fe-aea6-712349dc3abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:21.629457 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-1a36d03f-e040-46fe-aea6-712349dc3abd None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:21.630793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1a36d03f-e040-46fe-aea6-712349dc3abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:21.662004 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88aaad-932a-4ed2-a9c9-7a5cd7986398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:21.663931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88aaad-932a-4ed2-a9c9-7a5cd7986398 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:21.681628 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1263/2516] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:04:21.716811 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1254/2517] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:04:21.727260 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5a3cd-43dc-4baa-8076-f2efb2dd2cd8 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:21.727601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5a3cd-43dc-4baa-8076-f2efb2dd2cd8 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:21.727852 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5a3cd-43dc-4baa-8076-f2efb2dd2cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:21.758473 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c4d5a3cd-43dc-4baa-8076-f2efb2dd2cd8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:21.761048 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c4d5a3cd-43dc-4baa-8076-f2efb2dd2cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:21.780368 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1264/2518] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:21.785914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36d03f-e040-46fe-aea6-712349dc3abd None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:21.800719 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36d03f-e040-46fe-aea6-712349dc3abd None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:21.806779 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b8070-2ca2-4b23-a82f-f5bb320dc431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:21.808104 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b8070-2ca2-4b23-a82f-f5bb320dc431 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:21.808638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b8070-2ca2-4b23-a82f-f5bb320dc431 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:21.809171 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b8070-2ca2-4b23-a82f-f5bb320dc431 admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:21.811160 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b8070-2ca2-4b23-a82f-f5bb320dc431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:04:21.811573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b8070-2ca2-4b23-a82f-f5bb320dc431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:21.813713 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b8070-2ca2-4b23-a82f-f5bb320dc431 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:21.845296 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1255/2519] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:04:21.849261 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5a3cd-43dc-4baa-8076-f2efb2dd2cd8 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:21.861856 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5a3cd-43dc-4baa-8076-f2efb2dd2cd8 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:21.869666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5b4f0-77a1-4617-9de7-d9aa09bc52bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:21.870653 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5b4f0-77a1-4617-9de7-d9aa09bc52bf admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:21.870933 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5b4f0-77a1-4617-9de7-d9aa09bc52bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:21.871205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5b4f0-77a1-4617-9de7-d9aa09bc52bf admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:21.872874 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5b4f0-77a1-4617-9de7-d9aa09bc52bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:21.874818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5b4f0-77a1-4617-9de7-d9aa09bc52bf admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:22.035715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1265/2520] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:04:21 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:04:22.037120 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b8070-2ca2-4b23-a82f-f5bb320dc431 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:22.067474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b8070-2ca2-4b23-a82f-f5bb320dc431 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:22.191780 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f706c1a-0094-4807-8ab5-4a70e49db46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:22.192642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f706c1a-0094-4807-8ab5-4a70e49db46b admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:22.193120 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f706c1a-0094-4807-8ab5-4a70e49db46b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:22.197947 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f706c1a-0094-4807-8ab5-4a70e49db46b admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:22.197947 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f706c1a-0094-4807-8ab5-4a70e49db46b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:22.197947 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f706c1a-0094-4807-8ab5-4a70e49db46b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:22.380217 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1256/2521] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:04:22 2022] POST /identity/v3/users => generated 288 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:04:22.384459 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5b4f0-77a1-4617-9de7-d9aa09bc52bf admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:22.397910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5b4f0-77a1-4617-9de7-d9aa09bc52bf admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:22.413832 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee3e74-5ad6-4c30-8924-bc951db3cf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:22.414868 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee3e74-5ad6-4c30-8924-bc951db3cf97 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:22.415344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee3e74-5ad6-4c30-8924-bc951db3cf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:22.415852 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee3e74-5ad6-4c30-8924-bc951db3cf97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:22.416821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee3e74-5ad6-4c30-8924-bc951db3cf97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:22.419362 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee3e74-5ad6-4c30-8924-bc951db3cf97 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:22.449024 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f706c1a-0094-4807-8ab5-4a70e49db46b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:22.451112 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1266/2522] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:04:22.461929 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f706c1a-0094-4807-8ab5-4a70e49db46b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:22.477214 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7920c58-d4db-4b08-ae9f-74cf74608e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:22.478674 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7920c58-d4db-4b08-ae9f-74cf74608e0e admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:22.479203 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7920c58-d4db-4b08-ae9f-74cf74608e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:22.479748 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7920c58-d4db-4b08-ae9f-74cf74608e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:22.480706 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7920c58-d4db-4b08-ae9f-74cf74608e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:22.484486 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7920c58-d4db-4b08-ae9f-74cf74608e0e admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:22.517701 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1257/2523] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:04:22.522230 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee3e74-5ad6-4c30-8924-bc951db3cf97 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:22.537712 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee3e74-5ad6-4c30-8924-bc951db3cf97 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:22.551199 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba380d-d541-48cc-82f1-91d6f68555a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:22.553024 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba380d-d541-48cc-82f1-91d6f68555a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:22.553814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba380d-d541-48cc-82f1-91d6f68555a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:22.554511 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba380d-d541-48cc-82f1-91d6f68555a8 admin admin] PATH_INFO: `/v3/projects/83a949ebad604c20ae27ac0e126ea978/users/a434a7de9ad34e3a803ca2f3407ee43d/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:22.604042 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba380d-d541-48cc-82f1-91d6f68555a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a949ebad604c20ae27ac0e126ea978, user_id=a434a7de9ad34e3a803ca2f3407ee43d, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:22.608186 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba380d-d541-48cc-82f1-91d6f68555a8 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:22.689106 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1267/2524] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:04:22 2022] PUT /identity/v3/projects/83a949ebad604c20ae27ac0e126ea978/users/a434a7de9ad34e3a803ca2f3407ee43d/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:22.702404 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccada9-7d5f-4d71-afc7-e0ebfe19d941 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:22.703446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccada9-7d5f-4d71-afc7-e0ebfe19d941 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:22.703790 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccada9-7d5f-4d71-afc7-e0ebfe19d941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:22.735562 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-40ccada9-7d5f-4d71-afc7-e0ebfe19d941 None None] MFA Rules not processed for user `a434a7de9ad34e3a803ca2f3407ee43d`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:22.737206 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-40ccada9-7d5f-4d71-afc7-e0ebfe19d941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:22.813254 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1258/2525] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:22.817938 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba380d-d541-48cc-82f1-91d6f68555a8 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:22.907127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba380d-d541-48cc-82f1-91d6f68555a8 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:22.913782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324dc9d-bccb-43e5-ae13-a15711343964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:22.914457 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324dc9d-bccb-43e5-ae13-a15711343964 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:22.914879 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324dc9d-bccb-43e5-ae13-a15711343964 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:22.915156 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324dc9d-bccb-43e5-ae13-a15711343964 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:22.915910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324dc9d-bccb-43e5-ae13-a15711343964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:22.922148 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324dc9d-bccb-43e5-ae13-a15711343964 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:23.043909 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1268/2526] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:04:22 2022] POST /identity/v3/projects => generated 375 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:04:23.048455 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccada9-7d5f-4d71-afc7-e0ebfe19d941 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:23.059168 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccada9-7d5f-4d71-afc7-e0ebfe19d941 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:23.125321 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce732e9b-b48b-494b-9696-8d68e2bd3740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:23.126360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce732e9b-b48b-494b-9696-8d68e2bd3740 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:23.126837 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce732e9b-b48b-494b-9696-8d68e2bd3740 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:23.127307 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce732e9b-b48b-494b-9696-8d68e2bd3740 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:23.129106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce732e9b-b48b-494b-9696-8d68e2bd3740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:23.132150 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce732e9b-b48b-494b-9696-8d68e2bd3740 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:23.221140 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1259/2527] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:04:23 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:04:23.224935 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324dc9d-bccb-43e5-ae13-a15711343964 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:23.242155 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324dc9d-bccb-43e5-ae13-a15711343964 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:23.256729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f49d8-86e2-46f1-9dd7-f6f2616cc15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:23.257318 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f49d8-86e2-46f1-9dd7-f6f2616cc15b admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:23.257601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f49d8-86e2-46f1-9dd7-f6f2616cc15b admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:23.257881 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f49d8-86e2-46f1-9dd7-f6f2616cc15b admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:23.258613 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f49d8-86e2-46f1-9dd7-f6f2616cc15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:23.262079 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f49d8-86e2-46f1-9dd7-f6f2616cc15b admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:23.288256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1269/2528] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:04:23.293465 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce732e9b-b48b-494b-9696-8d68e2bd3740 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:23.306884 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce732e9b-b48b-494b-9696-8d68e2bd3740 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:23.316078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc0183-e200-430a-b3ce-445237b2daa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:23.318013 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc0183-e200-430a-b3ce-445237b2daa3 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:23.318509 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc0183-e200-430a-b3ce-445237b2daa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:23.319184 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc0183-e200-430a-b3ce-445237b2daa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:23.320188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc0183-e200-430a-b3ce-445237b2daa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:23.323291 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc0183-e200-430a-b3ce-445237b2daa3 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:23.344500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1260/2529] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:04:23.348323 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f49d8-86e2-46f1-9dd7-f6f2616cc15b admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:23.367167 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f49d8-86e2-46f1-9dd7-f6f2616cc15b admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:23.377255 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c293f04-f974-483f-bb28-98c228823a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:23.378507 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c293f04-f974-483f-bb28-98c228823a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:23.378900 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c293f04-f974-483f-bb28-98c228823a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:23.379390 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c293f04-f974-483f-bb28-98c228823a8f admin admin] PATH_INFO: `/v3/projects/35587b2b707349a6bbf0a4445e65130e/users/f5aba0da62f1452d95c651b2f188f03e/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:23.432488 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c293f04-f974-483f-bb28-98c228823a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=35587b2b707349a6bbf0a4445e65130e, user_id=f5aba0da62f1452d95c651b2f188f03e, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:23.439357 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c293f04-f974-483f-bb28-98c228823a8f admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:23.527687 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1270/2530] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:04:23 2022] PUT /identity/v3/projects/35587b2b707349a6bbf0a4445e65130e/users/f5aba0da62f1452d95c651b2f188f03e/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:23.540245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03721319-7d94-4863-a0d1-04a056f9ce69 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:23.541188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03721319-7d94-4863-a0d1-04a056f9ce69 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:23.541646 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03721319-7d94-4863-a0d1-04a056f9ce69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:23.614748 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-03721319-7d94-4863-a0d1-04a056f9ce69 None None] MFA Rules not processed for user `f5aba0da62f1452d95c651b2f188f03e`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:23.616280 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-03721319-7d94-4863-a0d1-04a056f9ce69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:23.733827 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1261/2531] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:23.736728 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c293f04-f974-483f-bb28-98c228823a8f admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:23.849516 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c293f04-f974-483f-bb28-98c228823a8f admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:23.855613 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d29a1-4a23-48bf-9f04-b23202dbc327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:23.857151 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d29a1-4a23-48bf-9f04-b23202dbc327 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:23.857622 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d29a1-4a23-48bf-9f04-b23202dbc327 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:23.858130 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d29a1-4a23-48bf-9f04-b23202dbc327 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:23.858999 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d29a1-4a23-48bf-9f04-b23202dbc327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:23.861210 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d29a1-4a23-48bf-9f04-b23202dbc327 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:23.993164 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1271/2532] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:04:23 2022] POST /identity/v3/projects => generated 375 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:04:23.997137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03721319-7d94-4863-a0d1-04a056f9ce69 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:24.012360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03721319-7d94-4863-a0d1-04a056f9ce69 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:24.082214 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39becf26-cdea-473e-b790-5c8d5611bd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:24.082968 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39becf26-cdea-473e-b790-5c8d5611bd1c admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:24.083248 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39becf26-cdea-473e-b790-5c8d5611bd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:24.083565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39becf26-cdea-473e-b790-5c8d5611bd1c admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:24.084697 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39becf26-cdea-473e-b790-5c8d5611bd1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:24.086245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39becf26-cdea-473e-b790-5c8d5611bd1c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:24.179611 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1262/2533] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:04:23 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:04:24.180783 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d29a1-4a23-48bf-9f04-b23202dbc327 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:24.191359 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d29a1-4a23-48bf-9f04-b23202dbc327 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:24.196307 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e527-9825-4484-987f-4897db8492fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:24.196997 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e527-9825-4484-987f-4897db8492fa admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:24.197285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e527-9825-4484-987f-4897db8492fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:24.197589 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e527-9825-4484-987f-4897db8492fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:24.198310 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5e527-9825-4484-987f-4897db8492fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:24.199980 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5e527-9825-4484-987f-4897db8492fa admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:24.211040 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1272/2534] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:04:24.215209 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39becf26-cdea-473e-b790-5c8d5611bd1c admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:24.226028 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39becf26-cdea-473e-b790-5c8d5611bd1c admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:24.232360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dc619-b09a-4373-8579-766594abc79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:24.236581 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dc619-b09a-4373-8579-766594abc79b admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:24.236581 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dc619-b09a-4373-8579-766594abc79b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:24.236581 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dc619-b09a-4373-8579-766594abc79b admin admin] PATH_INFO: `/v3/projects/f0cf5a5844e042d5b6c22669043ce6a7/users/4072e6022be8493ea9f5ab706e16f4ec/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:24.265016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5dc619-b09a-4373-8579-766594abc79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cf5a5844e042d5b6c22669043ce6a7, user_id=4072e6022be8493ea9f5ab706e16f4ec, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:24.268915 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5dc619-b09a-4373-8579-766594abc79b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:24.401197 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1263/2535] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:04:24 2022] PUT /identity/v3/projects/f0cf5a5844e042d5b6c22669043ce6a7/users/4072e6022be8493ea9f5ab706e16f4ec/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:24.407654 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e527-9825-4484-987f-4897db8492fa admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:24.432030 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e527-9825-4484-987f-4897db8492fa admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:24.525161 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17e66c-3561-43b2-8021-debb95198294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:24.525827 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e66c-3561-43b2-8021-debb95198294 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:24.526222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e66c-3561-43b2-8021-debb95198294 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:24.526604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e66c-3561-43b2-8021-debb95198294 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:24.527433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17e66c-3561-43b2-8021-debb95198294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:24.530324 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17e66c-3561-43b2-8021-debb95198294 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:24.540882 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1273/2536] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:04:24.545028 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dc619-b09a-4373-8579-766594abc79b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:24.556976 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dc619-b09a-4373-8579-766594abc79b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:24.562346 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cec04-ef34-4a02-8f6e-9b8071f5508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:24.563256 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cec04-ef34-4a02-8f6e-9b8071f5508b admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:24.563555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cec04-ef34-4a02-8f6e-9b8071f5508b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:24.563841 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cec04-ef34-4a02-8f6e-9b8071f5508b admin admin] PATH_INFO: `/v3/projects/f0cf5a5844e042d5b6c22669043ce6a7/users/4072e6022be8493ea9f5ab706e16f4ec/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:24.565999 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cec04-ef34-4a02-8f6e-9b8071f5508b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cf5a5844e042d5b6c22669043ce6a7, user_id=4072e6022be8493ea9f5ab706e16f4ec, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:24.568701 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cec04-ef34-4a02-8f6e-9b8071f5508b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:24.581044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1264/2537] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:04:24 2022] PUT /identity/v3/projects/f0cf5a5844e042d5b6c22669043ce6a7/users/4072e6022be8493ea9f5ab706e16f4ec/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:24.592668 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd128e7c-74f9-49b7-a2e5-c4dc96f79f7f None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:24.594283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd128e7c-74f9-49b7-a2e5-c4dc96f79f7f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:24.595609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd128e7c-74f9-49b7-a2e5-c4dc96f79f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:24.628706 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-bd128e7c-74f9-49b7-a2e5-c4dc96f79f7f None None] MFA Rules not processed for user `4072e6022be8493ea9f5ab706e16f4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:24.635298 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-bd128e7c-74f9-49b7-a2e5-c4dc96f79f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:24.763364 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1274/2538] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:24.773837 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cec04-ef34-4a02-8f6e-9b8071f5508b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:24.775687 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-8c1cec04-ef34-4a02-8f6e-9b8071f5508b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:24.875261 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cec04-ef34-4a02-8f6e-9b8071f5508b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:24.880437 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a58484-bc4a-4a31-bbf4-6a2c27358865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:24.881415 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a58484-bc4a-4a31-bbf4-6a2c27358865 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:24.881893 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a58484-bc4a-4a31-bbf4-6a2c27358865 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:24.882360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a58484-bc4a-4a31-bbf4-6a2c27358865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:24.980374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a58484-bc4a-4a31-bbf4-6a2c27358865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:24.981855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a58484-bc4a-4a31-bbf4-6a2c27358865 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:24.991903 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1265/2539] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:04:25.324679 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64e51c-0560-4b98-a2de-df7eeb4b2563 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:25.324979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64e51c-0560-4b98-a2de-df7eeb4b2563 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:25.326396 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64e51c-0560-4b98-a2de-df7eeb4b2563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:25.346756 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-8f64e51c-0560-4b98-a2de-df7eeb4b2563 None None] MFA Rules not processed for user `bda2f2412e6441c3a8c232f39c56fc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:25.348030 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-8f64e51c-0560-4b98-a2de-df7eeb4b2563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:25.411426 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1275/2540] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:25.483378 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a58484-bc4a-4a31-bbf4-6a2c27358865 service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:25.483980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-56a58484-bc4a-4a31-bbf4-6a2c27358865 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:25.578428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a58484-bc4a-4a31-bbf4-6a2c27358865 service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:25.591971 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f9bee-30c2-4042-930c-283f9f91c587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:25.592662 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f9bee-30c2-4042-930c-283f9f91c587 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:25.592931 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f9bee-30c2-4042-930c-283f9f91c587 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:25.593208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f9bee-30c2-4042-930c-283f9f91c587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:25.598149 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d99f9bee-30c2-4042-930c-283f9f91c587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:25.698870 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f9bee-30c2-4042-930c-283f9f91c587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:25.701889 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f9bee-30c2-4042-930c-283f9f91c587 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:25.732777 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1266/2541] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:04:25.890832 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735d277-6af6-43a2-b00f-ffbd22dbc29c None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:25.891669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735d277-6af6-43a2-b00f-ffbd22dbc29c None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:25.892109 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735d277-6af6-43a2-b00f-ffbd22dbc29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:25.939028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-5735d277-6af6-43a2-b00f-ffbd22dbc29c None None] MFA Rules not processed for user `e6deb8ac1c8344a6b3d737e51dbb4c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:25.940947 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-5735d277-6af6-43a2-b00f-ffbd22dbc29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:26.060246 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1276/2542] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:26.065108 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f9bee-30c2-4042-930c-283f9f91c587 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:26.066337 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d99f9bee-30c2-4042-930c-283f9f91c587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:26.172861 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f9bee-30c2-4042-930c-283f9f91c587 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:26.178610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd4e0b-d161-43aa-884b-b23e597da59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:26.180160 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd4e0b-d161-43aa-884b-b23e597da59a admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:26.180611 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd4e0b-d161-43aa-884b-b23e597da59a admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:26.181153 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd4e0b-d161-43aa-884b-b23e597da59a admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:26.182461 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd4e0b-d161-43aa-884b-b23e597da59a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:26.186016 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd4e0b-d161-43aa-884b-b23e597da59a admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:26.358478 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1267/2543] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:04:26 2022] POST /identity/v3/projects => generated 371 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:04:26.362213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735d277-6af6-43a2-b00f-ffbd22dbc29c None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:26.388932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735d277-6af6-43a2-b00f-ffbd22dbc29c None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:26.458794 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790f912-6a6d-46f8-9b11-b499cb09db59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:26.459968 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790f912-6a6d-46f8-9b11-b499cb09db59 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:26.460497 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790f912-6a6d-46f8-9b11-b499cb09db59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:26.461268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790f912-6a6d-46f8-9b11-b499cb09db59 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:26.462452 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790f912-6a6d-46f8-9b11-b499cb09db59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:26.464692 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790f912-6a6d-46f8-9b11-b499cb09db59 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:26.572477 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1277/2544] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:04:26 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:04:26.577109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd4e0b-d161-43aa-884b-b23e597da59a admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:26.592928 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd4e0b-d161-43aa-884b-b23e597da59a admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:26.629624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5ba88-ce4c-4bec-8e2e-9aee9ba8671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:26.630640 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5ba88-ce4c-4bec-8e2e-9aee9ba8671c admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:26.631110 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5ba88-ce4c-4bec-8e2e-9aee9ba8671c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:26.631624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5ba88-ce4c-4bec-8e2e-9aee9ba8671c admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:26.633436 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5ba88-ce4c-4bec-8e2e-9aee9ba8671c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:26.636671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5ba88-ce4c-4bec-8e2e-9aee9ba8671c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:26.686790 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1268/2545] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:04:26.692020 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790f912-6a6d-46f8-9b11-b499cb09db59 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:26.707638 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790f912-6a6d-46f8-9b11-b499cb09db59 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:26.721292 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11624e-f9de-4df8-9b9e-dc2a442bdf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:26.723201 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11624e-f9de-4df8-9b9e-dc2a442bdf7a admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:26.725942 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11624e-f9de-4df8-9b9e-dc2a442bdf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:26.728047 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11624e-f9de-4df8-9b9e-dc2a442bdf7a admin admin] PATH_INFO: `/v3/projects/3dc0e3bffb9d49e788fc11efd21eee1c/users/57e0914759314ed68e36afd3ec1cd649/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:26.768512 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11624e-f9de-4df8-9b9e-dc2a442bdf7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc0e3bffb9d49e788fc11efd21eee1c, user_id=57e0914759314ed68e36afd3ec1cd649, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:26.771555 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11624e-f9de-4df8-9b9e-dc2a442bdf7a admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:26.898018 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1278/2546] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:04:26 2022] PUT /identity/v3/projects/3dc0e3bffb9d49e788fc11efd21eee1c/users/57e0914759314ed68e36afd3ec1cd649/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:26.899367 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5ba88-ce4c-4bec-8e2e-9aee9ba8671c admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:26.916938 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5ba88-ce4c-4bec-8e2e-9aee9ba8671c admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:27.113192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef023c-207a-460a-8d09-a268e847849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:27.113881 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef023c-207a-460a-8d09-a268e847849a admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:27.114161 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef023c-207a-460a-8d09-a268e847849a admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:27.114450 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef023c-207a-460a-8d09-a268e847849a admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:27.115201 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef023c-207a-460a-8d09-a268e847849a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:27.116887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef023c-207a-460a-8d09-a268e847849a admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:27.141399 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1269/2547] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:04:27.145614 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11624e-f9de-4df8-9b9e-dc2a442bdf7a admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:27.163608 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11624e-f9de-4df8-9b9e-dc2a442bdf7a admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:27.170546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f21156-83c9-45eb-b7bc-fb77fc242d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:27.171753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f21156-83c9-45eb-b7bc-fb77fc242d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:27.172405 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f21156-83c9-45eb-b7bc-fb77fc242d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:27.172835 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f21156-83c9-45eb-b7bc-fb77fc242d99 admin admin] PATH_INFO: `/v3/projects/3dc0e3bffb9d49e788fc11efd21eee1c/users/57e0914759314ed68e36afd3ec1cd649/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:27.176439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f21156-83c9-45eb-b7bc-fb77fc242d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc0e3bffb9d49e788fc11efd21eee1c, user_id=57e0914759314ed68e36afd3ec1cd649, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:27.181624 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f21156-83c9-45eb-b7bc-fb77fc242d99 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:27.203943 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1279/2548] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:04:27 2022] PUT /identity/v3/projects/3dc0e3bffb9d49e788fc11efd21eee1c/users/57e0914759314ed68e36afd3ec1cd649/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:27.339989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef023c-207a-460a-8d09-a268e847849a admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:27.342392 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-daef023c-207a-460a-8d09-a268e847849a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:27.428807 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef023c-207a-460a-8d09-a268e847849a admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:27.517541 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32aef3-1a32-4955-bde1-e9b8b54f2ab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:27.518489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32aef3-1a32-4955-bde1-e9b8b54f2ab0 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:27.520849 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32aef3-1a32-4955-bde1-e9b8b54f2ab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:27.520849 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32aef3-1a32-4955-bde1-e9b8b54f2ab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:27.636394 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32aef3-1a32-4955-bde1-e9b8b54f2ab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:27.638826 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32aef3-1a32-4955-bde1-e9b8b54f2ab0 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:27.664457 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1270/2549] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:04:27.732965 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa66d94-40b1-4f1e-9f2e-282eec4c9671 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:27.733570 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa66d94-40b1-4f1e-9f2e-282eec4c9671 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:27.733969 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa66d94-40b1-4f1e-9f2e-282eec4c9671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:27.778358 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-1aa66d94-40b1-4f1e-9f2e-282eec4c9671 None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:27.782540 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-1aa66d94-40b1-4f1e-9f2e-282eec4c9671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:27.972682 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1280/2550] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 12:04:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:27.997960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32aef3-1a32-4955-bde1-e9b8b54f2ab0 service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:27.997960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-2e32aef3-1a32-4955-bde1-e9b8b54f2ab0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:28.278341 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32aef3-1a32-4955-bde1-e9b8b54f2ab0 service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:28.284410 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd81b80-1ce0-4c8e-a9dc-81c29c713a26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:28.285174 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd81b80-1ce0-4c8e-a9dc-81c29c713a26 service swift] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:28.285519 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd81b80-1ce0-4c8e-a9dc-81c29c713a26 service swift] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:28.285861 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd81b80-1ce0-4c8e-a9dc-81c29c713a26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:28.296012 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd81b80-1ce0-4c8e-a9dc-81c29c713a26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:28.297652 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd81b80-1ce0-4c8e-a9dc-81c29c713a26 service swift] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:28.305936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1271/2551] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:04:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 12:04:29.772948 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa66d94-40b1-4f1e-9f2e-282eec4c9671 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:29.784897 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa66d94-40b1-4f1e-9f2e-282eec4c9671 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:29.789020 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1dfd2-ffe4-47da-aa31-595c827b7a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:29.789920 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1dfd2-ffe4-47da-aa31-595c827b7a30 service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:29.790402 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1dfd2-ffe4-47da-aa31-595c827b7a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:29.791408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1dfd2-ffe4-47da-aa31-595c827b7a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:29.861091 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1dfd2-ffe4-47da-aa31-595c827b7a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:29.863156 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1dfd2-ffe4-47da-aa31-595c827b7a30 service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:29.885411 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1281/2552] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:04:36.491197 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd81b80-1ce0-4c8e-a9dc-81c29c713a26 service swift] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:36.622400 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd81b80-1ce0-4c8e-a9dc-81c29c713a26 service swift] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:36.628331 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbb930-5fac-4483-831d-4fc214a820fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:36.629337 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbb930-5fac-4483-831d-4fc214a820fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:36.629619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbb930-5fac-4483-831d-4fc214a820fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:36.629893 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbb930-5fac-4483-831d-4fc214a820fc admin admin] PATH_INFO: `/v3/users/a434a7de9ad34e3a803ca2f3407ee43d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:36.631248 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbb930-5fac-4483-831d-4fc214a820fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a434a7de9ad34e3a803ca2f3407ee43d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:36.633246 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbb930-5fac-4483-831d-4fc214a820fc admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:37.191935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-49fbb930-5fac-4483-831d-4fc214a820fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a434a7de9ad34e3a803ca2f3407ee43d'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:37.193416 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-49fbb930-5fac-4483-831d-4fc214a820fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a434a7de9ad34e3a803ca2f3407ee43d'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:37.326098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-49fbb930-5fac-4483-831d-4fc214a820fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a434a7de9ad34e3a803ca2f3407ee43d'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:37.361248 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-49fbb930-5fac-4483-831d-4fc214a820fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a434a7de9ad34e3a803ca2f3407ee43d'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:37.392486 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-49fbb930-5fac-4483-831d-4fc214a820fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a434a7de9ad34e3a803ca2f3407ee43d'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:37.402334 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1272/2553] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:04:36 2022] DELETE /identity/v3/users/a434a7de9ad34e3a803ca2f3407ee43d => generated 0 bytes in 913 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:37.409776 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1a2be-62f2-49ca-9cd1-f6c2ad212463 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:37.410420 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1a2be-62f2-49ca-9cd1-f6c2ad212463 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:37.410420 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1a2be-62f2-49ca-9cd1-f6c2ad212463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:37.456343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-53b1a2be-62f2-49ca-9cd1-f6c2ad212463 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:37.457604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-53b1a2be-62f2-49ca-9cd1-f6c2ad212463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:37.596471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1282/2554] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:37.609524 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbb930-5fac-4483-831d-4fc214a820fc admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:37.614319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-49fbb930-5fac-4483-831d-4fc214a820fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:37.845258 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbb930-5fac-4483-831d-4fc214a820fc admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:37.859488 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435cb37-cbfe-442d-97aa-315a7a3e4f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:37.867499 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435cb37-cbfe-442d-97aa-315a7a3e4f90 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:37.867864 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435cb37-cbfe-442d-97aa-315a7a3e4f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:37.871760 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435cb37-cbfe-442d-97aa-315a7a3e4f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:37.906596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435cb37-cbfe-442d-97aa-315a7a3e4f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:37.911626 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435cb37-cbfe-442d-97aa-315a7a3e4f90 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:37.943751 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1273/2555] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:04:38.770558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1a2be-62f2-49ca-9cd1-f6c2ad212463 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:38.774218 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-53b1a2be-62f2-49ca-9cd1-f6c2ad212463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:38.793854 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1a2be-62f2-49ca-9cd1-f6c2ad212463 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:38.801819 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19768fe5-f7c7-4059-911c-4c2f17eaed11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:38.803261 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19768fe5-f7c7-4059-911c-4c2f17eaed11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:38.804716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19768fe5-f7c7-4059-911c-4c2f17eaed11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:38.805411 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19768fe5-f7c7-4059-911c-4c2f17eaed11 admin admin] PATH_INFO: `/v3/projects/83a949ebad604c20ae27ac0e126ea978` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:38.814300 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19768fe5-f7c7-4059-911c-4c2f17eaed11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a949ebad604c20ae27ac0e126ea978)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:38.817116 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19768fe5-f7c7-4059-911c-4c2f17eaed11 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:39.386445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-19768fe5-f7c7-4059-911c-4c2f17eaed11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a949ebad604c20ae27ac0e126ea978', 'request_id': 'req-19768fe5-f7c7-4059-911c-4c2f17eaed11'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:39.394063 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-19768fe5-f7c7-4059-911c-4c2f17eaed11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a949ebad604c20ae27ac0e126ea978', 'request_id': 'req-19768fe5-f7c7-4059-911c-4c2f17eaed11'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:39.483633 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-19768fe5-f7c7-4059-911c-4c2f17eaed11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a949ebad604c20ae27ac0e126ea978', 'request_id': 'req-19768fe5-f7c7-4059-911c-4c2f17eaed11'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:39.518488 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-19768fe5-f7c7-4059-911c-4c2f17eaed11 admin admin] The token cache is being invalidate because project 83a949ebad604c20ae27ac0e126ea978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:04:39.518763 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-19768fe5-f7c7-4059-911c-4c2f17eaed11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:39.519698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-19768fe5-f7c7-4059-911c-4c2f17eaed11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:39.521719 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1283/2556] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:04:38 2022] DELETE /identity/v3/projects/83a949ebad604c20ae27ac0e126ea978 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:39.526272 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435cb37-cbfe-442d-97aa-315a7a3e4f90 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:39.547038 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435cb37-cbfe-442d-97aa-315a7a3e4f90 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:39.668182 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fff485-23ad-4ffc-a616-5407d1355bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:39.669113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fff485-23ad-4ffc-a616-5407d1355bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:39.669353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fff485-23ad-4ffc-a616-5407d1355bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:39.669626 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fff485-23ad-4ffc-a616-5407d1355bc5 admin admin] PATH_INFO: `/v3/users/f5aba0da62f1452d95c651b2f188f03e` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:39.674718 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fff485-23ad-4ffc-a616-5407d1355bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5aba0da62f1452d95c651b2f188f03e)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:39.677082 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fff485-23ad-4ffc-a616-5407d1355bc5 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:39.962487 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c4fff485-23ad-4ffc-a616-5407d1355bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5aba0da62f1452d95c651b2f188f03e'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:39.965038 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c4fff485-23ad-4ffc-a616-5407d1355bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5aba0da62f1452d95c651b2f188f03e'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:40.104888 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c4fff485-23ad-4ffc-a616-5407d1355bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5aba0da62f1452d95c651b2f188f03e'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:40.128815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c4fff485-23ad-4ffc-a616-5407d1355bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5aba0da62f1452d95c651b2f188f03e'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:40.142975 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c4fff485-23ad-4ffc-a616-5407d1355bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5aba0da62f1452d95c651b2f188f03e'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:40.169475 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1274/2557] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:04:39 2022] DELETE /identity/v3/users/f5aba0da62f1452d95c651b2f188f03e => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:40.444412 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee81b5-4439-41e5-88ae-15cdf6dd6226 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:40.445244 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee81b5-4439-41e5-88ae-15cdf6dd6226 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:40.445514 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee81b5-4439-41e5-88ae-15cdf6dd6226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:40.511423 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-7cee81b5-4439-41e5-88ae-15cdf6dd6226 None None] MFA Rules not processed for user `57e0914759314ed68e36afd3ec1cd649`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:40.512716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-7cee81b5-4439-41e5-88ae-15cdf6dd6226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:40.705154 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1284/2558] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:40.855780 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fff485-23ad-4ffc-a616-5407d1355bc5 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:40.855780 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c4fff485-23ad-4ffc-a616-5407d1355bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:41.285504 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fff485-23ad-4ffc-a616-5407d1355bc5 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:41.302295 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c597c49-ebfd-453f-a4fc-8141fc71c22b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:41.303806 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c597c49-ebfd-453f-a4fc-8141fc71c22b service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:41.304276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c597c49-ebfd-453f-a4fc-8141fc71c22b service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:41.307051 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c597c49-ebfd-453f-a4fc-8141fc71c22b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:41.309260 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-3c597c49-ebfd-453f-a4fc-8141fc71c22b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:41.385154 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee81b5-4439-41e5-88ae-15cdf6dd6226 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:41.388209 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-7cee81b5-4439-41e5-88ae-15cdf6dd6226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:41.500817 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c597c49-ebfd-453f-a4fc-8141fc71c22b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:41.503377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c597c49-ebfd-453f-a4fc-8141fc71c22b service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:41.515712 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1275/2559] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:04:41.534891 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee81b5-4439-41e5-88ae-15cdf6dd6226 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:41.543748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30249d6-ba45-484c-af8e-a0a483811574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:41.543748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30249d6-ba45-484c-af8e-a0a483811574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:41.543748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30249d6-ba45-484c-af8e-a0a483811574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:41.543748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30249d6-ba45-484c-af8e-a0a483811574 admin admin] PATH_INFO: `/v3/projects/35587b2b707349a6bbf0a4445e65130e` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:41.544382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30249d6-ba45-484c-af8e-a0a483811574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35587b2b707349a6bbf0a4445e65130e)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:41.547042 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30249d6-ba45-484c-af8e-a0a483811574 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:41.703786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c30249d6-ba45-484c-af8e-a0a483811574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35587b2b707349a6bbf0a4445e65130e', 'request_id': 'req-c30249d6-ba45-484c-af8e-a0a483811574'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:41.710843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c30249d6-ba45-484c-af8e-a0a483811574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35587b2b707349a6bbf0a4445e65130e', 'request_id': 'req-c30249d6-ba45-484c-af8e-a0a483811574'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:41.800397 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c30249d6-ba45-484c-af8e-a0a483811574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35587b2b707349a6bbf0a4445e65130e', 'request_id': 'req-c30249d6-ba45-484c-af8e-a0a483811574'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:41.812808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c30249d6-ba45-484c-af8e-a0a483811574 admin admin] The token cache is being invalidate because project 35587b2b707349a6bbf0a4445e65130e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:04:41.813171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c30249d6-ba45-484c-af8e-a0a483811574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:41.813844 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-c30249d6-ba45-484c-af8e-a0a483811574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:41.815403 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1285/2560] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:04:41 2022] DELETE /identity/v3/projects/35587b2b707349a6bbf0a4445e65130e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:41.819370 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c597c49-ebfd-453f-a4fc-8141fc71c22b service nova] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:41.829798 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c597c49-ebfd-453f-a4fc-8141fc71c22b service nova] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:41.891813 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfa8f3-2d7f-4f73-bd27-e6ee219db512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:41.892938 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfa8f3-2d7f-4f73-bd27-e6ee219db512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:41.893223 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfa8f3-2d7f-4f73-bd27-e6ee219db512 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:41.893500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfa8f3-2d7f-4f73-bd27-e6ee219db512 admin admin] PATH_INFO: `/v3/users/4072e6022be8493ea9f5ab706e16f4ec` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:41.896078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfa8f3-2d7f-4f73-bd27-e6ee219db512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4072e6022be8493ea9f5ab706e16f4ec)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:41.898696 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfa8f3-2d7f-4f73-bd27-e6ee219db512 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:42.126900 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-bfbfa8f3-2d7f-4f73-bd27-e6ee219db512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4072e6022be8493ea9f5ab706e16f4ec'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:42.127436 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-bfbfa8f3-2d7f-4f73-bd27-e6ee219db512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4072e6022be8493ea9f5ab706e16f4ec'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:42.210325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-bfbfa8f3-2d7f-4f73-bd27-e6ee219db512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4072e6022be8493ea9f5ab706e16f4ec'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:42.225337 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-bfbfa8f3-2d7f-4f73-bd27-e6ee219db512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4072e6022be8493ea9f5ab706e16f4ec'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:42.232508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-bfbfa8f3-2d7f-4f73-bd27-e6ee219db512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4072e6022be8493ea9f5ab706e16f4ec'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:42.253616 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1276/2561] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:04:41 2022] DELETE /identity/v3/users/4072e6022be8493ea9f5ab706e16f4ec => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:42.911507 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30249d6-ba45-484c-af8e-a0a483811574 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:42.913607 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c30249d6-ba45-484c-af8e-a0a483811574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:42.930314 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30249d6-ba45-484c-af8e-a0a483811574 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:43.030969 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967108f-6787-4619-ab95-6cf50c923f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:43.032369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967108f-6787-4619-ab95-6cf50c923f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:43.032798 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967108f-6787-4619-ab95-6cf50c923f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:43.033213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967108f-6787-4619-ab95-6cf50c923f40 admin admin] PATH_INFO: `/v3/projects/f0cf5a5844e042d5b6c22669043ce6a7` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:43.035112 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967108f-6787-4619-ab95-6cf50c923f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0cf5a5844e042d5b6c22669043ce6a7)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:43.038243 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967108f-6787-4619-ab95-6cf50c923f40 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:43.238107 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4967108f-6787-4619-ab95-6cf50c923f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0cf5a5844e042d5b6c22669043ce6a7', 'request_id': 'req-4967108f-6787-4619-ab95-6cf50c923f40'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:43.246493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4967108f-6787-4619-ab95-6cf50c923f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0cf5a5844e042d5b6c22669043ce6a7', 'request_id': 'req-4967108f-6787-4619-ab95-6cf50c923f40'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:43.334205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4967108f-6787-4619-ab95-6cf50c923f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0cf5a5844e042d5b6c22669043ce6a7', 'request_id': 'req-4967108f-6787-4619-ab95-6cf50c923f40'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:43.345498 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4967108f-6787-4619-ab95-6cf50c923f40 admin admin] The token cache is being invalidate because project f0cf5a5844e042d5b6c22669043ce6a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:04:43.345787 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4967108f-6787-4619-ab95-6cf50c923f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:43.346454 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4967108f-6787-4619-ab95-6cf50c923f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:43.348057 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1286/2562] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:04:42 2022] DELETE /identity/v3/projects/f0cf5a5844e042d5b6c22669043ce6a7 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:44.739937 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece0906-4fac-4a0d-ac76-d3ed9bd7c002 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:44.740517 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece0906-4fac-4a0d-ac76-d3ed9bd7c002 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:44.740517 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece0906-4fac-4a0d-ac76-d3ed9bd7c002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:44.759358 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-bece0906-4fac-4a0d-ac76-d3ed9bd7c002 None None] MFA Rules not processed for user `e6deb8ac1c8344a6b3d737e51dbb4c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:44.760614 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-bece0906-4fac-4a0d-ac76-d3ed9bd7c002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:44.818314 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1277/2563] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:57.257026 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967108f-6787-4619-ab95-6cf50c923f40 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:57.258604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-4967108f-6787-4619-ab95-6cf50c923f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:57.328544 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967108f-6787-4619-ab95-6cf50c923f40 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:57.333450 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f220b-6169-4a01-a30d-5a85ad12ed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:57.334860 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f220b-6169-4a01-a30d-5a85ad12ed4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:57.335137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f220b-6169-4a01-a30d-5a85ad12ed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:57.335410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f220b-6169-4a01-a30d-5a85ad12ed4c admin admin] PATH_INFO: `/v3/users/ff1dfe51ba0d4b0d938d7fa10e154eb4` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:57.336669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f220b-6169-4a01-a30d-5a85ad12ed4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1dfe51ba0d4b0d938d7fa10e154eb4)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:57.342675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f220b-6169-4a01-a30d-5a85ad12ed4c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:57.567982 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-fb3f220b-6169-4a01-a30d-5a85ad12ed4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1dfe51ba0d4b0d938d7fa10e154eb4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:57.569204 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-fb3f220b-6169-4a01-a30d-5a85ad12ed4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1dfe51ba0d4b0d938d7fa10e154eb4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:57.576722 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-fb3f220b-6169-4a01-a30d-5a85ad12ed4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1dfe51ba0d4b0d938d7fa10e154eb4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:57.649006 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-fb3f220b-6169-4a01-a30d-5a85ad12ed4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1dfe51ba0d4b0d938d7fa10e154eb4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:57.661115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-fb3f220b-6169-4a01-a30d-5a85ad12ed4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1dfe51ba0d4b0d938d7fa10e154eb4'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:57.667334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1287/2564] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:04:57 2022] DELETE /identity/v3/users/ff1dfe51ba0d4b0d938d7fa10e154eb4 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:57.917596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece0906-4fac-4a0d-ac76-d3ed9bd7c002 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:57.930383 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece0906-4fac-4a0d-ac76-d3ed9bd7c002 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:57.988759 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfea9c-214b-40b8-9cf5-87b5451bcc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:57.989535 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfea9c-214b-40b8-9cf5-87b5451bcc69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:57.989819 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfea9c-214b-40b8-9cf5-87b5451bcc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:57.990651 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfea9c-214b-40b8-9cf5-87b5451bcc69 admin admin] PATH_INFO: `/v3/projects/149f308259a840469dbeaee05e828ae4` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:57.992692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfea9c-214b-40b8-9cf5-87b5451bcc69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=149f308259a840469dbeaee05e828ae4)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:57.994587 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfea9c-214b-40b8-9cf5-87b5451bcc69 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:58.085513 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-37cfea9c-214b-40b8-9cf5-87b5451bcc69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149f308259a840469dbeaee05e828ae4', 'request_id': 'req-37cfea9c-214b-40b8-9cf5-87b5451bcc69'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:58.116085 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da854-386f-4a53-b4d3-9ccaa9541a89 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:58.116588 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da854-386f-4a53-b4d3-9ccaa9541a89 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:58.117024 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da854-386f-4a53-b4d3-9ccaa9541a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:58.135206 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-37cfea9c-214b-40b8-9cf5-87b5451bcc69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149f308259a840469dbeaee05e828ae4', 'request_id': 'req-37cfea9c-214b-40b8-9cf5-87b5451bcc69'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:58.136047 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-944da854-386f-4a53-b4d3-9ccaa9541a89 None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:58.137263 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-944da854-386f-4a53-b4d3-9ccaa9541a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:58.142611 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-37cfea9c-214b-40b8-9cf5-87b5451bcc69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149f308259a840469dbeaee05e828ae4', 'request_id': 'req-37cfea9c-214b-40b8-9cf5-87b5451bcc69'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:58.154671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-37cfea9c-214b-40b8-9cf5-87b5451bcc69 admin admin] The token cache is being invalidate because project 149f308259a840469dbeaee05e828ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:04:58.154962 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-37cfea9c-214b-40b8-9cf5-87b5451bcc69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:58.155681 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-37cfea9c-214b-40b8-9cf5-87b5451bcc69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:04:58.161685 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1278/2565] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:04:57 2022] DELETE /identity/v3/projects/149f308259a840469dbeaee05e828ae4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:58.165560 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce0291-4cfc-48ba-a2d5-ac7da134c984 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:58.165932 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce0291-4cfc-48ba-a2d5-ac7da134c984 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:58.166305 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce0291-4cfc-48ba-a2d5-ac7da134c984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:58.189747 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-20ce0291-4cfc-48ba-a2d5-ac7da134c984 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:58.191071 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-20ce0291-4cfc-48ba-a2d5-ac7da134c984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:58.248672 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1288/2566] 10.222.0.52 () {58 vars in 967 bytes} [Tue Mar 8 12:04:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:04:58.264819 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1279/2567] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:58.268947 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944da854-386f-4a53-b4d3-9ccaa9541a89 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:58.272604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-944da854-386f-4a53-b4d3-9ccaa9541a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:58.273101 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda67d8c-4413-40c2-91ca-8f19af787617 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:58.273399 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda67d8c-4413-40c2-91ca-8f19af787617 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:58.273679 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda67d8c-4413-40c2-91ca-8f19af787617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:58.295233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-bda67d8c-4413-40c2-91ca-8f19af787617 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:58.296491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-bda67d8c-4413-40c2-91ca-8f19af787617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:58.305446 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1280/2568] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:04:58.311085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda67d8c-4413-40c2-91ca-8f19af787617 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:58.323101 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda67d8c-4413-40c2-91ca-8f19af787617 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:58.328019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cd80a-e07d-4c67-92b7-c930235586ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:58.328798 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cd80a-e07d-4c67-92b7-c930235586ca admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:58.329267 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cd80a-e07d-4c67-92b7-c930235586ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:58.329619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cd80a-e07d-4c67-92b7-c930235586ca admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:58.330419 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cd80a-e07d-4c67-92b7-c930235586ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:04:58.330787 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cd80a-e07d-4c67-92b7-c930235586ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:58.332578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cd80a-e07d-4c67-92b7-c930235586ca admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:58.349917 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1281/2569] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:04:58.350828 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944da854-386f-4a53-b4d3-9ccaa9541a89 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:58.354325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cd80a-e07d-4c67-92b7-c930235586ca admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:58.358650 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155a7ce-811b-4a15-9e20-fc9a5257ca08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:58.359590 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155a7ce-811b-4a15-9e20-fc9a5257ca08 service swift] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:58.359906 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155a7ce-811b-4a15-9e20-fc9a5257ca08 service swift] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:58.360269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155a7ce-811b-4a15-9e20-fc9a5257ca08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:58.364903 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cd80a-e07d-4c67-92b7-c930235586ca admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:58.369898 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155a7ce-811b-4a15-9e20-fc9a5257ca08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:58.371605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f00b8-49d9-48f7-9b04-9cb5f5310a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:58.371844 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f00b8-49d9-48f7-9b04-9cb5f5310a91 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:58.371953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f00b8-49d9-48f7-9b04-9cb5f5310a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:58.372216 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f00b8-49d9-48f7-9b04-9cb5f5310a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:58.372486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155a7ce-811b-4a15-9e20-fc9a5257ca08 service swift] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:58.372911 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f00b8-49d9-48f7-9b04-9cb5f5310a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:58.374836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f00b8-49d9-48f7-9b04-9cb5f5310a91 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:58.383061 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1289/2570] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:04:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 12:04:58.506299 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1282/2571] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:04:58 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:04:58.510480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155a7ce-811b-4a15-9e20-fc9a5257ca08 service swift] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:58.521244 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155a7ce-811b-4a15-9e20-fc9a5257ca08 service swift] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:58.587845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540801c-2f6e-446c-9c2e-3d87adefa157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:58.588538 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540801c-2f6e-446c-9c2e-3d87adefa157 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:58.588815 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540801c-2f6e-446c-9c2e-3d87adefa157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:58.589101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540801c-2f6e-446c-9c2e-3d87adefa157 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:58.589798 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540801c-2f6e-446c-9c2e-3d87adefa157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:58.591808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540801c-2f6e-446c-9c2e-3d87adefa157 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:58.665454 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1290/2572] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:04:58 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:04:58.669641 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f00b8-49d9-48f7-9b04-9cb5f5310a91 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:58.681207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f00b8-49d9-48f7-9b04-9cb5f5310a91 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:58.686028 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8aa9b-e290-463b-9d78-ab6c7eebc1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:58.686614 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8aa9b-e290-463b-9d78-ab6c7eebc1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:58.686896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8aa9b-e290-463b-9d78-ab6c7eebc1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:58.687169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8aa9b-e290-463b-9d78-ab6c7eebc1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:58.687953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8aa9b-e290-463b-9d78-ab6c7eebc1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:58.689582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8aa9b-e290-463b-9d78-ab6c7eebc1e2 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:58.700388 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1283/2573] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:04:58.704455 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540801c-2f6e-446c-9c2e-3d87adefa157 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:58.715752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540801c-2f6e-446c-9c2e-3d87adefa157 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:58.720637 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966decd-8c9f-422c-9f13-ca43b0ac359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:58.721300 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966decd-8c9f-422c-9f13-ca43b0ac359f admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:58.721577 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966decd-8c9f-422c-9f13-ca43b0ac359f admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:58.721867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966decd-8c9f-422c-9f13-ca43b0ac359f admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:58.722586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966decd-8c9f-422c-9f13-ca43b0ac359f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:58.724230 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966decd-8c9f-422c-9f13-ca43b0ac359f admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:58.738070 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1291/2574] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:04:58.740701 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8aa9b-e290-463b-9d78-ab6c7eebc1e2 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:58.751343 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8aa9b-e290-463b-9d78-ab6c7eebc1e2 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:58.756269 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac2286-d2c2-4390-8ef7-da5f2f22f96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:58.757226 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac2286-d2c2-4390-8ef7-da5f2f22f96f admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:58.757444 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac2286-d2c2-4390-8ef7-da5f2f22f96f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:58.757721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac2286-d2c2-4390-8ef7-da5f2f22f96f admin admin] PATH_INFO: `/v3/projects/a0b93ba112f94a11ab3c56f431ac05b5/users/ae14c5524ee54e9c94a21362cb215eca/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:58.773708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac2286-d2c2-4390-8ef7-da5f2f22f96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b93ba112f94a11ab3c56f431ac05b5, user_id=ae14c5524ee54e9c94a21362cb215eca, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:58.776373 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac2286-d2c2-4390-8ef7-da5f2f22f96f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:58.856714 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1284/2575] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:04:58 2022] PUT /identity/v3/projects/a0b93ba112f94a11ab3c56f431ac05b5/users/ae14c5524ee54e9c94a21362cb215eca/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:04:58.861844 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebcc28-de23-40d1-a0b0-a475d7f82f0e None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:58.862134 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebcc28-de23-40d1-a0b0-a475d7f82f0e None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:58.862445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebcc28-de23-40d1-a0b0-a475d7f82f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:58.881568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-deebcc28-de23-40d1-a0b0-a475d7f82f0e None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:04:58.890159 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-deebcc28-de23-40d1-a0b0-a475d7f82f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:58.943181 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1292/2576] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:04:58.952895 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac2286-d2c2-4390-8ef7-da5f2f22f96f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:04:58.954634 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-28ac2286-d2c2-4390-8ef7-da5f2f22f96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:04:59.012990 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac2286-d2c2-4390-8ef7-da5f2f22f96f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:04:59.016538 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a3d4a-93dd-4684-a7e1-6607974999af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:04:59.017200 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a3d4a-93dd-4684-a7e1-6607974999af service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:04:59.017482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a3d4a-93dd-4684-a7e1-6607974999af service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:04:59.017778 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a3d4a-93dd-4684-a7e1-6607974999af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:04:59.027125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a3d4a-93dd-4684-a7e1-6607974999af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:04:59.028580 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a3d4a-93dd-4684-a7e1-6607974999af service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:04:59.038468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1285/2577] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:05:04.830677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42ef0a-edd6-4c23-ad2f-d38e9685321d None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:04.830677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42ef0a-edd6-4c23-ad2f-d38e9685321d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:04.830677 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42ef0a-edd6-4c23-ad2f-d38e9685321d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:04.859820 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-7c42ef0a-edd6-4c23-ad2f-d38e9685321d None None] MFA Rules not processed for user `ae14c5524ee54e9c94a21362cb215eca`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:05:04.861043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-7c42ef0a-edd6-4c23-ad2f-d38e9685321d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:04.932808 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1293/2578] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:05:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:05:04.937115 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a3d4a-93dd-4684-a7e1-6607974999af service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:04.946952 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a3d4a-93dd-4684-a7e1-6607974999af service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:04.951814 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fe07b-f186-46d0-abc7-fabe32bcd540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:04.952547 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fe07b-f186-46d0-abc7-fabe32bcd540 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:04.952894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fe07b-f186-46d0-abc7-fabe32bcd540 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:04.953237 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fe07b-f186-46d0-abc7-fabe32bcd540 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:04.954030 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fe07b-f186-46d0-abc7-fabe32bcd540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:04.956168 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fe07b-f186-46d0-abc7-fabe32bcd540 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:05.063403 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1286/2579] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:05:04 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:05:05.067237 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42ef0a-edd6-4c23-ad2f-d38e9685321d None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:05.079094 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42ef0a-edd6-4c23-ad2f-d38e9685321d None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:05.143086 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe1bad-8e44-42ef-88b2-d44849815557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:05.143679 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe1bad-8e44-42ef-88b2-d44849815557 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:05.143923 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe1bad-8e44-42ef-88b2-d44849815557 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:05.144208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe1bad-8e44-42ef-88b2-d44849815557 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:05.145116 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe1bad-8e44-42ef-88b2-d44849815557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:05.148360 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe1bad-8e44-42ef-88b2-d44849815557 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:05.256818 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1294/2580] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:05:05 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:05:05.260826 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fe07b-f186-46d0-abc7-fabe32bcd540 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:05.271141 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fe07b-f186-46d0-abc7-fabe32bcd540 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:05.276483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba7b1d-29e7-4c99-879e-7c3c7a878dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:05.277259 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba7b1d-29e7-4c99-879e-7c3c7a878dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:05.277596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba7b1d-29e7-4c99-879e-7c3c7a878dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:05.278074 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba7b1d-29e7-4c99-879e-7c3c7a878dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:05.278887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba7b1d-29e7-4c99-879e-7c3c7a878dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:05.280631 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba7b1d-29e7-4c99-879e-7c3c7a878dd2 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:05.293034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1287/2581] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:05:05.298977 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe1bad-8e44-42ef-88b2-d44849815557 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:05.310428 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe1bad-8e44-42ef-88b2-d44849815557 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:05.315329 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b8f6d-5fa2-425e-a2ee-981694d30141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:05.316342 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b8f6d-5fa2-425e-a2ee-981694d30141 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:05.316686 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b8f6d-5fa2-425e-a2ee-981694d30141 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:05.317024 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b8f6d-5fa2-425e-a2ee-981694d30141 admin admin] PATH_INFO: `/v3/projects/9211abecea7d4a0e9f7b8ad034637276/users/04578ed5a0684431a03d2da7324163bc/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:05.333304 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b8f6d-5fa2-425e-a2ee-981694d30141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9211abecea7d4a0e9f7b8ad034637276, user_id=04578ed5a0684431a03d2da7324163bc, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:05.336143 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b8f6d-5fa2-425e-a2ee-981694d30141 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:05.411424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1295/2582] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:05:05 2022] PUT /identity/v3/projects/9211abecea7d4a0e9f7b8ad034637276/users/04578ed5a0684431a03d2da7324163bc/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:05:05.416413 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba7b1d-29e7-4c99-879e-7c3c7a878dd2 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:05.429277 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba7b1d-29e7-4c99-879e-7c3c7a878dd2 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:05.494099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b99fa-fb2d-4d87-8d6a-487af7aeb606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:05.496828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b99fa-fb2d-4d87-8d6a-487af7aeb606 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:05.496828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b99fa-fb2d-4d87-8d6a-487af7aeb606 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:05.496828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b99fa-fb2d-4d87-8d6a-487af7aeb606 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:05.496828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b99fa-fb2d-4d87-8d6a-487af7aeb606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:05.497974 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b99fa-fb2d-4d87-8d6a-487af7aeb606 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:05.509105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1288/2583] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:05:05.513152 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b8f6d-5fa2-425e-a2ee-981694d30141 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:05.528573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b8f6d-5fa2-425e-a2ee-981694d30141 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:05.534175 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f224157-f9fa-4fa4-a7d5-4ff62e650ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:05.535097 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f224157-f9fa-4fa4-a7d5-4ff62e650ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:05.535406 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f224157-f9fa-4fa4-a7d5-4ff62e650ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:05.535723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f224157-f9fa-4fa4-a7d5-4ff62e650ca9 admin admin] PATH_INFO: `/v3/projects/9211abecea7d4a0e9f7b8ad034637276/users/04578ed5a0684431a03d2da7324163bc/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:05.538700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f224157-f9fa-4fa4-a7d5-4ff62e650ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9211abecea7d4a0e9f7b8ad034637276, user_id=04578ed5a0684431a03d2da7324163bc, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:05.541606 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f224157-f9fa-4fa4-a7d5-4ff62e650ca9 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:05.552335 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1296/2584] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:05:05 2022] PUT /identity/v3/projects/9211abecea7d4a0e9f7b8ad034637276/users/04578ed5a0684431a03d2da7324163bc/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:05:10.398195 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b99fa-fb2d-4d87-8d6a-487af7aeb606 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:10.401361 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a81b99fa-fb2d-4d87-8d6a-487af7aeb606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:10.467239 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b99fa-fb2d-4d87-8d6a-487af7aeb606 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:10.525244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d96eac-9dda-41c3-a249-c305e629951b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:10.525906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d96eac-9dda-41c3-a249-c305e629951b service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:10.526187 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d96eac-9dda-41c3-a249-c305e629951b service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:10.526454 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d96eac-9dda-41c3-a249-c305e629951b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:10.528721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-80d96eac-9dda-41c3-a249-c305e629951b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:10.637897 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d96eac-9dda-41c3-a249-c305e629951b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:10.640174 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d96eac-9dda-41c3-a249-c305e629951b service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:10.660383 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1289/2585] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:05:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:05:12.560277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f224157-f9fa-4fa4-a7d5-4ff62e650ca9 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:12.580928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f224157-f9fa-4fa4-a7d5-4ff62e650ca9 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:12.585803 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dce05-12f1-465f-8e59-ccdd092cda58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:12.586662 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dce05-12f1-465f-8e59-ccdd092cda58 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:12.586944 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dce05-12f1-465f-8e59-ccdd092cda58 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:12.587224 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dce05-12f1-465f-8e59-ccdd092cda58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:12.589661 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-667dce05-12f1-465f-8e59-ccdd092cda58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:12.607576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dce05-12f1-465f-8e59-ccdd092cda58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:12.617182 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dce05-12f1-465f-8e59-ccdd092cda58 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:12.621887 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1297/2586] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:05:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:05:13.765483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646ba00-b5c7-4faa-8639-dbaccd15b90f None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:13.766030 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646ba00-b5c7-4faa-8639-dbaccd15b90f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:13.766030 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646ba00-b5c7-4faa-8639-dbaccd15b90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:13.813423 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-f646ba00-b5c7-4faa-8639-dbaccd15b90f None None] MFA Rules not processed for user `04578ed5a0684431a03d2da7324163bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:05:13.814766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f646ba00-b5c7-4faa-8639-dbaccd15b90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:13.899031 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1290/2587] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:05:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:05:13.910851 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dce05-12f1-465f-8e59-ccdd092cda58 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:13.912300 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-667dce05-12f1-465f-8e59-ccdd092cda58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:13.968759 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dce05-12f1-465f-8e59-ccdd092cda58 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:13.972377 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8eab0d-2ed0-41c5-9a13-64b3b042ea7b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65583446d2e40a69dff534b73e8fa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:13.973027 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eab0d-2ed0-41c5-9a13-64b3b042ea7b service glance] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:13.973312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eab0d-2ed0-41c5-9a13-64b3b042ea7b service glance] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:13.973590 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eab0d-2ed0-41c5-9a13-64b3b042ea7b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:14.030518 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8eab0d-2ed0-41c5-9a13-64b3b042ea7b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:14.045873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8eab0d-2ed0-41c5-9a13-64b3b042ea7b service glance] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:14.045873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1298/2588] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:05:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:05:14.283876 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bc2e9-274d-4633-a33d-7a656718a5cd None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:14.288671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bc2e9-274d-4633-a33d-7a656718a5cd None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:14.288671 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bc2e9-274d-4633-a33d-7a656718a5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:14.302945 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-147bc2e9-274d-4633-a33d-7a656718a5cd None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:05:14.304766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-147bc2e9-274d-4633-a33d-7a656718a5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:14.359890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1291/2589] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 12:05:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:05:14.373105 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8eab0d-2ed0-41c5-9a13-64b3b042ea7b service glance] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:14.438257 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8eab0d-2ed0-41c5-9a13-64b3b042ea7b service glance] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:14.443347 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731183d-f046-4cde-8531-7758b7dfb974 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:14.444036 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731183d-f046-4cde-8531-7758b7dfb974 service swift] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:14.444359 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731183d-f046-4cde-8531-7758b7dfb974 service swift] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:14.444722 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731183d-f046-4cde-8531-7758b7dfb974 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:14.456898 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731183d-f046-4cde-8531-7758b7dfb974 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:14.459371 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731183d-f046-4cde-8531-7758b7dfb974 service swift] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:14.471950 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1299/2590] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:05:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 12:05:25.182622 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bc2e9-274d-4633-a33d-7a656718a5cd None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:25.199386 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bc2e9-274d-4633-a33d-7a656718a5cd None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:25.212024 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd925c9a-0008-4a6e-b35a-c8d7b3f63bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:25.212752 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd925c9a-0008-4a6e-b35a-c8d7b3f63bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:25.213156 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd925c9a-0008-4a6e-b35a-c8d7b3f63bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:25.213460 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd925c9a-0008-4a6e-b35a-c8d7b3f63bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:25.215608 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-bd925c9a-0008-4a6e-b35a-c8d7b3f63bf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:25.298214 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd925c9a-0008-4a6e-b35a-c8d7b3f63bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:25.299776 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd925c9a-0008-4a6e-b35a-c8d7b3f63bf4 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:25.310890 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1292/2591] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:05:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:05:26.248747 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435029d3-3ebf-45ba-90cb-43d9bd77c48f None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:26.249326 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435029d3-3ebf-45ba-90cb-43d9bd77c48f None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:26.249326 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435029d3-3ebf-45ba-90cb-43d9bd77c48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:26.267448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-435029d3-3ebf-45ba-90cb-43d9bd77c48f None None] MFA Rules not processed for user `ae14c5524ee54e9c94a21362cb215eca`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:05:26.268698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-435029d3-3ebf-45ba-90cb-43d9bd77c48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:26.275931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1300/2592] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:05:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:05:26.591807 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd925c9a-0008-4a6e-b35a-c8d7b3f63bf4 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:26.600829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd925c9a-0008-4a6e-b35a-c8d7b3f63bf4 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:26.605262 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4b855-8104-4eaa-86cd-7aabff05eb3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:26.605908 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4b855-8104-4eaa-86cd-7aabff05eb3c service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:26.606187 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4b855-8104-4eaa-86cd-7aabff05eb3c service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:26.606459 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4b855-8104-4eaa-86cd-7aabff05eb3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:26.608280 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-56e4b855-8104-4eaa-86cd-7aabff05eb3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:26.618106 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4b855-8104-4eaa-86cd-7aabff05eb3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:26.619695 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4b855-8104-4eaa-86cd-7aabff05eb3c service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:26.627953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1293/2593] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:05:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:05:27.089266 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435029d3-3ebf-45ba-90cb-43d9bd77c48f None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:27.090752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-435029d3-3ebf-45ba-90cb-43d9bd77c48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:27.163609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435029d3-3ebf-45ba-90cb-43d9bd77c48f None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:27.169297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104f16f-b541-40dc-96bd-32ff008f7168 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8855284b10c64b8ca367e3c30b5f66fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:27.169955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104f16f-b541-40dc-96bd-32ff008f7168 service placement] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:27.170240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104f16f-b541-40dc-96bd-32ff008f7168 service placement] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:27.170511 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104f16f-b541-40dc-96bd-32ff008f7168 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:27.172282 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d104f16f-b541-40dc-96bd-32ff008f7168 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:27.184807 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104f16f-b541-40dc-96bd-32ff008f7168 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:27.186432 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104f16f-b541-40dc-96bd-32ff008f7168 service placement] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:27.198578 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1301/2594] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:05:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:05:27.983238 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4b855-8104-4eaa-86cd-7aabff05eb3c service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:27.991613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4b855-8104-4eaa-86cd-7aabff05eb3c service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:27.996051 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088ee47-d97f-496f-aefe-88f454478533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:27.997923 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088ee47-d97f-496f-aefe-88f454478533 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:27.998661 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088ee47-d97f-496f-aefe-88f454478533 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:27.999143 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088ee47-d97f-496f-aefe-88f454478533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:28.002138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0088ee47-d97f-496f-aefe-88f454478533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:28.014232 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088ee47-d97f-496f-aefe-88f454478533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:28.015995 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088ee47-d97f-496f-aefe-88f454478533 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:28.025555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1294/2595] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:05:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:05:30.188764 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe8077-0508-43a6-9aad-05c30d013f0a None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:30.189269 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe8077-0508-43a6-9aad-05c30d013f0a None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:30.189516 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe8077-0508-43a6-9aad-05c30d013f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:30.213134 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-53fe8077-0508-43a6-9aad-05c30d013f0a None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:05:30.214375 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-53fe8077-0508-43a6-9aad-05c30d013f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:30.221659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1302/2596] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 12:05:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:05:30.237812 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088ee47-d97f-496f-aefe-88f454478533 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:30.249305 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088ee47-d97f-496f-aefe-88f454478533 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:30.254481 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82225891-4cb7-4091-add1-a5b8c88e23e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:30.255125 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82225891-4cb7-4091-add1-a5b8c88e23e2 service swift] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:30.255502 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82225891-4cb7-4091-add1-a5b8c88e23e2 service swift] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:30.255806 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82225891-4cb7-4091-add1-a5b8c88e23e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:30.264943 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82225891-4cb7-4091-add1-a5b8c88e23e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:30.266986 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82225891-4cb7-4091-add1-a5b8c88e23e2 service swift] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:30.279919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1295/2597] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:05:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 12:05:30.647074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe8077-0508-43a6-9aad-05c30d013f0a None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:30.647074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-53fe8077-0508-43a6-9aad-05c30d013f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:30.668859 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe8077-0508-43a6-9aad-05c30d013f0a None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:30.678960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98fb9a-f908-43cf-9e21-878548693e20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:30.679879 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98fb9a-f908-43cf-9e21-878548693e20 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:30.680318 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98fb9a-f908-43cf-9e21-878548693e20 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:30.680852 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98fb9a-f908-43cf-9e21-878548693e20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:30.683723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-ba98fb9a-f908-43cf-9e21-878548693e20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:30.799838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98fb9a-f908-43cf-9e21-878548693e20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:30.802117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98fb9a-f908-43cf-9e21-878548693e20 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:30.814089 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1303/2598] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:05:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:05:40.227676 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82225891-4cb7-4091-add1-a5b8c88e23e2 service swift] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:40.241668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82225891-4cb7-4091-add1-a5b8c88e23e2 service swift] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:40.262494 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112cb94-84b4-40ff-9634-b3b210b38ba3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:40.263766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112cb94-84b4-40ff-9634-b3b210b38ba3 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:40.264572 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112cb94-84b4-40ff-9634-b3b210b38ba3 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:40.265389 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112cb94-84b4-40ff-9634-b3b210b38ba3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:40.268878 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e112cb94-84b4-40ff-9634-b3b210b38ba3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:40.284501 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112cb94-84b4-40ff-9634-b3b210b38ba3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:40.286278 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112cb94-84b4-40ff-9634-b3b210b38ba3 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:40.306399 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1296/2599] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:05:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:05:46.148773 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98fb9a-f908-43cf-9e21-878548693e20 service nova] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:46.159960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98fb9a-f908-43cf-9e21-878548693e20 service nova] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:46.165475 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916615f7-0110-4051-9d51-13973d293547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:46.166108 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916615f7-0110-4051-9d51-13973d293547 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:46.166388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916615f7-0110-4051-9d51-13973d293547 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:46.166661 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916615f7-0110-4051-9d51-13973d293547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:46.168623 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-916615f7-0110-4051-9d51-13973d293547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:46.180866 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916615f7-0110-4051-9d51-13973d293547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:46.182511 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916615f7-0110-4051-9d51-13973d293547 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:46.194094 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1304/2600] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:05:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:05:59.276835 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac98efd-f66c-481f-8cd3-a5352033c68d None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:59.277745 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac98efd-f66c-481f-8cd3-a5352033c68d None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:59.278233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac98efd-f66c-481f-8cd3-a5352033c68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:59.312853 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-8ac98efd-f66c-481f-8cd3-a5352033c68d None None] MFA Rules not processed for user `420d44749c064fc883bc3aadd9d2e8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:05:59.314168 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-8ac98efd-f66c-481f-8cd3-a5352033c68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:59.376960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1297/2601] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:05:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:05:59.655934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916615f7-0110-4051-9d51-13973d293547 service nova] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:59.665379 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916615f7-0110-4051-9d51-13973d293547 service nova] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:59.669121 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc449b-5c1b-40dd-9eaa-ef555a18bcc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:59.669824 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc449b-5c1b-40dd-9eaa-ef555a18bcc1 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:59.670308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc449b-5c1b-40dd-9eaa-ef555a18bcc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:59.670588 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc449b-5c1b-40dd-9eaa-ef555a18bcc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:59.679862 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc449b-5c1b-40dd-9eaa-ef555a18bcc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:59.681417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc449b-5c1b-40dd-9eaa-ef555a18bcc1 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:59.692354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1305/2602] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:05:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:05:59.694617 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac98efd-f66c-481f-8cd3-a5352033c68d None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:05:59.704624 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac98efd-f66c-481f-8cd3-a5352033c68d None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:05:59.708629 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501f574-4445-4c1e-8820-c613b65fbf66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:05:59.709365 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501f574-4445-4c1e-8820-c613b65fbf66 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:05:59.709711 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501f574-4445-4c1e-8820-c613b65fbf66 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:05:59.710050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501f574-4445-4c1e-8820-c613b65fbf66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:05:59.711963 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1501f574-4445-4c1e-8820-c613b65fbf66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:05:59.723143 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501f574-4445-4c1e-8820-c613b65fbf66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:05:59.723595 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501f574-4445-4c1e-8820-c613b65fbf66 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:05:59.732756 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1298/2603] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:05:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:06:00.680143 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c949e-07ce-4216-ae19-c360b48b793d None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:06:00.680648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c949e-07ce-4216-ae19-c360b48b793d None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:06:00.680744 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c949e-07ce-4216-ae19-c360b48b793d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:06:00.699020 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-1f6c949e-07ce-4216-ae19-c360b48b793d None None] MFA Rules not processed for user `bda2f2412e6441c3a8c232f39c56fc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:06:00.700373 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-1f6c949e-07ce-4216-ae19-c360b48b793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:06:00.708137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1306/2604] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:06:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:06:02.570013 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501f574-4445-4c1e-8820-c613b65fbf66 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:06:02.573405 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1501f574-4445-4c1e-8820-c613b65fbf66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:06:02.592609 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501f574-4445-4c1e-8820-c613b65fbf66 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:06:02.599477 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d28f6d-e79d-4bfc-9a0a-845c2bcafa99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:06:02.600560 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28f6d-e79d-4bfc-9a0a-845c2bcafa99 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:06:02.601036 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28f6d-e79d-4bfc-9a0a-845c2bcafa99 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:06:02.601504 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28f6d-e79d-4bfc-9a0a-845c2bcafa99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:06:02.604536 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f2d28f6d-e79d-4bfc-9a0a-845c2bcafa99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:06:02.629830 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d28f6d-e79d-4bfc-9a0a-845c2bcafa99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:06:02.631635 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d28f6d-e79d-4bfc-9a0a-845c2bcafa99 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:06:02.659005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1299/2605] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:06:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:06:34.529455 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9332c-4888-41ea-9e12-39e847a1fa07 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:06:34.530056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9332c-4888-41ea-9e12-39e847a1fa07 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:06:34.530056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9332c-4888-41ea-9e12-39e847a1fa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:06:34.548076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-88d9332c-4888-41ea-9e12-39e847a1fa07 None None] MFA Rules not processed for user `a918aee2dc2d4024ad3d9d0f9646a1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:06:34.549285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-88d9332c-4888-41ea-9e12-39e847a1fa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:06:34.607655 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1307/2606] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:06:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:07:01.745961 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d28f6d-e79d-4bfc-9a0a-845c2bcafa99 service nova] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:01.757261 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d28f6d-e79d-4bfc-9a0a-845c2bcafa99 service nova] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:01.763600 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d644ef6-1107-4588-8586-a97247b714e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:01.764318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d644ef6-1107-4588-8586-a97247b714e2 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:01.764607 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d644ef6-1107-4588-8586-a97247b714e2 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:01.764882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d644ef6-1107-4588-8586-a97247b714e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:01.766644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5d644ef6-1107-4588-8586-a97247b714e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:01.777399 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d644ef6-1107-4588-8586-a97247b714e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:01.779045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d644ef6-1107-4588-8586-a97247b714e2 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:01.788544 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1300/2607] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:07:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:07:20.232689 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9332c-4888-41ea-9e12-39e847a1fa07 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:20.242212 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9332c-4888-41ea-9e12-39e847a1fa07 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:20.245846 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89708bde-5969-4add-a3bc-e59cb862ad62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:20.246531 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89708bde-5969-4add-a3bc-e59cb862ad62 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:20.246826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89708bde-5969-4add-a3bc-e59cb862ad62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:20.247082 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89708bde-5969-4add-a3bc-e59cb862ad62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:20.248950 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-89708bde-5969-4add-a3bc-e59cb862ad62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:20.311515 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89708bde-5969-4add-a3bc-e59cb862ad62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:20.313035 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89708bde-5969-4add-a3bc-e59cb862ad62 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:20.323533 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1308/2608] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:07:23.071164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df94e55-a49e-47b6-adf9-729769011402 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:23.072424 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df94e55-a49e-47b6-adf9-729769011402 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:23.072774 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df94e55-a49e-47b6-adf9-729769011402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:23.098856 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-9df94e55-a49e-47b6-adf9-729769011402 None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:23.100117 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-9df94e55-a49e-47b6-adf9-729769011402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:23.108287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1301/2609] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 12:07:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:23.162489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89708bde-5969-4add-a3bc-e59cb862ad62 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:23.175866 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89708bde-5969-4add-a3bc-e59cb862ad62 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:23.181217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcd06d-bd67-4b9c-8f1f-76b128f14697 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:23.182169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcd06d-bd67-4b9c-8f1f-76b128f14697 service swift] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:23.182310 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcd06d-bd67-4b9c-8f1f-76b128f14697 service swift] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:23.182617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcd06d-bd67-4b9c-8f1f-76b128f14697 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:23.193322 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcd06d-bd67-4b9c-8f1f-76b128f14697 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:23.195208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcd06d-bd67-4b9c-8f1f-76b128f14697 service swift] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:23.205052 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1309/2610] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:07:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 12:07:25.086440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df94e55-a49e-47b6-adf9-729769011402 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:25.087961 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-9df94e55-a49e-47b6-adf9-729769011402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:25.113168 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df94e55-a49e-47b6-adf9-729769011402 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:25.115508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac64e67-d4af-4a27-bfbb-ed8488f5fca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:25.117092 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac64e67-d4af-4a27-bfbb-ed8488f5fca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:25.117611 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac64e67-d4af-4a27-bfbb-ed8488f5fca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:25.118225 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac64e67-d4af-4a27-bfbb-ed8488f5fca9 admin admin] PATH_INFO: `/v3/users/bda2f2412e6441c3a8c232f39c56fc9f` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:25.119875 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac64e67-d4af-4a27-bfbb-ed8488f5fca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda2f2412e6441c3a8c232f39c56fc9f)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:25.123442 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac64e67-d4af-4a27-bfbb-ed8488f5fca9 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:25.362343 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-7ac64e67-d4af-4a27-bfbb-ed8488f5fca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda2f2412e6441c3a8c232f39c56fc9f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:25.363196 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-7ac64e67-d4af-4a27-bfbb-ed8488f5fca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda2f2412e6441c3a8c232f39c56fc9f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:25.464703 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-7ac64e67-d4af-4a27-bfbb-ed8488f5fca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda2f2412e6441c3a8c232f39c56fc9f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:25.478622 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-7ac64e67-d4af-4a27-bfbb-ed8488f5fca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda2f2412e6441c3a8c232f39c56fc9f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:25.486467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-7ac64e67-d4af-4a27-bfbb-ed8488f5fca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda2f2412e6441c3a8c232f39c56fc9f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:25.495362 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1302/2611] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:07:25 2022] DELETE /identity/v3/users/bda2f2412e6441c3a8c232f39c56fc9f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:25.763867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcd06d-bd67-4b9c-8f1f-76b128f14697 service swift] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:25.778849 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcd06d-bd67-4b9c-8f1f-76b128f14697 service swift] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:25.845562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec6a71-dbe3-47cd-96d4-f8aa6ccdd1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:25.846617 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec6a71-dbe3-47cd-96d4-f8aa6ccdd1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:25.846965 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec6a71-dbe3-47cd-96d4-f8aa6ccdd1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:25.847328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec6a71-dbe3-47cd-96d4-f8aa6ccdd1a1 admin admin] PATH_INFO: `/v3/projects/ab382c388f1e4605be7dd6193181f2c3` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:25.849152 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec6a71-dbe3-47cd-96d4-f8aa6ccdd1a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab382c388f1e4605be7dd6193181f2c3)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:25.851193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec6a71-dbe3-47cd-96d4-f8aa6ccdd1a1 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:26.051646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4eec6a71-dbe3-47cd-96d4-f8aa6ccdd1a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab382c388f1e4605be7dd6193181f2c3', 'request_id': 'req-4eec6a71-dbe3-47cd-96d4-f8aa6ccdd1a1'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:26.051646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4eec6a71-dbe3-47cd-96d4-f8aa6ccdd1a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab382c388f1e4605be7dd6193181f2c3', 'request_id': 'req-4eec6a71-dbe3-47cd-96d4-f8aa6ccdd1a1'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:26.608086 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4eec6a71-dbe3-47cd-96d4-f8aa6ccdd1a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab382c388f1e4605be7dd6193181f2c3', 'request_id': 'req-4eec6a71-dbe3-47cd-96d4-f8aa6ccdd1a1'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:26.620280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4eec6a71-dbe3-47cd-96d4-f8aa6ccdd1a1 admin admin] The token cache is being invalidate because project ab382c388f1e4605be7dd6193181f2c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:07:26.620633 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4eec6a71-dbe3-47cd-96d4-f8aa6ccdd1a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:26.621250 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4eec6a71-dbe3-47cd-96d4-f8aa6ccdd1a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:26.624051 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1310/2612] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:07:25 2022] DELETE /identity/v3/projects/ab382c388f1e4605be7dd6193181f2c3 => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:26.629391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d75788-9a01-4ae7-a4a2-7650c887e549 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:26.629951 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d75788-9a01-4ae7-a4a2-7650c887e549 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:26.629951 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d75788-9a01-4ae7-a4a2-7650c887e549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:26.655297 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-f4d75788-9a01-4ae7-a4a2-7650c887e549 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:26.656831 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f4d75788-9a01-4ae7-a4a2-7650c887e549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:26.733839 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1303/2613] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:26.741767 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32790c-bb62-434d-b51f-2df4c580664b None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:26.742049 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32790c-bb62-434d-b51f-2df4c580664b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:26.742330 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32790c-bb62-434d-b51f-2df4c580664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:26.768466 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-cb32790c-bb62-434d-b51f-2df4c580664b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:26.770486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-cb32790c-bb62-434d-b51f-2df4c580664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:26.782165 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1311/2614] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:26.786360 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d75788-9a01-4ae7-a4a2-7650c887e549 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:26.800019 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d75788-9a01-4ae7-a4a2-7650c887e549 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:26.806502 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e006d02-bec4-4360-b89a-7200e77a72b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:26.807359 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e006d02-bec4-4360-b89a-7200e77a72b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:26.807764 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e006d02-bec4-4360-b89a-7200e77a72b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:26.808130 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e006d02-bec4-4360-b89a-7200e77a72b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:26.808971 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e006d02-bec4-4360-b89a-7200e77a72b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:07:26.810030 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e006d02-bec4-4360-b89a-7200e77a72b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:26.812314 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e006d02-bec4-4360-b89a-7200e77a72b2 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:26.829769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1304/2615] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:07:26.834556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32790c-bb62-434d-b51f-2df4c580664b None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:26.856813 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32790c-bb62-434d-b51f-2df4c580664b None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:26.874993 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde16763-0fd9-42ea-965e-fa92b35fdbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:26.876215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde16763-0fd9-42ea-965e-fa92b35fdbc2 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:26.876545 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde16763-0fd9-42ea-965e-fa92b35fdbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:26.876784 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde16763-0fd9-42ea-965e-fa92b35fdbc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:26.877490 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde16763-0fd9-42ea-965e-fa92b35fdbc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:26.879915 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde16763-0fd9-42ea-965e-fa92b35fdbc2 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:27.023782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1312/2616] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:07:26 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:07:27.025347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e006d02-bec4-4360-b89a-7200e77a72b2 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:27.041292 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e006d02-bec4-4360-b89a-7200e77a72b2 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:27.156069 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebdda8-e381-4871-b9a1-fc38d56d4f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:27.157531 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebdda8-e381-4871-b9a1-fc38d56d4f97 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:27.158098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebdda8-e381-4871-b9a1-fc38d56d4f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:27.158553 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebdda8-e381-4871-b9a1-fc38d56d4f97 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:27.159424 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebdda8-e381-4871-b9a1-fc38d56d4f97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:27.161391 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebdda8-e381-4871-b9a1-fc38d56d4f97 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:27.303418 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1305/2617] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:07:27 2022] POST /identity/v3/users => generated 292 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:07:27.307514 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde16763-0fd9-42ea-965e-fa92b35fdbc2 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:27.324472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde16763-0fd9-42ea-965e-fa92b35fdbc2 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:27.337319 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62315ebe-2158-4e38-8300-78ac10f6976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:27.338014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62315ebe-2158-4e38-8300-78ac10f6976f admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:27.339086 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62315ebe-2158-4e38-8300-78ac10f6976f admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:27.339386 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62315ebe-2158-4e38-8300-78ac10f6976f admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:27.340221 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62315ebe-2158-4e38-8300-78ac10f6976f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:27.345800 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62315ebe-2158-4e38-8300-78ac10f6976f admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:27.380843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1313/2618] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:07:27.385194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebdda8-e381-4871-b9a1-fc38d56d4f97 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:27.396318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebdda8-e381-4871-b9a1-fc38d56d4f97 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:27.401473 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78524549-7a0f-441a-9d78-09a20dc06197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:27.402186 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78524549-7a0f-441a-9d78-09a20dc06197 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:27.402468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78524549-7a0f-441a-9d78-09a20dc06197 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:27.402815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78524549-7a0f-441a-9d78-09a20dc06197 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:27.403847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78524549-7a0f-441a-9d78-09a20dc06197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:27.405236 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78524549-7a0f-441a-9d78-09a20dc06197 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:27.420361 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1306/2619] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:07:27.421565 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62315ebe-2158-4e38-8300-78ac10f6976f admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:27.432233 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62315ebe-2158-4e38-8300-78ac10f6976f admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:27.437520 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d9d57-2ca1-4f89-95c3-d4cc3cc8503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:27.438641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9d57-2ca1-4f89-95c3-d4cc3cc8503f admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:27.438933 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9d57-2ca1-4f89-95c3-d4cc3cc8503f admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:27.439217 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9d57-2ca1-4f89-95c3-d4cc3cc8503f admin admin] PATH_INFO: `/v3/projects/3fbf532740fa4a68b26d43bc0e4bfcbe/users/8d0add07830a4531ac9368501ee35e37/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:27.462911 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d9d57-2ca1-4f89-95c3-d4cc3cc8503f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fbf532740fa4a68b26d43bc0e4bfcbe, user_id=8d0add07830a4531ac9368501ee35e37, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:27.467362 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d9d57-2ca1-4f89-95c3-d4cc3cc8503f admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:27.586710 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1314/2620] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:07:27 2022] PUT /identity/v3/projects/3fbf532740fa4a68b26d43bc0e4bfcbe/users/8d0add07830a4531ac9368501ee35e37/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:27.599729 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd222ac-a108-4594-b827-de6c7ef86f66 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:27.600324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd222ac-a108-4594-b827-de6c7ef86f66 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:27.600776 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd222ac-a108-4594-b827-de6c7ef86f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:27.666927 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-ebd222ac-a108-4594-b827-de6c7ef86f66 None None] MFA Rules not processed for user `8d0add07830a4531ac9368501ee35e37`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:27.671014 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ebd222ac-a108-4594-b827-de6c7ef86f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:27.820189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1307/2621] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:27.833272 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d9d57-2ca1-4f89-95c3-d4cc3cc8503f admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:27.835210 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-288d9d57-2ca1-4f89-95c3-d4cc3cc8503f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:27.922789 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d9d57-2ca1-4f89-95c3-d4cc3cc8503f admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:27.930456 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbe4e4-69b0-41d2-bc70-eea855c78463 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:27.931842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbe4e4-69b0-41d2-bc70-eea855c78463 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:27.932434 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbe4e4-69b0-41d2-bc70-eea855c78463 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:27.933227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbe4e4-69b0-41d2-bc70-eea855c78463 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:27.950438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbe4e4-69b0-41d2-bc70-eea855c78463 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:27.952493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbe4e4-69b0-41d2-bc70-eea855c78463 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:27.969813 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1315/2622] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:07:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:07:38.242909 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd222ac-a108-4594-b827-de6c7ef86f66 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:38.303719 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd222ac-a108-4594-b827-de6c7ef86f66 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:38.308300 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245881a-0d99-4501-a594-a9ac083e881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:38.309271 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245881a-0d99-4501-a594-a9ac083e881b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:38.310197 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245881a-0d99-4501-a594-a9ac083e881b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:38.310482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245881a-0d99-4501-a594-a9ac083e881b admin admin] PATH_INFO: `/v3/users/8d0add07830a4531ac9368501ee35e37` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:38.311720 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245881a-0d99-4501-a594-a9ac083e881b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d0add07830a4531ac9368501ee35e37)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:38.313643 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245881a-0d99-4501-a594-a9ac083e881b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:38.526847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6245881a-0d99-4501-a594-a9ac083e881b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d0add07830a4531ac9368501ee35e37'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:38.527546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6245881a-0d99-4501-a594-a9ac083e881b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d0add07830a4531ac9368501ee35e37'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:38.615817 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6245881a-0d99-4501-a594-a9ac083e881b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d0add07830a4531ac9368501ee35e37'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:38.631208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6245881a-0d99-4501-a594-a9ac083e881b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d0add07830a4531ac9368501ee35e37'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:38.638919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-6245881a-0d99-4501-a594-a9ac083e881b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d0add07830a4531ac9368501ee35e37'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:38.646192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1308/2623] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:07:38 2022] DELETE /identity/v3/users/8d0add07830a4531ac9368501ee35e37 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:38.653670 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2070-a26f-4e78-9597-96aa861b134e None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:38.653670 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2070-a26f-4e78-9597-96aa861b134e None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:38.653670 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2070-a26f-4e78-9597-96aa861b134e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:38.679354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-fe3c2070-a26f-4e78-9597-96aa861b134e None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:38.679354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-fe3c2070-a26f-4e78-9597-96aa861b134e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:38.733204 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1316/2624] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:38.742795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245881a-0d99-4501-a594-a9ac083e881b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:38.744252 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-6245881a-0d99-4501-a594-a9ac083e881b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:38.800211 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245881a-0d99-4501-a594-a9ac083e881b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:38.803780 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61323793-1029-4eb0-8583-e3fe2db43770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:38.804432 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323793-1029-4eb0-8583-e3fe2db43770 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:38.804710 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323793-1029-4eb0-8583-e3fe2db43770 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:38.804980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323793-1029-4eb0-8583-e3fe2db43770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:38.814751 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61323793-1029-4eb0-8583-e3fe2db43770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:38.816251 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61323793-1029-4eb0-8583-e3fe2db43770 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:38.825658 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1309/2625] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:07:39.331755 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c2070-a26f-4e78-9597-96aa861b134e None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:39.333209 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-fe3c2070-a26f-4e78-9597-96aa861b134e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:39.346117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c2070-a26f-4e78-9597-96aa861b134e None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:39.352859 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d885645-dfdf-425f-b74b-0fb841dcfa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:39.354873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d885645-dfdf-425f-b74b-0fb841dcfa93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:39.355405 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d885645-dfdf-425f-b74b-0fb841dcfa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:39.355883 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d885645-dfdf-425f-b74b-0fb841dcfa93 admin admin] PATH_INFO: `/v3/projects/3fbf532740fa4a68b26d43bc0e4bfcbe` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:39.361139 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d885645-dfdf-425f-b74b-0fb841dcfa93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fbf532740fa4a68b26d43bc0e4bfcbe)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:39.361139 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d885645-dfdf-425f-b74b-0fb841dcfa93 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:39.509133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9d885645-dfdf-425f-b74b-0fb841dcfa93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fbf532740fa4a68b26d43bc0e4bfcbe', 'request_id': 'req-9d885645-dfdf-425f-b74b-0fb841dcfa93'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:39.516229 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9d885645-dfdf-425f-b74b-0fb841dcfa93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fbf532740fa4a68b26d43bc0e4bfcbe', 'request_id': 'req-9d885645-dfdf-425f-b74b-0fb841dcfa93'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:39.575955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9d885645-dfdf-425f-b74b-0fb841dcfa93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fbf532740fa4a68b26d43bc0e4bfcbe', 'request_id': 'req-9d885645-dfdf-425f-b74b-0fb841dcfa93'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:39.589203 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9d885645-dfdf-425f-b74b-0fb841dcfa93 admin admin] The token cache is being invalidate because project 3fbf532740fa4a68b26d43bc0e4bfcbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:07:39.593702 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9d885645-dfdf-425f-b74b-0fb841dcfa93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:39.593702 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-9d885645-dfdf-425f-b74b-0fb841dcfa93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:39.593702 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1317/2626] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:07:39 2022] DELETE /identity/v3/projects/3fbf532740fa4a68b26d43bc0e4bfcbe => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:39.597340 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d921eb-12f6-4868-8895-669c7de41335 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:39.597825 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d921eb-12f6-4868-8895-669c7de41335 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:39.597944 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d921eb-12f6-4868-8895-669c7de41335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:39.617306 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-d8d921eb-12f6-4868-8895-669c7de41335 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:39.618728 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d8d921eb-12f6-4868-8895-669c7de41335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:39.683448 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1310/2627] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:39.691240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c891ca-e7ed-485c-ad40-7af4f69891f0 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:39.691826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c891ca-e7ed-485c-ad40-7af4f69891f0 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:39.691936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c891ca-e7ed-485c-ad40-7af4f69891f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:39.710891 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-d9c891ca-e7ed-485c-ad40-7af4f69891f0 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:39.712164 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d9c891ca-e7ed-485c-ad40-7af4f69891f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:39.721647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1318/2628] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:39.725879 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d921eb-12f6-4868-8895-669c7de41335 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:39.736230 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d921eb-12f6-4868-8895-669c7de41335 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:39.740857 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd00f67-d365-4b7a-83da-94dee97c8b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:39.741518 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd00f67-d365-4b7a-83da-94dee97c8b87 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:39.741797 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd00f67-d365-4b7a-83da-94dee97c8b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:39.742072 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd00f67-d365-4b7a-83da-94dee97c8b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:39.742789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd00f67-d365-4b7a-83da-94dee97c8b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:07:39.743098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd00f67-d365-4b7a-83da-94dee97c8b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:39.744715 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd00f67-d365-4b7a-83da-94dee97c8b87 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:39.756769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1311/2629] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:07:39.761242 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c891ca-e7ed-485c-ad40-7af4f69891f0 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:39.771383 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c891ca-e7ed-485c-ad40-7af4f69891f0 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:39.776082 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1994d-4a3c-468f-9724-a431383bb782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:39.776741 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1994d-4a3c-468f-9724-a431383bb782 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:39.777026 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1994d-4a3c-468f-9724-a431383bb782 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:39.777303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1994d-4a3c-468f-9724-a431383bb782 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:39.778525 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1994d-4a3c-468f-9724-a431383bb782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:39.781034 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1994d-4a3c-468f-9724-a431383bb782 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:39.908518 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1319/2630] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:07:39 2022] POST /identity/v3/projects => generated 403 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:07:39.912896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd00f67-d365-4b7a-83da-94dee97c8b87 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:39.924130 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd00f67-d365-4b7a-83da-94dee97c8b87 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:39.985341 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c177189-def7-4788-8060-a931e351d2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:39.986017 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c177189-def7-4788-8060-a931e351d2ec admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:39.986296 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c177189-def7-4788-8060-a931e351d2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:39.986568 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c177189-def7-4788-8060-a931e351d2ec admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:39.987254 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c177189-def7-4788-8060-a931e351d2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:39.989207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c177189-def7-4788-8060-a931e351d2ec admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:40.112178 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1312/2631] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:07:39 2022] POST /identity/v3/users => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:07:40.116333 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1994d-4a3c-468f-9724-a431383bb782 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:40.128930 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1994d-4a3c-468f-9724-a431383bb782 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:40.134535 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79361ac7-4717-4c63-8090-22de0a18811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:40.135734 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79361ac7-4717-4c63-8090-22de0a18811e admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:40.136170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79361ac7-4717-4c63-8090-22de0a18811e admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:40.140926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79361ac7-4717-4c63-8090-22de0a18811e admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:40.140926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79361ac7-4717-4c63-8090-22de0a18811e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:40.140926 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79361ac7-4717-4c63-8090-22de0a18811e admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:40.151018 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1320/2632] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:07:40.155311 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c177189-def7-4788-8060-a931e351d2ec admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:40.172469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c177189-def7-4788-8060-a931e351d2ec admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:40.177557 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98fc82-29d0-48cd-a747-f799cb224261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:40.178416 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98fc82-29d0-48cd-a747-f799cb224261 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:40.178801 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98fc82-29d0-48cd-a747-f799cb224261 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:40.179179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98fc82-29d0-48cd-a747-f799cb224261 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:40.180064 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98fc82-29d0-48cd-a747-f799cb224261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:40.181825 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98fc82-29d0-48cd-a747-f799cb224261 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:40.199488 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1313/2633] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:07:40.200170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79361ac7-4717-4c63-8090-22de0a18811e admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:40.210969 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79361ac7-4717-4c63-8090-22de0a18811e admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:40.216904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba050aa-d4a6-49ae-a616-ac908d1b014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:40.217892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba050aa-d4a6-49ae-a616-ac908d1b014b admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:40.218186 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba050aa-d4a6-49ae-a616-ac908d1b014b admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:40.218499 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba050aa-d4a6-49ae-a616-ac908d1b014b admin admin] PATH_INFO: `/v3/projects/b213a9a02f3c4e1c84a1ede13426ba14/users/17c153f71fa04477bfb4ebfbd610a6be/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:40.246111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba050aa-d4a6-49ae-a616-ac908d1b014b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b213a9a02f3c4e1c84a1ede13426ba14, user_id=17c153f71fa04477bfb4ebfbd610a6be, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:40.249675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba050aa-d4a6-49ae-a616-ac908d1b014b admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:40.343039 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1321/2634] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:07:40 2022] PUT /identity/v3/projects/b213a9a02f3c4e1c84a1ede13426ba14/users/17c153f71fa04477bfb4ebfbd610a6be/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:40.351814 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfed75-b928-4b3d-bb3d-24e1bdab08cc None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:40.352189 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfed75-b928-4b3d-bb3d-24e1bdab08cc None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:40.352469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfed75-b928-4b3d-bb3d-24e1bdab08cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:40.383640 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-60cfed75-b928-4b3d-bb3d-24e1bdab08cc None None] MFA Rules not processed for user `17c153f71fa04477bfb4ebfbd610a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:40.384933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-60cfed75-b928-4b3d-bb3d-24e1bdab08cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:40.453950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1314/2635] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:40.458594 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba050aa-d4a6-49ae-a616-ac908d1b014b admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:40.526177 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba050aa-d4a6-49ae-a616-ac908d1b014b admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:40.531985 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dad3a-4e91-4943-b48f-cba5e102bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:40.532689 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dad3a-4e91-4943-b48f-cba5e102bbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:40.532971 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dad3a-4e91-4943-b48f-cba5e102bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:40.533248 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dad3a-4e91-4943-b48f-cba5e102bbd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:40.533945 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5dad3a-4e91-4943-b48f-cba5e102bbd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:40.535895 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5dad3a-4e91-4943-b48f-cba5e102bbd6 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:40.706492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1322/2636] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:07:40 2022] POST /identity/v3/projects => generated 403 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:07:40.710332 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfed75-b928-4b3d-bb3d-24e1bdab08cc None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:40.722098 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfed75-b928-4b3d-bb3d-24e1bdab08cc None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:40.781505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc971027-e35a-47d7-9889-ca3e8eb5b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:40.782204 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc971027-e35a-47d7-9889-ca3e8eb5b873 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:40.782483 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc971027-e35a-47d7-9889-ca3e8eb5b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:40.782764 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc971027-e35a-47d7-9889-ca3e8eb5b873 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:40.783464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc971027-e35a-47d7-9889-ca3e8eb5b873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:40.785430 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc971027-e35a-47d7-9889-ca3e8eb5b873 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:40.890326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1315/2637] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:07:40 2022] POST /identity/v3/users => generated 308 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:07:40.894550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dad3a-4e91-4943-b48f-cba5e102bbd6 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:40.906151 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dad3a-4e91-4943-b48f-cba5e102bbd6 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:40.915121 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a41cb3-bb22-43c6-9dfc-2f6d45030bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:40.915855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a41cb3-bb22-43c6-9dfc-2f6d45030bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:40.916142 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a41cb3-bb22-43c6-9dfc-2f6d45030bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:40.916423 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a41cb3-bb22-43c6-9dfc-2f6d45030bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:40.917171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a41cb3-bb22-43c6-9dfc-2f6d45030bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:40.919284 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a41cb3-bb22-43c6-9dfc-2f6d45030bd4 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:40.935776 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1323/2638] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:07:40.936908 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc971027-e35a-47d7-9889-ca3e8eb5b873 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:40.947705 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc971027-e35a-47d7-9889-ca3e8eb5b873 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:40.952650 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef3c87-70b2-420f-a637-cb7263e0dbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:40.953628 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef3c87-70b2-420f-a637-cb7263e0dbc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:40.953941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef3c87-70b2-420f-a637-cb7263e0dbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:40.954487 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef3c87-70b2-420f-a637-cb7263e0dbc1 admin admin] PATH_INFO: `/v3/projects/5078c781fb5c4cabbeb7103b4475b24c/users/db4cfbc1cff240ad97267aa97247d247/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:40.969972 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef3c87-70b2-420f-a637-cb7263e0dbc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5078c781fb5c4cabbeb7103b4475b24c, user_id=db4cfbc1cff240ad97267aa97247d247, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:40.972923 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef3c87-70b2-420f-a637-cb7263e0dbc1 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:41.079412 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1316/2639] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:07:40 2022] PUT /identity/v3/projects/5078c781fb5c4cabbeb7103b4475b24c/users/db4cfbc1cff240ad97267aa97247d247/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:41.083493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a41cb3-bb22-43c6-9dfc-2f6d45030bd4 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:41.093612 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a41cb3-bb22-43c6-9dfc-2f6d45030bd4 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:41.156934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fc9b3-10b2-47d3-a55d-4b6539236d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:41.157629 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fc9b3-10b2-47d3-a55d-4b6539236d49 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:41.157896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fc9b3-10b2-47d3-a55d-4b6539236d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:41.158171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fc9b3-10b2-47d3-a55d-4b6539236d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:41.158903 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fc9b3-10b2-47d3-a55d-4b6539236d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:41.160679 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fc9b3-10b2-47d3-a55d-4b6539236d49 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:41.171338 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1324/2640] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:07:41.175677 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef3c87-70b2-420f-a637-cb7263e0dbc1 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:41.186484 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef3c87-70b2-420f-a637-cb7263e0dbc1 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:41.191574 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f32e31-745d-4854-90d6-de2865bb30f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:41.193887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f32e31-745d-4854-90d6-de2865bb30f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:41.193887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f32e31-745d-4854-90d6-de2865bb30f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:41.193887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f32e31-745d-4854-90d6-de2865bb30f4 admin admin] PATH_INFO: `/v3/projects/5078c781fb5c4cabbeb7103b4475b24c/users/db4cfbc1cff240ad97267aa97247d247/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:41.195199 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f32e31-745d-4854-90d6-de2865bb30f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5078c781fb5c4cabbeb7103b4475b24c, user_id=db4cfbc1cff240ad97267aa97247d247, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:41.197816 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f32e31-745d-4854-90d6-de2865bb30f4 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:41.209688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1317/2641] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:07:41 2022] PUT /identity/v3/projects/5078c781fb5c4cabbeb7103b4475b24c/users/db4cfbc1cff240ad97267aa97247d247/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:07:41.225502 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90c09-8d30-442b-9d3e-d750379e5627 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:41.225851 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90c09-8d30-442b-9d3e-d750379e5627 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:41.226137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90c09-8d30-442b-9d3e-d750379e5627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:41.255161 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-2ad90c09-8d30-442b-9d3e-d750379e5627 None None] MFA Rules not processed for user `db4cfbc1cff240ad97267aa97247d247`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:41.256432 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-2ad90c09-8d30-442b-9d3e-d750379e5627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:41.325747 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1325/2642] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:41.336573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f32e31-745d-4854-90d6-de2865bb30f4 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:41.338298 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a6f32e31-745d-4854-90d6-de2865bb30f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:41.400886 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f32e31-745d-4854-90d6-de2865bb30f4 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:41.405225 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457c76b-9741-4176-81cf-5f85b4843b81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:41.405969 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457c76b-9741-4176-81cf-5f85b4843b81 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:41.406238 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457c76b-9741-4176-81cf-5f85b4843b81 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:41.406511 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457c76b-9741-4176-81cf-5f85b4843b81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:41.416978 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457c76b-9741-4176-81cf-5f85b4843b81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:41.417449 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457c76b-9741-4176-81cf-5f85b4843b81 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:41.428445 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1318/2643] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:07:41 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:07:41.588558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad90c09-8d30-442b-9d3e-d750379e5627 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:41.656485 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad90c09-8d30-442b-9d3e-d750379e5627 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:41.661320 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f026129-3b87-427b-a300-9cd7767b23da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:41.662260 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f026129-3b87-427b-a300-9cd7767b23da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:41.662539 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f026129-3b87-427b-a300-9cd7767b23da admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:41.662814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f026129-3b87-427b-a300-9cd7767b23da admin admin] PATH_INFO: `/v3/users/17c153f71fa04477bfb4ebfbd610a6be` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:41.664091 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f026129-3b87-427b-a300-9cd7767b23da admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c153f71fa04477bfb4ebfbd610a6be)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:41.666070 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f026129-3b87-427b-a300-9cd7767b23da admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:41.688619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10597ef-4b46-4d86-b506-c57f7c933a3a None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:41.688905 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10597ef-4b46-4d86-b506-c57f7c933a3a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:41.689179 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10597ef-4b46-4d86-b506-c57f7c933a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:41.707034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-a10597ef-4b46-4d86-b506-c57f7c933a3a None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:41.708326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a10597ef-4b46-4d86-b506-c57f7c933a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:41.765785 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1319/2644] 10.222.0.52 () {58 vars in 967 bytes} [Tue Mar 8 12:07:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:07:41.782073 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10597ef-4b46-4d86-b506-c57f7c933a3a None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:41.783929 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-a10597ef-4b46-4d86-b506-c57f7c933a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:41.869453 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10597ef-4b46-4d86-b506-c57f7c933a3a None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:41.876752 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c3259-98bd-4e7d-9189-3ca0b9b08f0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:41.877216 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c3259-98bd-4e7d-9189-3ca0b9b08f0a service swift] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:41.877500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c3259-98bd-4e7d-9189-3ca0b9b08f0a service swift] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:41.877777 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c3259-98bd-4e7d-9189-3ca0b9b08f0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:41.889399 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c3259-98bd-4e7d-9189-3ca0b9b08f0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:41.891852 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c3259-98bd-4e7d-9189-3ca0b9b08f0a service swift] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:41.904584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1320/2645] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:07:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 12:07:41.952647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3f026129-3b87-427b-a300-9cd7767b23da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c153f71fa04477bfb4ebfbd610a6be'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:41.953611 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3f026129-3b87-427b-a300-9cd7767b23da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c153f71fa04477bfb4ebfbd610a6be'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:41.964527 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3f026129-3b87-427b-a300-9cd7767b23da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c153f71fa04477bfb4ebfbd610a6be'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:42.059691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3f026129-3b87-427b-a300-9cd7767b23da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c153f71fa04477bfb4ebfbd610a6be'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:42.075651 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3f026129-3b87-427b-a300-9cd7767b23da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c153f71fa04477bfb4ebfbd610a6be'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:42.086682 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1326/2646] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:07:41 2022] DELETE /identity/v3/users/17c153f71fa04477bfb4ebfbd610a6be => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:42.094093 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37ddaa-e1c0-4b97-9200-280d4db77932 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:42.095452 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37ddaa-e1c0-4b97-9200-280d4db77932 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:42.096303 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37ddaa-e1c0-4b97-9200-280d4db77932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:42.116074 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-ac37ddaa-e1c0-4b97-9200-280d4db77932 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:42.117508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ac37ddaa-e1c0-4b97-9200-280d4db77932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:42.178096 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1321/2647] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:42.188240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f026129-3b87-427b-a300-9cd7767b23da admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:42.189729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3f026129-3b87-427b-a300-9cd7767b23da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:42.251054 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f026129-3b87-427b-a300-9cd7767b23da admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:42.255598 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148ac9e-519b-4f5f-ac9b-8bf925cb32fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:42.256265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148ac9e-519b-4f5f-ac9b-8bf925cb32fc service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:42.256549 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148ac9e-519b-4f5f-ac9b-8bf925cb32fc service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:42.256826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148ac9e-519b-4f5f-ac9b-8bf925cb32fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:42.268531 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148ac9e-519b-4f5f-ac9b-8bf925cb32fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:42.270252 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148ac9e-519b-4f5f-ac9b-8bf925cb32fc service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:42.293575 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1327/2648] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:07:42.373980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66033dbb-8a33-4786-b8e0-e56530ff12ad None None] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:42.374362 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66033dbb-8a33-4786-b8e0-e56530ff12ad None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:42.374699 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66033dbb-8a33-4786-b8e0-e56530ff12ad None None] PATH_INFO: `/` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:42.376805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1322/2649] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 12:07:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:07:42.382960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8deae5-db33-4065-a27f-514e20689bd8 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:42.383356 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8deae5-db33-4065-a27f-514e20689bd8 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:42.383738 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8deae5-db33-4065-a27f-514e20689bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:42.405508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-5f8deae5-db33-4065-a27f-514e20689bd8 None None] MFA Rules not processed for user `a5f8507c0ae342f7a3e97b48363ad606`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:42.406849 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-5f8deae5-db33-4065-a27f-514e20689bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:42.414717 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1328/2650] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:42.430710 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66033dbb-8a33-4786-b8e0-e56530ff12ad None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:42.433427 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-66033dbb-8a33-4786-b8e0-e56530ff12ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:42.454617 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66033dbb-8a33-4786-b8e0-e56530ff12ad None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:42.466811 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b25c4-6b6b-4cf9-b0b8-c734b5abb2cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:42.467578 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b25c4-6b6b-4cf9-b0b8-c734b5abb2cf service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:42.467935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b25c4-6b6b-4cf9-b0b8-c734b5abb2cf service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:42.468952 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b25c4-6b6b-4cf9-b0b8-c734b5abb2cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:42.486909 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b25c4-6b6b-4cf9-b0b8-c734b5abb2cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:42.488551 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b25c4-6b6b-4cf9-b0b8-c734b5abb2cf service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:42.498356 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1323/2651] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:07:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:07:42.592695 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef520bb-41a2-4871-97b8-acd4fb891cbd None None] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:42.596000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef520bb-41a2-4871-97b8-acd4fb891cbd None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:42.596365 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef520bb-41a2-4871-97b8-acd4fb891cbd None None] PATH_INFO: `/` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:42.598414 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1329/2652] 10.222.0.52 () {54 vars in 921 bytes} [Tue Mar 8 12:07:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 12:07:42.605114 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3537b5-9216-4ab3-8b3a-b85433b841b4 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:42.605407 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3537b5-9216-4ab3-8b3a-b85433b841b4 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:42.605871 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3537b5-9216-4ab3-8b3a-b85433b841b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:42.633571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-df3537b5-9216-4ab3-8b3a-b85433b841b4 None None] MFA Rules not processed for user `534fd902f96043068e99ca0537cf57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:42.634844 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-df3537b5-9216-4ab3-8b3a-b85433b841b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:42.709555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1324/2653] 10.222.0.52 () {58 vars in 1018 bytes} [Tue Mar 8 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:42.720458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef520bb-41a2-4871-97b8-acd4fb891cbd None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:42.733972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef520bb-41a2-4871-97b8-acd4fb891cbd None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:42.738687 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6cf55-eb79-46bb-aa1a-f46e94e254e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:42.739993 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6cf55-eb79-46bb-aa1a-f46e94e254e8 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:42.740448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6cf55-eb79-46bb-aa1a-f46e94e254e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:42.741875 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6cf55-eb79-46bb-aa1a-f46e94e254e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:42.754007 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6cf55-eb79-46bb-aa1a-f46e94e254e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:42.756145 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6cf55-eb79-46bb-aa1a-f46e94e254e8 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:42.771901 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1330/2654] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:07:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:07:42.873491 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3537b5-9216-4ab3-8b3a-b85433b841b4 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:42.875059 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-df3537b5-9216-4ab3-8b3a-b85433b841b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:42.901037 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3537b5-9216-4ab3-8b3a-b85433b841b4 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:42.957573 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:42.960460 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:42.960819 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:42.962237 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387 admin admin] PATH_INFO: `/v3/projects/b213a9a02f3c4e1c84a1ede13426ba14` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:42.964268 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b213a9a02f3c4e1c84a1ede13426ba14)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:42.968594 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:43.094706 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b213a9a02f3c4e1c84a1ede13426ba14', 'request_id': 'req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:43.169785 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b213a9a02f3c4e1c84a1ede13426ba14', 'request_id': 'req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:43.179874 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b213a9a02f3c4e1c84a1ede13426ba14', 'request_id': 'req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:43.191871 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387 admin admin] The token cache is being invalidate because project b213a9a02f3c4e1c84a1ede13426ba14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:07:43.192260 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:43.192972 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:43.195888 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1325/2655] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:07:42 2022] DELETE /identity/v3/projects/b213a9a02f3c4e1c84a1ede13426ba14 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:43.199415 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6cf55-eb79-46bb-aa1a-f46e94e254e8 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:43.214591 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6cf55-eb79-46bb-aa1a-f46e94e254e8 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:43.298748 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51e353-08aa-4321-8971-101f83960fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:43.299704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51e353-08aa-4321-8971-101f83960fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:43.300009 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51e353-08aa-4321-8971-101f83960fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:43.300463 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51e353-08aa-4321-8971-101f83960fcf admin admin] PATH_INFO: `/v3/users/db4cfbc1cff240ad97267aa97247d247` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:43.303703 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51e353-08aa-4321-8971-101f83960fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4cfbc1cff240ad97267aa97247d247)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:43.305871 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51e353-08aa-4321-8971-101f83960fcf admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:43.545256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0c51e353-08aa-4321-8971-101f83960fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4cfbc1cff240ad97267aa97247d247'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:43.546207 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0c51e353-08aa-4321-8971-101f83960fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4cfbc1cff240ad97267aa97247d247'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:43.554592 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0c51e353-08aa-4321-8971-101f83960fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4cfbc1cff240ad97267aa97247d247'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:43.624960 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0c51e353-08aa-4321-8971-101f83960fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4cfbc1cff240ad97267aa97247d247'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:43.639354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0c51e353-08aa-4321-8971-101f83960fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4cfbc1cff240ad97267aa97247d247'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:43.647436 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1331/2656] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:07:43 2022] DELETE /identity/v3/users/db4cfbc1cff240ad97267aa97247d247 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:44.475302 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:44.478925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:44.496244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dc7ad-ae42-4b2e-ae49-16e59cf7b387 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:44.578000 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3171357-670e-4706-b474-3d04a955a3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:44.579187 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3171357-670e-4706-b474-3d04a955a3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:44.579543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3171357-670e-4706-b474-3d04a955a3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:44.579851 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3171357-670e-4706-b474-3d04a955a3e3 admin admin] PATH_INFO: `/v3/projects/5078c781fb5c4cabbeb7103b4475b24c` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:44.581233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3171357-670e-4706-b474-3d04a955a3e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5078c781fb5c4cabbeb7103b4475b24c)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:44.583319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3171357-670e-4706-b474-3d04a955a3e3 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:44.717411 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c3171357-670e-4706-b474-3d04a955a3e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5078c781fb5c4cabbeb7103b4475b24c', 'request_id': 'req-c3171357-670e-4706-b474-3d04a955a3e3'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:44.804038 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c3171357-670e-4706-b474-3d04a955a3e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5078c781fb5c4cabbeb7103b4475b24c', 'request_id': 'req-c3171357-670e-4706-b474-3d04a955a3e3'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:44.812807 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c3171357-670e-4706-b474-3d04a955a3e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5078c781fb5c4cabbeb7103b4475b24c', 'request_id': 'req-c3171357-670e-4706-b474-3d04a955a3e3'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:44.826207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c3171357-670e-4706-b474-3d04a955a3e3 admin admin] The token cache is being invalidate because project 5078c781fb5c4cabbeb7103b4475b24c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:07:44.826474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c3171357-670e-4706-b474-3d04a955a3e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:44.827475 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c3171357-670e-4706-b474-3d04a955a3e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:44.829553 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1326/2657] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:07:44 2022] DELETE /identity/v3/projects/5078c781fb5c4cabbeb7103b4475b24c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:44.835020 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c29e2d-3ac7-49f9-b526-35b90a3c9096 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:44.835020 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c29e2d-3ac7-49f9-b526-35b90a3c9096 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:44.835576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c29e2d-3ac7-49f9-b526-35b90a3c9096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:44.857794 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-c1c29e2d-3ac7-49f9-b526-35b90a3c9096 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:44.859086 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-c1c29e2d-3ac7-49f9-b526-35b90a3c9096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:44.955609 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1332/2658] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:44.963322 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab2cb8-5f3a-47ac-9cb7-5ab1153164cb None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:44.963923 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab2cb8-5f3a-47ac-9cb7-5ab1153164cb None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:44.964202 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab2cb8-5f3a-47ac-9cb7-5ab1153164cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:44.987912 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-cbab2cb8-5f3a-47ac-9cb7-5ab1153164cb None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:44.989264 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-cbab2cb8-5f3a-47ac-9cb7-5ab1153164cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:45.001712 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1327/2659] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:45.006689 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c29e2d-3ac7-49f9-b526-35b90a3c9096 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:45.029584 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c29e2d-3ac7-49f9-b526-35b90a3c9096 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:45.036967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96920aa-b6ab-457a-ba21-8ab4ca785482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:45.038132 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96920aa-b6ab-457a-ba21-8ab4ca785482 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:45.038848 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96920aa-b6ab-457a-ba21-8ab4ca785482 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:45.039350 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96920aa-b6ab-457a-ba21-8ab4ca785482 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:45.040391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96920aa-b6ab-457a-ba21-8ab4ca785482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:07:45.041028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96920aa-b6ab-457a-ba21-8ab4ca785482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:45.042937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96920aa-b6ab-457a-ba21-8ab4ca785482 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:45.058674 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1333/2660] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:07:45.063117 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab2cb8-5f3a-47ac-9cb7-5ab1153164cb None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:45.087412 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab2cb8-5f3a-47ac-9cb7-5ab1153164cb None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:45.098413 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97ebc0-c784-43c1-892d-a90605f3304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:45.099324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97ebc0-c784-43c1-892d-a90605f3304a admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:45.099974 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97ebc0-c784-43c1-892d-a90605f3304a admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:45.100254 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97ebc0-c784-43c1-892d-a90605f3304a admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:45.100959 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97ebc0-c784-43c1-892d-a90605f3304a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:45.102899 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97ebc0-c784-43c1-892d-a90605f3304a admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:45.226389 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1328/2661] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:07:45 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:07:45.230833 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96920aa-b6ab-457a-ba21-8ab4ca785482 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:45.244327 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96920aa-b6ab-457a-ba21-8ab4ca785482 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:45.328265 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346de55c-7ddd-4686-8ab6-25b7ede1b70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:45.329021 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346de55c-7ddd-4686-8ab6-25b7ede1b70a admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:45.329405 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346de55c-7ddd-4686-8ab6-25b7ede1b70a admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:45.331117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346de55c-7ddd-4686-8ab6-25b7ede1b70a admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:45.331117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346de55c-7ddd-4686-8ab6-25b7ede1b70a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:45.333236 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346de55c-7ddd-4686-8ab6-25b7ede1b70a admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:45.445330 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1334/2662] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:07:45 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:07:45.449505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97ebc0-c784-43c1-892d-a90605f3304a admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:45.466904 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97ebc0-c784-43c1-892d-a90605f3304a admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:45.473219 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a41a12-88f6-4306-a1ce-96423382fa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:45.474171 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a41a12-88f6-4306-a1ce-96423382fa10 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:45.474464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a41a12-88f6-4306-a1ce-96423382fa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:45.477953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a41a12-88f6-4306-a1ce-96423382fa10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:45.477953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a41a12-88f6-4306-a1ce-96423382fa10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:45.479729 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a41a12-88f6-4306-a1ce-96423382fa10 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:45.497977 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1329/2663] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:07:45.499571 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346de55c-7ddd-4686-8ab6-25b7ede1b70a admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:45.519362 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346de55c-7ddd-4686-8ab6-25b7ede1b70a admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:45.527376 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9f55a-c482-4d54-949a-bd1b8a9d0c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:45.528854 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9f55a-c482-4d54-949a-bd1b8a9d0c4c admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:45.530272 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9f55a-c482-4d54-949a-bd1b8a9d0c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:45.530601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9f55a-c482-4d54-949a-bd1b8a9d0c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:45.531585 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9f55a-c482-4d54-949a-bd1b8a9d0c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:45.533731 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9f55a-c482-4d54-949a-bd1b8a9d0c4c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:45.583623 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1335/2664] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:07:45.585602 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a41a12-88f6-4306-a1ce-96423382fa10 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:45.603045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a41a12-88f6-4306-a1ce-96423382fa10 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:45.608367 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580f43f-5530-411b-8432-7ff87e8b536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:45.609471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580f43f-5530-411b-8432-7ff87e8b536b admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:45.609753 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580f43f-5530-411b-8432-7ff87e8b536b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:45.610079 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580f43f-5530-411b-8432-7ff87e8b536b admin admin] PATH_INFO: `/v3/projects/435b45cdb2384546a8be13c92c113b45/users/f3ccda7804024795b02248eaff13b834/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:45.640409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580f43f-5530-411b-8432-7ff87e8b536b admin admin] RBAC: Authorizing `identity:create_grant(project_id=435b45cdb2384546a8be13c92c113b45, user_id=f3ccda7804024795b02248eaff13b834, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:45.643266 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580f43f-5530-411b-8432-7ff87e8b536b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:45.719592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1330/2665] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:07:45 2022] PUT /identity/v3/projects/435b45cdb2384546a8be13c92c113b45/users/f3ccda7804024795b02248eaff13b834/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:45.738737 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0e2bc-da16-46e2-a238-12873d822082 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:45.739712 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0e2bc-da16-46e2-a238-12873d822082 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:45.740161 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0e2bc-da16-46e2-a238-12873d822082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:45.771373 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-a1c0e2bc-da16-46e2-a238-12873d822082 None None] MFA Rules not processed for user `f3ccda7804024795b02248eaff13b834`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:45.772896 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a1c0e2bc-da16-46e2-a238-12873d822082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:45.887733 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1336/2666] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:45.894025 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580f43f-5530-411b-8432-7ff87e8b536b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:46.012208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580f43f-5530-411b-8432-7ff87e8b536b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:46.022488 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482fa24-93df-40d2-aeb0-649a770f2574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:46.024450 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482fa24-93df-40d2-aeb0-649a770f2574 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:46.026610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482fa24-93df-40d2-aeb0-649a770f2574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:46.027275 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482fa24-93df-40d2-aeb0-649a770f2574 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:46.028906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482fa24-93df-40d2-aeb0-649a770f2574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:46.031606 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482fa24-93df-40d2-aeb0-649a770f2574 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:46.065458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767d45c-3510-497b-97b5-836720b1be36 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:46.065752 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767d45c-3510-497b-97b5-836720b1be36 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:46.066156 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767d45c-3510-497b-97b5-836720b1be36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:46.085642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-e767d45c-3510-497b-97b5-836720b1be36 None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:46.086887 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-e767d45c-3510-497b-97b5-836720b1be36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:46.142620 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1331/2667] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:07:45 2022] POST /identity/v3/projects => generated 365 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:07:46.143908 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482fa24-93df-40d2-aeb0-649a770f2574 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:46.223068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1337/2668] 10.222.0.52 () {58 vars in 1009 bytes} [Tue Mar 8 12:07:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:07:46.240442 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767d45c-3510-497b-97b5-836720b1be36 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:46.242066 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-e767d45c-3510-497b-97b5-836720b1be36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:46.256352 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482fa24-93df-40d2-aeb0-649a770f2574 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:46.264045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e854f4-2027-48f9-a6a9-669f5a18893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:46.264853 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e854f4-2027-48f9-a6a9-669f5a18893f admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:46.265277 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e854f4-2027-48f9-a6a9-669f5a18893f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:46.267009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e854f4-2027-48f9-a6a9-669f5a18893f admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:46.267795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e854f4-2027-48f9-a6a9-669f5a18893f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:46.270999 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e854f4-2027-48f9-a6a9-669f5a18893f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:46.343839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767d45c-3510-497b-97b5-836720b1be36 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:46.351279 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1332/2669] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:07:46 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:07:46.354910 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e854f4-2027-48f9-a6a9-669f5a18893f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:46.369397 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e854f4-2027-48f9-a6a9-669f5a18893f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:46.382699 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1851962-c84d-4bdc-8ee4-63076a2b170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:46.383783 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1851962-c84d-4bdc-8ee4-63076a2b170e admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:46.384172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1851962-c84d-4bdc-8ee4-63076a2b170e admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:46.384881 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1851962-c84d-4bdc-8ee4-63076a2b170e admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:46.385440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1851962-c84d-4bdc-8ee4-63076a2b170e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:46.387300 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1851962-c84d-4bdc-8ee4-63076a2b170e admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:46.401411 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1333/2670] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:07:46.408434 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1851962-c84d-4bdc-8ee4-63076a2b170e admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:46.419783 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1851962-c84d-4bdc-8ee4-63076a2b170e admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:46.426598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8ec11-e939-41f1-a29d-18cbf7ac179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:46.427619 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8ec11-e939-41f1-a29d-18cbf7ac179c admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:46.427840 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8ec11-e939-41f1-a29d-18cbf7ac179c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:46.428138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8ec11-e939-41f1-a29d-18cbf7ac179c admin admin] PATH_INFO: `/v3/projects/23a8f24032e84a2287f6cc9a87daf7cd/users/bb6bc1ea20844a27af0f7b4f085c2c06/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:46.431931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7550a-1f99-4a26-b337-561780cc44df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:46.432788 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7550a-1f99-4a26-b337-561780cc44df service swift] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:46.433245 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7550a-1f99-4a26-b337-561780cc44df service swift] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:46.433698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7550a-1f99-4a26-b337-561780cc44df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:46.454679 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8ec11-e939-41f1-a29d-18cbf7ac179c admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a8f24032e84a2287f6cc9a87daf7cd, user_id=bb6bc1ea20844a27af0f7b4f085c2c06, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:46.458086 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8ec11-e939-41f1-a29d-18cbf7ac179c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:46.530208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1334/2671] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:07:46 2022] PUT /identity/v3/projects/23a8f24032e84a2287f6cc9a87daf7cd/users/bb6bc1ea20844a27af0f7b4f085c2c06/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:46.534026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8ec11-e939-41f1-a29d-18cbf7ac179c admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:46.537169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7550a-1f99-4a26-b337-561780cc44df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:46.544905 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7550a-1f99-4a26-b337-561780cc44df service swift] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:46.554796 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1338/2672] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:07:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 12:07:46.622635 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8ec11-e939-41f1-a29d-18cbf7ac179c admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:46.628232 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acc8c3-6997-4f02-8b26-6cc4becf9ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:46.629335 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acc8c3-6997-4f02-8b26-6cc4becf9ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:46.629673 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acc8c3-6997-4f02-8b26-6cc4becf9ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:46.630025 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acc8c3-6997-4f02-8b26-6cc4becf9ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:46.630818 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acc8c3-6997-4f02-8b26-6cc4becf9ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:46.633031 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acc8c3-6997-4f02-8b26-6cc4becf9ae5 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:46.648711 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7550a-1f99-4a26-b337-561780cc44df service swift] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:46.658032 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1335/2673] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:07:46.660732 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7550a-1f99-4a26-b337-561780cc44df service swift] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:46.668859 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c608f8-60c8-4edf-863e-f78cd1c5ef7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:46.670037 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c608f8-60c8-4edf-863e-f78cd1c5ef7a admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:46.670384 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c608f8-60c8-4edf-863e-f78cd1c5ef7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:46.670729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c608f8-60c8-4edf-863e-f78cd1c5ef7a admin admin] PATH_INFO: `/v3/projects/23a8f24032e84a2287f6cc9a87daf7cd/users/bb6bc1ea20844a27af0f7b4f085c2c06/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:46.672981 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c608f8-60c8-4edf-863e-f78cd1c5ef7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a8f24032e84a2287f6cc9a87daf7cd, user_id=bb6bc1ea20844a27af0f7b4f085c2c06, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:46.676198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c608f8-60c8-4edf-863e-f78cd1c5ef7a admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:46.699053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1339/2674] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:07:46 2022] PUT /identity/v3/projects/23a8f24032e84a2287f6cc9a87daf7cd/users/bb6bc1ea20844a27af0f7b4f085c2c06/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:46.709919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61957531-16e7-4baf-91d6-08484f6afa3a None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:46.710262 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61957531-16e7-4baf-91d6-08484f6afa3a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:46.715486 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61957531-16e7-4baf-91d6-08484f6afa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:46.788830 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-61957531-16e7-4baf-91d6-08484f6afa3a None None] MFA Rules not processed for user `bb6bc1ea20844a27af0f7b4f085c2c06`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:46.790527 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-61957531-16e7-4baf-91d6-08484f6afa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:46.937093 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1336/2675] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:46.949801 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c608f8-60c8-4edf-863e-f78cd1c5ef7a admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:46.954492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-99c608f8-60c8-4edf-863e-f78cd1c5ef7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:47.086958 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c608f8-60c8-4edf-863e-f78cd1c5ef7a admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:47.091433 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252877c7-9100-4cc1-a54c-9c95117c4044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:47.092292 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252877c7-9100-4cc1-a54c-9c95117c4044 service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:47.092600 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252877c7-9100-4cc1-a54c-9c95117c4044 service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:47.093000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252877c7-9100-4cc1-a54c-9c95117c4044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:47.107003 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252877c7-9100-4cc1-a54c-9c95117c4044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:47.109210 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252877c7-9100-4cc1-a54c-9c95117c4044 service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:47.137525 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1340/2676] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:07:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:07:47.608255 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61957531-16e7-4baf-91d6-08484f6afa3a None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:47.735062 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61957531-16e7-4baf-91d6-08484f6afa3a None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:47.746157 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d7f31-00a2-4757-8a85-08c116d22282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:47.747451 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d7f31-00a2-4757-8a85-08c116d22282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:47.747855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d7f31-00a2-4757-8a85-08c116d22282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:47.748229 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d7f31-00a2-4757-8a85-08c116d22282 admin admin] PATH_INFO: `/v3/users/f3ccda7804024795b02248eaff13b834` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:47.750425 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d7f31-00a2-4757-8a85-08c116d22282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ccda7804024795b02248eaff13b834)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:47.755596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d7f31-00a2-4757-8a85-08c116d22282 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:48.007447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-839d7f31-00a2-4757-8a85-08c116d22282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ccda7804024795b02248eaff13b834'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:48.009004 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-839d7f31-00a2-4757-8a85-08c116d22282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ccda7804024795b02248eaff13b834'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:48.134870 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-839d7f31-00a2-4757-8a85-08c116d22282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ccda7804024795b02248eaff13b834'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:48.170506 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-839d7f31-00a2-4757-8a85-08c116d22282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ccda7804024795b02248eaff13b834'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:48.183236 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-839d7f31-00a2-4757-8a85-08c116d22282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ccda7804024795b02248eaff13b834'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:48.196943 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1337/2677] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:07:47 2022] DELETE /identity/v3/users/f3ccda7804024795b02248eaff13b834 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:07:48.202799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c225342-6092-4c26-a835-0f029ddff695 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:48.203285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c225342-6092-4c26-a835-0f029ddff695 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:48.203426 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c225342-6092-4c26-a835-0f029ddff695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:48.241793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-3c225342-6092-4c26-a835-0f029ddff695 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:48.249755 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3c225342-6092-4c26-a835-0f029ddff695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:48.389840 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1341/2678] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:48.398731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d7f31-00a2-4757-8a85-08c116d22282 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:48.400631 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-839d7f31-00a2-4757-8a85-08c116d22282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:48.529539 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d7f31-00a2-4757-8a85-08c116d22282 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:48.533937 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e727238-8605-4dc4-82e5-f711bba0ccb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:48.534875 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e727238-8605-4dc4-82e5-f711bba0ccb6 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:48.535190 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e727238-8605-4dc4-82e5-f711bba0ccb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:48.535689 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e727238-8605-4dc4-82e5-f711bba0ccb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:48.548144 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e727238-8605-4dc4-82e5-f711bba0ccb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:48.549862 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e727238-8605-4dc4-82e5-f711bba0ccb6 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:48.561958 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1338/2679] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:07:49.138190 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c225342-6092-4c26-a835-0f029ddff695 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:49.140413 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3c225342-6092-4c26-a835-0f029ddff695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:49.162033 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c225342-6092-4c26-a835-0f029ddff695 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:49.168148 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:49.169606 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:49.170042 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:49.170488 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16 admin admin] PATH_INFO: `/v3/projects/435b45cdb2384546a8be13c92c113b45` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:49.171804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=435b45cdb2384546a8be13c92c113b45)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:49.177805 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:49.343119 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435b45cdb2384546a8be13c92c113b45', 'request_id': 'req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:49.352292 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435b45cdb2384546a8be13c92c113b45', 'request_id': 'req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:49.455596 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435b45cdb2384546a8be13c92c113b45', 'request_id': 'req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:49.472900 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16 admin admin] The token cache is being invalidate because project 435b45cdb2384546a8be13c92c113b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:07:49.473480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:49.484108 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:49.486156 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1342/2680] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:07:49 2022] DELETE /identity/v3/projects/435b45cdb2384546a8be13c92c113b45 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:07:49.496329 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e727238-8605-4dc4-82e5-f711bba0ccb6 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:49.517927 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e727238-8605-4dc4-82e5-f711bba0ccb6 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:49.664340 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e82ca5-c13b-49a5-9385-c145792dc9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:49.665247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e82ca5-c13b-49a5-9385-c145792dc9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:49.665533 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e82ca5-c13b-49a5-9385-c145792dc9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:49.665811 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e82ca5-c13b-49a5-9385-c145792dc9dd admin admin] PATH_INFO: `/v3/users/bb6bc1ea20844a27af0f7b4f085c2c06` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:49.667059 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e82ca5-c13b-49a5-9385-c145792dc9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6bc1ea20844a27af0f7b4f085c2c06)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:49.669363 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e82ca5-c13b-49a5-9385-c145792dc9dd admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:49.917953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c3e82ca5-c13b-49a5-9385-c145792dc9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6bc1ea20844a27af0f7b4f085c2c06'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:49.919176 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c3e82ca5-c13b-49a5-9385-c145792dc9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6bc1ea20844a27af0f7b4f085c2c06'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:49.991002 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c3e82ca5-c13b-49a5-9385-c145792dc9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6bc1ea20844a27af0f7b4f085c2c06'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:50.008540 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c3e82ca5-c13b-49a5-9385-c145792dc9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6bc1ea20844a27af0f7b4f085c2c06'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:50.015899 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-c3e82ca5-c13b-49a5-9385-c145792dc9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6bc1ea20844a27af0f7b4f085c2c06'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:50.040061 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1339/2681] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:07:49 2022] DELETE /identity/v3/users/bb6bc1ea20844a27af0f7b4f085c2c06 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:50.650179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:50.652382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:50.686238 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f55b3-6ab9-4980-a1ec-6f6ba6d8ab16 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:50.798457 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187a1f5-ca58-43b4-a09f-d7414eadb927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:50.800299 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187a1f5-ca58-43b4-a09f-d7414eadb927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:50.801467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187a1f5-ca58-43b4-a09f-d7414eadb927 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:50.802675 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187a1f5-ca58-43b4-a09f-d7414eadb927 admin admin] PATH_INFO: `/v3/projects/23a8f24032e84a2287f6cc9a87daf7cd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:50.805161 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187a1f5-ca58-43b4-a09f-d7414eadb927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a8f24032e84a2287f6cc9a87daf7cd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:50.808546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187a1f5-ca58-43b4-a09f-d7414eadb927 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:50.953595 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5187a1f5-ca58-43b4-a09f-d7414eadb927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a8f24032e84a2287f6cc9a87daf7cd', 'request_id': 'req-5187a1f5-ca58-43b4-a09f-d7414eadb927'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:50.967088 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5187a1f5-ca58-43b4-a09f-d7414eadb927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a8f24032e84a2287f6cc9a87daf7cd', 'request_id': 'req-5187a1f5-ca58-43b4-a09f-d7414eadb927'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:51.052876 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5187a1f5-ca58-43b4-a09f-d7414eadb927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a8f24032e84a2287f6cc9a87daf7cd', 'request_id': 'req-5187a1f5-ca58-43b4-a09f-d7414eadb927'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:51.072076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5187a1f5-ca58-43b4-a09f-d7414eadb927 admin admin] The token cache is being invalidate because project 23a8f24032e84a2287f6cc9a87daf7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:07:51.079652 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5187a1f5-ca58-43b4-a09f-d7414eadb927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:51.080777 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5187a1f5-ca58-43b4-a09f-d7414eadb927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:51.087874 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1343/2682] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:07:50 2022] DELETE /identity/v3/projects/23a8f24032e84a2287f6cc9a87daf7cd => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:51.089972 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e81f76-c2e2-4890-8649-9383c7bb4c65 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:51.090430 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e81f76-c2e2-4890-8649-9383c7bb4c65 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:51.090538 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e81f76-c2e2-4890-8649-9383c7bb4c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:51.137141 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-64e81f76-c2e2-4890-8649-9383c7bb4c65 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:51.138816 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-64e81f76-c2e2-4890-8649-9383c7bb4c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:51.272416 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1340/2683] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:51.284826 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd34909-1da5-4933-9203-a0e50c2742e8 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:51.285117 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd34909-1da5-4933-9203-a0e50c2742e8 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:51.285395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd34909-1da5-4933-9203-a0e50c2742e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:51.310198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-bdd34909-1da5-4933-9203-a0e50c2742e8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:51.312138 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-bdd34909-1da5-4933-9203-a0e50c2742e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:51.321697 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1344/2684] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:51.326218 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e81f76-c2e2-4890-8649-9383c7bb4c65 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:51.338458 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e81f76-c2e2-4890-8649-9383c7bb4c65 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:51.343982 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edcd2c-2c41-4790-92d5-607106b0e204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:51.344749 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edcd2c-2c41-4790-92d5-607106b0e204 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:51.345080 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edcd2c-2c41-4790-92d5-607106b0e204 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:51.345417 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edcd2c-2c41-4790-92d5-607106b0e204 admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:51.346230 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edcd2c-2c41-4790-92d5-607106b0e204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:07:51.346615 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edcd2c-2c41-4790-92d5-607106b0e204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:51.349231 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edcd2c-2c41-4790-92d5-607106b0e204 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:51.371351 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd34909-1da5-4933-9203-a0e50c2742e8 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:51.371716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1341/2685] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:07:51.384334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd34909-1da5-4933-9203-a0e50c2742e8 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:51.389500 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6c13b-3802-492e-ae63-e5610ec2dc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:51.390170 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6c13b-3802-492e-ae63-e5610ec2dc65 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:51.390488 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6c13b-3802-492e-ae63-e5610ec2dc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:51.390751 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6c13b-3802-492e-ae63-e5610ec2dc65 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:51.391454 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6c13b-3802-492e-ae63-e5610ec2dc65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:51.393460 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6c13b-3802-492e-ae63-e5610ec2dc65 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:51.493159 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1345/2686] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:07:51 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:07:51.494404 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edcd2c-2c41-4790-92d5-607106b0e204 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:51.506897 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edcd2c-2c41-4790-92d5-607106b0e204 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:51.657603 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e505be0-d314-404c-8909-d94584fdd92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:51.658299 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e505be0-d314-404c-8909-d94584fdd92a admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:51.658582 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e505be0-d314-404c-8909-d94584fdd92a admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:51.658858 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e505be0-d314-404c-8909-d94584fdd92a admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:51.659588 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e505be0-d314-404c-8909-d94584fdd92a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:51.661536 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e505be0-d314-404c-8909-d94584fdd92a admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:52.188077 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1342/2687] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:07:51 2022] POST /identity/v3/users => generated 292 bytes in 693 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:07:52.193175 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6c13b-3802-492e-ae63-e5610ec2dc65 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:52.208686 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6c13b-3802-492e-ae63-e5610ec2dc65 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:52.218776 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e66dd7-cfc8-4b32-b541-6b4741a04351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:52.219765 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e66dd7-cfc8-4b32-b541-6b4741a04351 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:52.227710 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e66dd7-cfc8-4b32-b541-6b4741a04351 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:52.227710 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e66dd7-cfc8-4b32-b541-6b4741a04351 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:52.227710 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e66dd7-cfc8-4b32-b541-6b4741a04351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:52.227710 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e66dd7-cfc8-4b32-b541-6b4741a04351 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:52.263769 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1346/2688] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:07:52.267630 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e505be0-d314-404c-8909-d94584fdd92a admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:52.289695 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e505be0-d314-404c-8909-d94584fdd92a admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:52.301206 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67aebe-7bd5-4c2a-bc9d-553f2f5b7456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:52.316857 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67aebe-7bd5-4c2a-bc9d-553f2f5b7456 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:52.316857 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67aebe-7bd5-4c2a-bc9d-553f2f5b7456 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:52.316857 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67aebe-7bd5-4c2a-bc9d-553f2f5b7456 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:52.316857 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67aebe-7bd5-4c2a-bc9d-553f2f5b7456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:52.316857 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67aebe-7bd5-4c2a-bc9d-553f2f5b7456 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:52.332442 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1343/2689] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:07:52.336430 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e66dd7-cfc8-4b32-b541-6b4741a04351 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:52.365151 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e66dd7-cfc8-4b32-b541-6b4741a04351 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:52.370422 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522b994-3889-4a71-9d77-43978ad533ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:52.371661 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522b994-3889-4a71-9d77-43978ad533ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:52.372669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522b994-3889-4a71-9d77-43978ad533ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:52.373135 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522b994-3889-4a71-9d77-43978ad533ea admin admin] PATH_INFO: `/v3/projects/a1247ed1a92a4487ba7e668b0a459eb2/users/4053e96755ed4f47925f740899b8379f/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:52.389788 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522b994-3889-4a71-9d77-43978ad533ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1247ed1a92a4487ba7e668b0a459eb2, user_id=4053e96755ed4f47925f740899b8379f, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:52.392860 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522b994-3889-4a71-9d77-43978ad533ea admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:52.505179 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1347/2690] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:07:52 2022] PUT /identity/v3/projects/a1247ed1a92a4487ba7e668b0a459eb2/users/4053e96755ed4f47925f740899b8379f/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:52.525932 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ce1ed-d106-4b6b-b83b-f999bf96a1a2 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:52.526617 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ce1ed-d106-4b6b-b83b-f999bf96a1a2 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:52.527124 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ce1ed-d106-4b6b-b83b-f999bf96a1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:52.603950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-122ce1ed-d106-4b6b-b83b-f999bf96a1a2 None None] MFA Rules not processed for user `4053e96755ed4f47925f740899b8379f`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:52.605326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-122ce1ed-d106-4b6b-b83b-f999bf96a1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:52.718324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1344/2691] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:52.722343 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522b994-3889-4a71-9d77-43978ad533ea admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:52.822517 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522b994-3889-4a71-9d77-43978ad533ea admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:52.828385 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b09d5-2d43-4217-a648-bc9a80765b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:52.829445 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b09d5-2d43-4217-a648-bc9a80765b83 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:52.829834 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b09d5-2d43-4217-a648-bc9a80765b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:52.830205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b09d5-2d43-4217-a648-bc9a80765b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:52.831095 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b09d5-2d43-4217-a648-bc9a80765b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:52.833341 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b09d5-2d43-4217-a648-bc9a80765b83 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:52.972369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1348/2692] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:07:52 2022] POST /identity/v3/projects => generated 383 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:07:52.976306 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ce1ed-d106-4b6b-b83b-f999bf96a1a2 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:52.989409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ce1ed-d106-4b6b-b83b-f999bf96a1a2 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:53.077078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02086b-8341-499d-a74d-5ac4bfe8ec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:53.078379 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02086b-8341-499d-a74d-5ac4bfe8ec85 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:53.078479 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02086b-8341-499d-a74d-5ac4bfe8ec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:53.078691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02086b-8341-499d-a74d-5ac4bfe8ec85 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:53.079423 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02086b-8341-499d-a74d-5ac4bfe8ec85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:53.081512 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02086b-8341-499d-a74d-5ac4bfe8ec85 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:53.168018 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1345/2693] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:07:52 2022] POST /identity/v3/users => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:07:53.173919 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b09d5-2d43-4217-a648-bc9a80765b83 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:53.186046 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b09d5-2d43-4217-a648-bc9a80765b83 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:53.195500 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6dedd-4684-4225-8295-e31c6d3c7404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:53.195500 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6dedd-4684-4225-8295-e31c6d3c7404 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:53.195500 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6dedd-4684-4225-8295-e31c6d3c7404 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:53.195500 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6dedd-4684-4225-8295-e31c6d3c7404 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:53.197743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6dedd-4684-4225-8295-e31c6d3c7404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:53.199512 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6dedd-4684-4225-8295-e31c6d3c7404 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:53.221825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1349/2694] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:07:53.226138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02086b-8341-499d-a74d-5ac4bfe8ec85 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:53.240630 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02086b-8341-499d-a74d-5ac4bfe8ec85 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:53.249192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f19603-fab6-4935-8c29-f6657d2a297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:53.251258 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f19603-fab6-4935-8c29-f6657d2a297f admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:53.251692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f19603-fab6-4935-8c29-f6657d2a297f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:53.253824 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f19603-fab6-4935-8c29-f6657d2a297f admin admin] PATH_INFO: `/v3/projects/5d10a2c405df49f793dac468ce4e5c9d/users/6afab3ce7a6b4e8e9e35dc02a84e705f/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:53.270575 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f19603-fab6-4935-8c29-f6657d2a297f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d10a2c405df49f793dac468ce4e5c9d, user_id=6afab3ce7a6b4e8e9e35dc02a84e705f, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:53.273603 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f19603-fab6-4935-8c29-f6657d2a297f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:53.353272 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1346/2695] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:07:53 2022] PUT /identity/v3/projects/5d10a2c405df49f793dac468ce4e5c9d/users/6afab3ce7a6b4e8e9e35dc02a84e705f/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:53.359573 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6dedd-4684-4225-8295-e31c6d3c7404 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:53.376226 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6dedd-4684-4225-8295-e31c6d3c7404 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:53.478928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f2d11-9ff9-46f2-b7f3-9eef62d47ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:53.480356 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f2d11-9ff9-46f2-b7f3-9eef62d47ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:53.480851 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f2d11-9ff9-46f2-b7f3-9eef62d47ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:53.484383 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f2d11-9ff9-46f2-b7f3-9eef62d47ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:53.484383 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f2d11-9ff9-46f2-b7f3-9eef62d47ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:53.484383 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f2d11-9ff9-46f2-b7f3-9eef62d47ff0 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:53.508240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1350/2696] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:07:53.513859 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f19603-fab6-4935-8c29-f6657d2a297f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:53.530333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f19603-fab6-4935-8c29-f6657d2a297f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:53.553607 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789a0d6-179a-4345-821c-3ddeb9b9e7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:53.554637 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789a0d6-179a-4345-821c-3ddeb9b9e7ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:53.554918 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789a0d6-179a-4345-821c-3ddeb9b9e7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:53.555192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789a0d6-179a-4345-821c-3ddeb9b9e7ae admin admin] PATH_INFO: `/v3/projects/5d10a2c405df49f793dac468ce4e5c9d/users/6afab3ce7a6b4e8e9e35dc02a84e705f/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:53.571498 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789a0d6-179a-4345-821c-3ddeb9b9e7ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d10a2c405df49f793dac468ce4e5c9d, user_id=6afab3ce7a6b4e8e9e35dc02a84e705f, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:53.574246 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789a0d6-179a-4345-821c-3ddeb9b9e7ae admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:53.666854 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1347/2697] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:07:53 2022] PUT /identity/v3/projects/5d10a2c405df49f793dac468ce4e5c9d/users/6afab3ce7a6b4e8e9e35dc02a84e705f/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:53.670027 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe6ef0-ffdb-4110-aa37-8f73bed340d7 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:53.674778 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe6ef0-ffdb-4110-aa37-8f73bed340d7 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:53.674778 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe6ef0-ffdb-4110-aa37-8f73bed340d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:53.760912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-6cfe6ef0-ffdb-4110-aa37-8f73bed340d7 None None] MFA Rules not processed for user `6afab3ce7a6b4e8e9e35dc02a84e705f`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:53.766706 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-6cfe6ef0-ffdb-4110-aa37-8f73bed340d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:53.940014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1351/2698] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:53.962485 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789a0d6-179a-4345-821c-3ddeb9b9e7ae admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:53.964934 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-8789a0d6-179a-4345-821c-3ddeb9b9e7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:54.078478 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789a0d6-179a-4345-821c-3ddeb9b9e7ae admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:54.084473 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e45fb2-9cf7-4d4a-b6f0-7a35dafaae99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:54.085622 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e45fb2-9cf7-4d4a-b6f0-7a35dafaae99 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:54.086171 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e45fb2-9cf7-4d4a-b6f0-7a35dafaae99 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:54.086640 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e45fb2-9cf7-4d4a-b6f0-7a35dafaae99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:54.126943 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e45fb2-9cf7-4d4a-b6f0-7a35dafaae99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:54.130192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e45fb2-9cf7-4d4a-b6f0-7a35dafaae99 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:54.153527 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1348/2699] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:07:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:07:54.319202 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe6ef0-ffdb-4110-aa37-8f73bed340d7 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:54.334298 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe6ef0-ffdb-4110-aa37-8f73bed340d7 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:54.347227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f81808-7c1b-4c11-817a-b990a1be1605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:54.348335 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f81808-7c1b-4c11-817a-b990a1be1605 service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:54.348866 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f81808-7c1b-4c11-817a-b990a1be1605 service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:54.349369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f81808-7c1b-4c11-817a-b990a1be1605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:54.490758 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f81808-7c1b-4c11-817a-b990a1be1605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:54.492724 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f81808-7c1b-4c11-817a-b990a1be1605 service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:54.507158 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1352/2700] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:07:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:07:55.096827 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e45fb2-9cf7-4d4a-b6f0-7a35dafaae99 service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:55.098793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-83e45fb2-9cf7-4d4a-b6f0-7a35dafaae99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:55.129191 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f81808-7c1b-4c11-817a-b990a1be1605 service cinder] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:55.185930 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e45fb2-9cf7-4d4a-b6f0-7a35dafaae99 service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:55.196520 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f07041-2bb4-4b18-a345-dce9a1b5fd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:55.197430 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f07041-2bb4-4b18-a345-dce9a1b5fd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:55.197713 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f07041-2bb4-4b18-a345-dce9a1b5fd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:55.198009 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f07041-2bb4-4b18-a345-dce9a1b5fd99 admin admin] PATH_INFO: `/v3/users/ae14c5524ee54e9c94a21362cb215eca` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:55.199289 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f07041-2bb4-4b18-a345-dce9a1b5fd99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae14c5524ee54e9c94a21362cb215eca)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:55.202014 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f07041-2bb4-4b18-a345-dce9a1b5fd99 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:55.226777 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f81808-7c1b-4c11-817a-b990a1be1605 service cinder] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:55.231984 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476452dc-4dee-446f-980d-6f98f066c5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:55.232907 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476452dc-4dee-446f-980d-6f98f066c5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:55.233192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476452dc-4dee-446f-980d-6f98f066c5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:55.233469 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476452dc-4dee-446f-980d-6f98f066c5fb admin admin] PATH_INFO: `/v3/users/4053e96755ed4f47925f740899b8379f` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:55.234785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476452dc-4dee-446f-980d-6f98f066c5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4053e96755ed4f47925f740899b8379f)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:55.236824 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476452dc-4dee-446f-980d-6f98f066c5fb admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:55.423183 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-27f07041-2bb4-4b18-a345-dce9a1b5fd99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae14c5524ee54e9c94a21362cb215eca'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:55.423834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-27f07041-2bb4-4b18-a345-dce9a1b5fd99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae14c5524ee54e9c94a21362cb215eca'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:55.446319 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-476452dc-4dee-446f-980d-6f98f066c5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4053e96755ed4f47925f740899b8379f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:55.447019 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-476452dc-4dee-446f-980d-6f98f066c5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4053e96755ed4f47925f740899b8379f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:55.454373 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-476452dc-4dee-446f-980d-6f98f066c5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4053e96755ed4f47925f740899b8379f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:55.506997 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-27f07041-2bb4-4b18-a345-dce9a1b5fd99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae14c5524ee54e9c94a21362cb215eca'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:55.519894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-27f07041-2bb4-4b18-a345-dce9a1b5fd99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae14c5524ee54e9c94a21362cb215eca'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:55.526769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-27f07041-2bb4-4b18-a345-dce9a1b5fd99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae14c5524ee54e9c94a21362cb215eca'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:55.532829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1349/2701] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:07:55 2022] DELETE /identity/v3/users/ae14c5524ee54e9c94a21362cb215eca => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:55.558454 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-476452dc-4dee-446f-980d-6f98f066c5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4053e96755ed4f47925f740899b8379f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:55.572278 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-476452dc-4dee-446f-980d-6f98f066c5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4053e96755ed4f47925f740899b8379f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:55.582910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1353/2702] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:07:55 2022] DELETE /identity/v3/users/4053e96755ed4f47925f740899b8379f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:55.585102 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361cc37-8f8b-4cd4-8847-a7c0bfce0e32 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:55.585392 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361cc37-8f8b-4cd4-8847-a7c0bfce0e32 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:55.585668 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361cc37-8f8b-4cd4-8847-a7c0bfce0e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:55.603489 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-c361cc37-8f8b-4cd4-8847-a7c0bfce0e32 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:55.604794 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c361cc37-8f8b-4cd4-8847-a7c0bfce0e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:55.666471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1350/2703] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:55.680641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476452dc-4dee-446f-980d-6f98f066c5fb admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:55.680641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-476452dc-4dee-446f-980d-6f98f066c5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:55.735297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476452dc-4dee-446f-980d-6f98f066c5fb admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:55.738911 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c4349-5f4a-4259-bfab-b8a415f38cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:55.739583 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c4349-5f4a-4259-bfab-b8a415f38cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:55.739870 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c4349-5f4a-4259-bfab-b8a415f38cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:55.740146 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c4349-5f4a-4259-bfab-b8a415f38cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:55.749695 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c4349-5f4a-4259-bfab-b8a415f38cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:55.751129 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c4349-5f4a-4259-bfab-b8a415f38cd6 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:55.760855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1354/2704] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:07:55.792362 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361cc37-8f8b-4cd4-8847-a7c0bfce0e32 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:55.795306 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-c361cc37-8f8b-4cd4-8847-a7c0bfce0e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:55.813899 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361cc37-8f8b-4cd4-8847-a7c0bfce0e32 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:55.819788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127f264-0226-4249-a9ac-302c552a42ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:55.820756 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127f264-0226-4249-a9ac-302c552a42ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:55.820940 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127f264-0226-4249-a9ac-302c552a42ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:55.821332 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127f264-0226-4249-a9ac-302c552a42ce admin admin] PATH_INFO: `/v3/projects/a0b93ba112f94a11ab3c56f431ac05b5` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:55.822466 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127f264-0226-4249-a9ac-302c552a42ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b93ba112f94a11ab3c56f431ac05b5)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:55.824654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127f264-0226-4249-a9ac-302c552a42ce admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:55.928166 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2127f264-0226-4249-a9ac-302c552a42ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b93ba112f94a11ab3c56f431ac05b5', 'request_id': 'req-2127f264-0226-4249-a9ac-302c552a42ce'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:55.985220 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2127f264-0226-4249-a9ac-302c552a42ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b93ba112f94a11ab3c56f431ac05b5', 'request_id': 'req-2127f264-0226-4249-a9ac-302c552a42ce'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:55.992340 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2127f264-0226-4249-a9ac-302c552a42ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b93ba112f94a11ab3c56f431ac05b5', 'request_id': 'req-2127f264-0226-4249-a9ac-302c552a42ce'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.004071 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2127f264-0226-4249-a9ac-302c552a42ce admin admin] The token cache is being invalidate because project a0b93ba112f94a11ab3c56f431ac05b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:07:56.004383 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2127f264-0226-4249-a9ac-302c552a42ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.005043 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2127f264-0226-4249-a9ac-302c552a42ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.006579 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1351/2705] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:07:55 2022] DELETE /identity/v3/projects/a0b93ba112f94a11ab3c56f431ac05b5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:56.010497 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c4349-5f4a-4259-bfab-b8a415f38cd6 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:56.020706 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c4349-5f4a-4259-bfab-b8a415f38cd6 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:56.076924 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a45e59-5224-4659-9b58-84fbfa315e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:56.077813 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a45e59-5224-4659-9b58-84fbfa315e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:56.078098 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a45e59-5224-4659-9b58-84fbfa315e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:56.078418 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a45e59-5224-4659-9b58-84fbfa315e69 admin admin] PATH_INFO: `/v3/users/04578ed5a0684431a03d2da7324163bc` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:56.079716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a45e59-5224-4659-9b58-84fbfa315e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04578ed5a0684431a03d2da7324163bc)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:56.081892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a45e59-5224-4659-9b58-84fbfa315e69 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:56.171057 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127f264-0226-4249-a9ac-302c552a42ce admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:56.173613 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-2127f264-0226-4249-a9ac-302c552a42ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:56.199480 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127f264-0226-4249-a9ac-302c552a42ce admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:56.208390 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f8f70-2df6-4952-9515-7abc75ffc445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:56.209444 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f8f70-2df6-4952-9515-7abc75ffc445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:56.209621 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f8f70-2df6-4952-9515-7abc75ffc445 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:56.209896 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f8f70-2df6-4952-9515-7abc75ffc445 admin admin] PATH_INFO: `/v3/projects/a1247ed1a92a4487ba7e668b0a459eb2` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:56.211500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f8f70-2df6-4952-9515-7abc75ffc445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1247ed1a92a4487ba7e668b0a459eb2)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:56.213453 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f8f70-2df6-4952-9515-7abc75ffc445 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:56.271417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-40a45e59-5224-4659-9b58-84fbfa315e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04578ed5a0684431a03d2da7324163bc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.272128 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-40a45e59-5224-4659-9b58-84fbfa315e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04578ed5a0684431a03d2da7324163bc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.279902 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-40a45e59-5224-4659-9b58-84fbfa315e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04578ed5a0684431a03d2da7324163bc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.381069 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-40a45e59-5224-4659-9b58-84fbfa315e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04578ed5a0684431a03d2da7324163bc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.394172 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-40a45e59-5224-4659-9b58-84fbfa315e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04578ed5a0684431a03d2da7324163bc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.400772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-1c8f8f70-2df6-4952-9515-7abc75ffc445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1247ed1a92a4487ba7e668b0a459eb2', 'request_id': 'req-1c8f8f70-2df6-4952-9515-7abc75ffc445'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.400982 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1355/2706] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:07:56 2022] DELETE /identity/v3/users/04578ed5a0684431a03d2da7324163bc => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:56.474600 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-1c8f8f70-2df6-4952-9515-7abc75ffc445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1247ed1a92a4487ba7e668b0a459eb2', 'request_id': 'req-1c8f8f70-2df6-4952-9515-7abc75ffc445'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.482209 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-1c8f8f70-2df6-4952-9515-7abc75ffc445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1247ed1a92a4487ba7e668b0a459eb2', 'request_id': 'req-1c8f8f70-2df6-4952-9515-7abc75ffc445'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.499099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-1c8f8f70-2df6-4952-9515-7abc75ffc445 admin admin] The token cache is being invalidate because project a1247ed1a92a4487ba7e668b0a459eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:07:56.499396 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-1c8f8f70-2df6-4952-9515-7abc75ffc445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.500379 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-1c8f8f70-2df6-4952-9515-7abc75ffc445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.502469 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1352/2707] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:07:56 2022] DELETE /identity/v3/projects/a1247ed1a92a4487ba7e668b0a459eb2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:56.506736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a45e59-5224-4659-9b58-84fbfa315e69 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:56.509105 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-40a45e59-5224-4659-9b58-84fbfa315e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:56.582409 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a45e59-5224-4659-9b58-84fbfa315e69 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:56.587145 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e89db-7c0a-4144-9828-bdf1eea864e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:56.588107 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e89db-7c0a-4144-9828-bdf1eea864e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:56.588391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e89db-7c0a-4144-9828-bdf1eea864e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:56.588667 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e89db-7c0a-4144-9828-bdf1eea864e5 admin admin] PATH_INFO: `/v3/users/6afab3ce7a6b4e8e9e35dc02a84e705f` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:56.592814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e89db-7c0a-4144-9828-bdf1eea864e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6afab3ce7a6b4e8e9e35dc02a84e705f)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:56.592814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e89db-7c0a-4144-9828-bdf1eea864e5 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:56.644452 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f8f70-2df6-4952-9515-7abc75ffc445 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:56.646070 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1c8f8f70-2df6-4952-9515-7abc75ffc445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:56.714169 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f8f70-2df6-4952-9515-7abc75ffc445 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:56.718767 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e870d-656e-459f-917c-ba6d0f203ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:56.719657 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e870d-656e-459f-917c-ba6d0f203ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:56.719937 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e870d-656e-459f-917c-ba6d0f203ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:56.720207 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e870d-656e-459f-917c-ba6d0f203ec3 admin admin] PATH_INFO: `/v3/projects/9211abecea7d4a0e9f7b8ad034637276` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:56.721381 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e870d-656e-459f-917c-ba6d0f203ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9211abecea7d4a0e9f7b8ad034637276)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:56.723287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e870d-656e-459f-917c-ba6d0f203ec3 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:56.789132 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-121e89db-7c0a-4144-9828-bdf1eea864e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6afab3ce7a6b4e8e9e35dc02a84e705f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.789814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-121e89db-7c0a-4144-9828-bdf1eea864e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6afab3ce7a6b4e8e9e35dc02a84e705f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.797484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-121e89db-7c0a-4144-9828-bdf1eea864e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6afab3ce7a6b4e8e9e35dc02a84e705f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.838407 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8a2e870d-656e-459f-917c-ba6d0f203ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9211abecea7d4a0e9f7b8ad034637276', 'request_id': 'req-8a2e870d-656e-459f-917c-ba6d0f203ec3'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.893602 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-121e89db-7c0a-4144-9828-bdf1eea864e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6afab3ce7a6b4e8e9e35dc02a84e705f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.907045 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-121e89db-7c0a-4144-9828-bdf1eea864e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6afab3ce7a6b4e8e9e35dc02a84e705f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.913171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1356/2708] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:07:56 2022] DELETE /identity/v3/users/6afab3ce7a6b4e8e9e35dc02a84e705f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:56.973381 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8a2e870d-656e-459f-917c-ba6d0f203ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9211abecea7d4a0e9f7b8ad034637276', 'request_id': 'req-8a2e870d-656e-459f-917c-ba6d0f203ec3'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.980630 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8a2e870d-656e-459f-917c-ba6d0f203ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9211abecea7d4a0e9f7b8ad034637276', 'request_id': 'req-8a2e870d-656e-459f-917c-ba6d0f203ec3'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.991596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8a2e870d-656e-459f-917c-ba6d0f203ec3 admin admin] The token cache is being invalidate because project 9211abecea7d4a0e9f7b8ad034637276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:07:56.991882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8a2e870d-656e-459f-917c-ba6d0f203ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.992528 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8a2e870d-656e-459f-917c-ba6d0f203ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:56.994049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1353/2709] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:07:56 2022] DELETE /identity/v3/projects/9211abecea7d4a0e9f7b8ad034637276 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:07:57.354071 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e89db-7c0a-4144-9828-bdf1eea864e5 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:57.359409 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-121e89db-7c0a-4144-9828-bdf1eea864e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:57.429349 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e89db-7c0a-4144-9828-bdf1eea864e5 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:57.434146 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908c6e8-1a4e-4451-a026-e988253e2c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:57.436009 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908c6e8-1a4e-4451-a026-e988253e2c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:57.436473 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908c6e8-1a4e-4451-a026-e988253e2c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:57.436806 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908c6e8-1a4e-4451-a026-e988253e2c47 admin admin] PATH_INFO: `/v3/projects/5d10a2c405df49f793dac468ce4e5c9d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:57.438143 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908c6e8-1a4e-4451-a026-e988253e2c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d10a2c405df49f793dac468ce4e5c9d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:57.440192 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908c6e8-1a4e-4451-a026-e988253e2c47 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:57.567185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b908c6e8-1a4e-4451-a026-e988253e2c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d10a2c405df49f793dac468ce4e5c9d', 'request_id': 'req-b908c6e8-1a4e-4451-a026-e988253e2c47'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:57.576311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b908c6e8-1a4e-4451-a026-e988253e2c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d10a2c405df49f793dac468ce4e5c9d', 'request_id': 'req-b908c6e8-1a4e-4451-a026-e988253e2c47'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:57.644143 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b908c6e8-1a4e-4451-a026-e988253e2c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d10a2c405df49f793dac468ce4e5c9d', 'request_id': 'req-b908c6e8-1a4e-4451-a026-e988253e2c47'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:57.656873 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b908c6e8-1a4e-4451-a026-e988253e2c47 admin admin] The token cache is being invalidate because project 5d10a2c405df49f793dac468ce4e5c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:07:57.657276 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b908c6e8-1a4e-4451-a026-e988253e2c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:57.658248 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-b908c6e8-1a4e-4451-a026-e988253e2c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:57.660083 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1357/2710] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:07:57 2022] DELETE /identity/v3/projects/5d10a2c405df49f793dac468ce4e5c9d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:57.664973 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb0ca7-f0c1-4088-8ce7-65710d68c186 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:57.666007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb0ca7-f0c1-4088-8ce7-65710d68c186 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:57.666342 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb0ca7-f0c1-4088-8ce7-65710d68c186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:57.690309 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-b1fb0ca7-f0c1-4088-8ce7-65710d68c186 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:57.691854 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b1fb0ca7-f0c1-4088-8ce7-65710d68c186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:57.754289 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1354/2711] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:57.763280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22927c-635f-41a2-b83e-33ff764920cb None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:57.763589 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22927c-635f-41a2-b83e-33ff764920cb None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:57.763870 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22927c-635f-41a2-b83e-33ff764920cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:57.783347 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-aa22927c-635f-41a2-b83e-33ff764920cb None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:57.784601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-aa22927c-635f-41a2-b83e-33ff764920cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:57.792554 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1358/2712] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:57.797365 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb0ca7-f0c1-4088-8ce7-65710d68c186 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:57.807047 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb0ca7-f0c1-4088-8ce7-65710d68c186 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:57.812173 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768390f-a042-4129-8856-0e87c48ea55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:57.812924 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768390f-a042-4129-8856-0e87c48ea55d admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:57.813276 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768390f-a042-4129-8856-0e87c48ea55d admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:57.813643 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768390f-a042-4129-8856-0e87c48ea55d admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:57.814376 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768390f-a042-4129-8856-0e87c48ea55d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:07:57.814685 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768390f-a042-4129-8856-0e87c48ea55d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:57.816347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768390f-a042-4129-8856-0e87c48ea55d admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:57.828063 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1355/2713] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:07:57.832694 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22927c-635f-41a2-b83e-33ff764920cb None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:57.842680 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22927c-635f-41a2-b83e-33ff764920cb None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:57.847324 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8a997-d791-488a-bcdb-99d043ff8fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:57.848006 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8a997-d791-488a-bcdb-99d043ff8fea admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:57.848283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8a997-d791-488a-bcdb-99d043ff8fea admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:57.848558 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8a997-d791-488a-bcdb-99d043ff8fea admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:57.849244 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8a997-d791-488a-bcdb-99d043ff8fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:57.851142 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8a997-d791-488a-bcdb-99d043ff8fea admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:57.959756 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1359/2714] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:07:57 2022] POST /identity/v3/projects => generated 361 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:07:57.963849 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768390f-a042-4129-8856-0e87c48ea55d admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:57.974352 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768390f-a042-4129-8856-0e87c48ea55d admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:58.030049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495ac8a-a2fa-432e-85c1-df54159adf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:58.030717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495ac8a-a2fa-432e-85c1-df54159adf95 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:58.031001 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495ac8a-a2fa-432e-85c1-df54159adf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:58.031273 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495ac8a-a2fa-432e-85c1-df54159adf95 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:58.031992 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495ac8a-a2fa-432e-85c1-df54159adf95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:58.033938 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495ac8a-a2fa-432e-85c1-df54159adf95 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:58.147004 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1356/2715] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:07:57 2022] POST /identity/v3/users => generated 281 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:07:58.151307 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8a997-d791-488a-bcdb-99d043ff8fea admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:58.162268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8a997-d791-488a-bcdb-99d043ff8fea admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:58.166835 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f44bf0-1612-4cc1-bc50-f74e0f0274e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:58.167534 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f44bf0-1612-4cc1-bc50-f74e0f0274e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:58.167837 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f44bf0-1612-4cc1-bc50-f74e0f0274e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:58.168128 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f44bf0-1612-4cc1-bc50-f74e0f0274e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:58.168840 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f44bf0-1612-4cc1-bc50-f74e0f0274e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:58.170439 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f44bf0-1612-4cc1-bc50-f74e0f0274e7 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:58.180806 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1360/2716] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:07:58.184805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495ac8a-a2fa-432e-85c1-df54159adf95 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:58.195176 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495ac8a-a2fa-432e-85c1-df54159adf95 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:58.199785 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0e065-e332-491b-8702-7d505db38866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:58.201174 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0e065-e332-491b-8702-7d505db38866 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:58.201456 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0e065-e332-491b-8702-7d505db38866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:58.201729 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0e065-e332-491b-8702-7d505db38866 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:58.202447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0e065-e332-491b-8702-7d505db38866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:58.204067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0e065-e332-491b-8702-7d505db38866 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:58.214751 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1357/2717] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:07:58.219122 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f44bf0-1612-4cc1-bc50-f74e0f0274e7 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:58.228976 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f44bf0-1612-4cc1-bc50-f74e0f0274e7 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:58.233936 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aa862-98e3-46f5-abdf-a2932d3143ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:58.234811 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa862-98e3-46f5-abdf-a2932d3143ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:58.235090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa862-98e3-46f5-abdf-a2932d3143ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:58.235362 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa862-98e3-46f5-abdf-a2932d3143ee admin admin] PATH_INFO: `/v3/projects/e38f8bea56674f9083b6a71cfa7b4b3a/users/48d6db543ea2472cb92faeb5f25a9952/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:58.250295 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9aa862-98e3-46f5-abdf-a2932d3143ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38f8bea56674f9083b6a71cfa7b4b3a, user_id=48d6db543ea2472cb92faeb5f25a9952, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:58.253135 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9aa862-98e3-46f5-abdf-a2932d3143ee admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:58.318464 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1361/2718] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:07:58 2022] PUT /identity/v3/projects/e38f8bea56674f9083b6a71cfa7b4b3a/users/48d6db543ea2472cb92faeb5f25a9952/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:58.329595 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f91f5-8792-46d2-9b17-282943492ae8 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:58.329903 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f91f5-8792-46d2-9b17-282943492ae8 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:58.330198 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f91f5-8792-46d2-9b17-282943492ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:58.357295 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-f01f91f5-8792-46d2-9b17-282943492ae8 None None] MFA Rules not processed for user `48d6db543ea2472cb92faeb5f25a9952`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:58.358506 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f01f91f5-8792-46d2-9b17-282943492ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:58.420853 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1358/2719] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:58.452028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aa862-98e3-46f5-abdf-a2932d3143ee admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:58.453796 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3c9aa862-98e3-46f5-abdf-a2932d3143ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:58.509860 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aa862-98e3-46f5-abdf-a2932d3143ee admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:58.514291 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb1bdb-5a6d-4ac0-80f6-fe5d9a359261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:58.514962 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb1bdb-5a6d-4ac0-80f6-fe5d9a359261 service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:58.515244 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb1bdb-5a6d-4ac0-80f6-fe5d9a359261 service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:58.515531 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb1bdb-5a6d-4ac0-80f6-fe5d9a359261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:58.524287 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb1bdb-5a6d-4ac0-80f6-fe5d9a359261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:58.525726 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb1bdb-5a6d-4ac0-80f6-fe5d9a359261 service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:58.535214 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1362/2720] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:07:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:07:58.548788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f91f5-8792-46d2-9b17-282943492ae8 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:58.616842 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f91f5-8792-46d2-9b17-282943492ae8 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:58.622442 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb14be9-33ff-46f5-8e11-71b23fa031c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:58.623326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb14be9-33ff-46f5-8e11-71b23fa031c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:58.623716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb14be9-33ff-46f5-8e11-71b23fa031c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:58.623891 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb14be9-33ff-46f5-8e11-71b23fa031c3 admin admin] PATH_INFO: `/v3/users/48d6db543ea2472cb92faeb5f25a9952` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:58.625230 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb14be9-33ff-46f5-8e11-71b23fa031c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d6db543ea2472cb92faeb5f25a9952)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:58.627155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb14be9-33ff-46f5-8e11-71b23fa031c3 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:58.851676 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-ccb14be9-33ff-46f5-8e11-71b23fa031c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d6db543ea2472cb92faeb5f25a9952'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:58.852736 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-ccb14be9-33ff-46f5-8e11-71b23fa031c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d6db543ea2472cb92faeb5f25a9952'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:58.936136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-ccb14be9-33ff-46f5-8e11-71b23fa031c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d6db543ea2472cb92faeb5f25a9952'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:58.949176 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-ccb14be9-33ff-46f5-8e11-71b23fa031c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d6db543ea2472cb92faeb5f25a9952'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:58.956260 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-ccb14be9-33ff-46f5-8e11-71b23fa031c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d6db543ea2472cb92faeb5f25a9952'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:58.962334 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1359/2721] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:07:58 2022] DELETE /identity/v3/users/48d6db543ea2472cb92faeb5f25a9952 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:07:58.966915 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf8ee0-369d-45ec-8ca9-fc27a31af7be None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:58.967432 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf8ee0-369d-45ec-8ca9-fc27a31af7be None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:58.967577 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf8ee0-369d-45ec-8ca9-fc27a31af7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:58.986073 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-8acf8ee0-369d-45ec-8ca9-fc27a31af7be None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:07:58.987512 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-8acf8ee0-369d-45ec-8ca9-fc27a31af7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:59.051062 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1363/2722] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:07:59.062902 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb14be9-33ff-46f5-8e11-71b23fa031c3 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:59.064428 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ccb14be9-33ff-46f5-8e11-71b23fa031c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:59.123857 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb14be9-33ff-46f5-8e11-71b23fa031c3 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:59.127472 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a8b0b-23a1-42b6-811b-d5ef4d94d958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:59.128153 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8b0b-23a1-42b6-811b-d5ef4d94d958 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:59.128438 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8b0b-23a1-42b6-811b-d5ef4d94d958 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:59.128972 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8b0b-23a1-42b6-811b-d5ef4d94d958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:59.138157 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a8b0b-23a1-42b6-811b-d5ef4d94d958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:59.139645 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a8b0b-23a1-42b6-811b-d5ef4d94d958 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:59.149284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1360/2723] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:07:59.548882 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf8ee0-369d-45ec-8ca9-fc27a31af7be None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:07:59.550318 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-8acf8ee0-369d-45ec-8ca9-fc27a31af7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:07:59.566637 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf8ee0-369d-45ec-8ca9-fc27a31af7be None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:07:59.571456 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db09915-f045-4c58-ba63-271abe5f163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:07:59.572566 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db09915-f045-4c58-ba63-271abe5f163b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:07:59.572875 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db09915-f045-4c58-ba63-271abe5f163b admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:07:59.573187 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db09915-f045-4c58-ba63-271abe5f163b admin admin] PATH_INFO: `/v3/projects/e38f8bea56674f9083b6a71cfa7b4b3a` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:07:59.574424 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db09915-f045-4c58-ba63-271abe5f163b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e38f8bea56674f9083b6a71cfa7b4b3a)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:07:59.576729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db09915-f045-4c58-ba63-271abe5f163b admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:07:59.683972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6db09915-f045-4c58-ba63-271abe5f163b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38f8bea56674f9083b6a71cfa7b4b3a', 'request_id': 'req-6db09915-f045-4c58-ba63-271abe5f163b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:07:59.694353 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6db09915-f045-4c58-ba63-271abe5f163b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38f8bea56674f9083b6a71cfa7b4b3a', 'request_id': 'req-6db09915-f045-4c58-ba63-271abe5f163b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:00.613328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6db09915-f045-4c58-ba63-271abe5f163b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38f8bea56674f9083b6a71cfa7b4b3a', 'request_id': 'req-6db09915-f045-4c58-ba63-271abe5f163b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:00.624920 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6db09915-f045-4c58-ba63-271abe5f163b admin admin] The token cache is being invalidate because project e38f8bea56674f9083b6a71cfa7b4b3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:08:00.625213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6db09915-f045-4c58-ba63-271abe5f163b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:00.625971 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-6db09915-f045-4c58-ba63-271abe5f163b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:00.627515 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1364/2724] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:07:59 2022] DELETE /identity/v3/projects/e38f8bea56674f9083b6a71cfa7b4b3a => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:08:00.632741 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e611ba-84f0-486c-84a4-c9dde43870b2 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:00.633195 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e611ba-84f0-486c-84a4-c9dde43870b2 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:00.633304 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e611ba-84f0-486c-84a4-c9dde43870b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:00.651863 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-98e611ba-84f0-486c-84a4-c9dde43870b2 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:08:00.653087 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-98e611ba-84f0-486c-84a4-c9dde43870b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:00.719192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1361/2725] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:08:00.728286 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bc58b-4edf-4159-a2ee-c7b5b5ee23a1 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:00.728642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bc58b-4edf-4159-a2ee-c7b5b5ee23a1 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:00.729073 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bc58b-4edf-4159-a2ee-c7b5b5ee23a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:00.749092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-be7bc58b-4edf-4159-a2ee-c7b5b5ee23a1 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:08:00.750297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-be7bc58b-4edf-4159-a2ee-c7b5b5ee23a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:00.758444 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1365/2726] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:08:00.763321 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e611ba-84f0-486c-84a4-c9dde43870b2 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:00.773633 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e611ba-84f0-486c-84a4-c9dde43870b2 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:00.778571 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe09253-206d-4a1b-bb0d-e4251088f615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:00.779333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe09253-206d-4a1b-bb0d-e4251088f615 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:00.779657 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe09253-206d-4a1b-bb0d-e4251088f615 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:00.779935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe09253-206d-4a1b-bb0d-e4251088f615 admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:00.787682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe09253-206d-4a1b-bb0d-e4251088f615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:08:00.787682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe09253-206d-4a1b-bb0d-e4251088f615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:00.787682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe09253-206d-4a1b-bb0d-e4251088f615 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:00.794855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1362/2727] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:08:00.799457 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bc58b-4edf-4159-a2ee-c7b5b5ee23a1 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:00.810840 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bc58b-4edf-4159-a2ee-c7b5b5ee23a1 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:00.816372 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdd97b-1cd4-4dd5-af36-582b0a339757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:00.816372 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdd97b-1cd4-4dd5-af36-582b0a339757 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:00.816614 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdd97b-1cd4-4dd5-af36-582b0a339757 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:00.816891 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdd97b-1cd4-4dd5-af36-582b0a339757 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:00.817840 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdd97b-1cd4-4dd5-af36-582b0a339757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:00.819786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdd97b-1cd4-4dd5-af36-582b0a339757 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:00.946928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1366/2728] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:08:00 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:08:00.951642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe09253-206d-4a1b-bb0d-e4251088f615 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:00.962782 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe09253-206d-4a1b-bb0d-e4251088f615 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:01.040235 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cb82f-232b-4f15-af6d-16f365047f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:01.041712 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cb82f-232b-4f15-af6d-16f365047f4d admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:01.042191 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cb82f-232b-4f15-af6d-16f365047f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:01.042466 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cb82f-232b-4f15-af6d-16f365047f4d admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:01.043213 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cb82f-232b-4f15-af6d-16f365047f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:01.046244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cb82f-232b-4f15-af6d-16f365047f4d admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:01.144346 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1363/2729] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:08:00 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:08:01.147855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdd97b-1cd4-4dd5-af36-582b0a339757 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:01.161404 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdd97b-1cd4-4dd5-af36-582b0a339757 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:01.166157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758372d8-65e7-4fe5-bb29-6387e118c8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:01.167005 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758372d8-65e7-4fe5-bb29-6387e118c8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:01.167291 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758372d8-65e7-4fe5-bb29-6387e118c8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:01.167811 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758372d8-65e7-4fe5-bb29-6387e118c8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:01.168556 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758372d8-65e7-4fe5-bb29-6387e118c8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:01.170672 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758372d8-65e7-4fe5-bb29-6387e118c8a1 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:01.181640 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1367/2730] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:08:01.186237 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cb82f-232b-4f15-af6d-16f365047f4d admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:01.197810 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cb82f-232b-4f15-af6d-16f365047f4d admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:01.204477 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351777cc-b535-4858-bd0f-c9ff5453eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:01.205222 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351777cc-b535-4858-bd0f-c9ff5453eb1b admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:01.205708 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351777cc-b535-4858-bd0f-c9ff5453eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:01.206203 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351777cc-b535-4858-bd0f-c9ff5453eb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:01.207315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351777cc-b535-4858-bd0f-c9ff5453eb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:01.209146 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351777cc-b535-4858-bd0f-c9ff5453eb1b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:01.219993 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1364/2731] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:08:01.224053 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758372d8-65e7-4fe5-bb29-6387e118c8a1 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:01.234735 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758372d8-65e7-4fe5-bb29-6387e118c8a1 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:01.239348 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b86bd0-c089-4a18-8fed-23c5ef2d3cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:01.240273 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b86bd0-c089-4a18-8fed-23c5ef2d3cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:01.240555 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b86bd0-c089-4a18-8fed-23c5ef2d3cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:01.245577 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b86bd0-c089-4a18-8fed-23c5ef2d3cc9 admin admin] PATH_INFO: `/v3/projects/cc911b4eb14f4724848e4cb46e71165a/users/ec0fd008f70040bf859883cc019d0f7f/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:01.257227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b86bd0-c089-4a18-8fed-23c5ef2d3cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc911b4eb14f4724848e4cb46e71165a, user_id=ec0fd008f70040bf859883cc019d0f7f, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:01.260105 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b86bd0-c089-4a18-8fed-23c5ef2d3cc9 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:01.335904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1368/2732] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:08:01 2022] PUT /identity/v3/projects/cc911b4eb14f4724848e4cb46e71165a/users/ec0fd008f70040bf859883cc019d0f7f/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:08:01.346757 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec365eb5-df9d-4b30-869b-2ffee6e3671d None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:01.347047 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec365eb5-df9d-4b30-869b-2ffee6e3671d None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:01.347348 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec365eb5-df9d-4b30-869b-2ffee6e3671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:01.375663 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-ec365eb5-df9d-4b30-869b-2ffee6e3671d None None] MFA Rules not processed for user `ec0fd008f70040bf859883cc019d0f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:08:01.376868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ec365eb5-df9d-4b30-869b-2ffee6e3671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:01.445879 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1365/2733] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:08:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:08:01.450448 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b86bd0-c089-4a18-8fed-23c5ef2d3cc9 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:01.512328 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b86bd0-c089-4a18-8fed-23c5ef2d3cc9 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:01.517062 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da014b94-e5d8-479c-81f1-6f66a3485b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:01.517709 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da014b94-e5d8-479c-81f1-6f66a3485b14 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:01.517988 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da014b94-e5d8-479c-81f1-6f66a3485b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:01.518264 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da014b94-e5d8-479c-81f1-6f66a3485b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:01.518949 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da014b94-e5d8-479c-81f1-6f66a3485b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:01.520912 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da014b94-e5d8-479c-81f1-6f66a3485b14 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:01.634284 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1369/2734] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:08:01 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:08:01.638249 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec365eb5-df9d-4b30-869b-2ffee6e3671d None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:01.649069 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec365eb5-df9d-4b30-869b-2ffee6e3671d None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:01.703765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e8eed-0c18-4e5d-b653-6e29a9ee0daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:01.704363 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e8eed-0c18-4e5d-b653-6e29a9ee0daf admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:01.704644 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e8eed-0c18-4e5d-b653-6e29a9ee0daf admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:01.704920 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e8eed-0c18-4e5d-b653-6e29a9ee0daf admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:01.705616 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e8eed-0c18-4e5d-b653-6e29a9ee0daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:01.707546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e8eed-0c18-4e5d-b653-6e29a9ee0daf admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:01.805638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1366/2735] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:08:01 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:08:01.809838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da014b94-e5d8-479c-81f1-6f66a3485b14 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:01.820799 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da014b94-e5d8-479c-81f1-6f66a3485b14 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:01.826425 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44c8ca-eb73-42cd-bd4b-baff68dbd1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:01.827096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44c8ca-eb73-42cd-bd4b-baff68dbd1dd admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:01.827380 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44c8ca-eb73-42cd-bd4b-baff68dbd1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:01.827708 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44c8ca-eb73-42cd-bd4b-baff68dbd1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:01.828435 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44c8ca-eb73-42cd-bd4b-baff68dbd1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:01.830086 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44c8ca-eb73-42cd-bd4b-baff68dbd1dd admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:01.842116 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1370/2736] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:08:01.846182 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e8eed-0c18-4e5d-b653-6e29a9ee0daf admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:01.856722 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e8eed-0c18-4e5d-b653-6e29a9ee0daf admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:01.861471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4569a-ce86-4905-8da6-734c73aca426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:01.862448 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4569a-ce86-4905-8da6-734c73aca426 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:01.862724 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4569a-ce86-4905-8da6-734c73aca426 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:01.862996 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4569a-ce86-4905-8da6-734c73aca426 admin admin] PATH_INFO: `/v3/projects/66c18a652fa3467983cd31d1adf158fc/users/7af5febaf46b434a950a5fd22815e558/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:01.878290 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4569a-ce86-4905-8da6-734c73aca426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c18a652fa3467983cd31d1adf158fc, user_id=7af5febaf46b434a950a5fd22815e558, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:01.881419 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4569a-ce86-4905-8da6-734c73aca426 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:01.958545 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1367/2737] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:08:01 2022] PUT /identity/v3/projects/66c18a652fa3467983cd31d1adf158fc/users/7af5febaf46b434a950a5fd22815e558/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:08:01.962483 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44c8ca-eb73-42cd-bd4b-baff68dbd1dd admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:01.973329 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44c8ca-eb73-42cd-bd4b-baff68dbd1dd admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:02.029391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63b191-0732-4239-9642-89d8da30b8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:02.030112 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63b191-0732-4239-9642-89d8da30b8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:02.030396 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63b191-0732-4239-9642-89d8da30b8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:02.030673 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63b191-0732-4239-9642-89d8da30b8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:02.031428 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63b191-0732-4239-9642-89d8da30b8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:02.033062 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63b191-0732-4239-9642-89d8da30b8e0 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:02.043058 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1371/2738] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:08:02.047713 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4569a-ce86-4905-8da6-734c73aca426 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:02.057717 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4569a-ce86-4905-8da6-734c73aca426 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:02.066296 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc7628-623e-4bac-ac52-e3b6092bf6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:02.067198 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc7628-623e-4bac-ac52-e3b6092bf6c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:02.067484 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc7628-623e-4bac-ac52-e3b6092bf6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:02.067794 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc7628-623e-4bac-ac52-e3b6092bf6c7 admin admin] PATH_INFO: `/v3/projects/66c18a652fa3467983cd31d1adf158fc/users/7af5febaf46b434a950a5fd22815e558/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:02.069797 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc7628-623e-4bac-ac52-e3b6092bf6c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c18a652fa3467983cd31d1adf158fc, user_id=7af5febaf46b434a950a5fd22815e558, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:02.072596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc7628-623e-4bac-ac52-e3b6092bf6c7 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:02.084757 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1368/2739] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:08:02 2022] PUT /identity/v3/projects/66c18a652fa3467983cd31d1adf158fc/users/7af5febaf46b434a950a5fd22815e558/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:08:02.100645 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529890c-ce18-4f24-84b6-440947609300 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:02.101163 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529890c-ce18-4f24-84b6-440947609300 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:02.101654 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529890c-ce18-4f24-84b6-440947609300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:02.134277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-2529890c-ce18-4f24-84b6-440947609300 None None] MFA Rules not processed for user `7af5febaf46b434a950a5fd22815e558`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:08:02.135487 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-2529890c-ce18-4f24-84b6-440947609300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:02.204637 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1372/2740] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:08:02.215417 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc7628-623e-4bac-ac52-e3b6092bf6c7 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:02.218057 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-7bfc7628-623e-4bac-ac52-e3b6092bf6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:02.256582 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5991f98-2a51-4032-802e-5a1a6b7ed0e2 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:02.256962 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5991f98-2a51-4032-802e-5a1a6b7ed0e2 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:02.257319 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5991f98-2a51-4032-802e-5a1a6b7ed0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:02.279503 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-a5991f98-2a51-4032-802e-5a1a6b7ed0e2 None None] MFA Rules not processed for user `34d5824ea4a54b65a3eaa6deeb9dc416`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:08:02.280904 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a5991f98-2a51-4032-802e-5a1a6b7ed0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:02.295279 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc7628-623e-4bac-ac52-e3b6092bf6c7 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:02.299814 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549ed38-37ad-4fb4-b508-657c359208d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:02.300484 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549ed38-37ad-4fb4-b508-657c359208d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:02.300765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549ed38-37ad-4fb4-b508-657c359208d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:02.301045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549ed38-37ad-4fb4-b508-657c359208d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:02.348394 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1373/2741] 10.222.0.52 () {58 vars in 967 bytes} [Tue Mar 8 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:08:02.360854 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5991f98-2a51-4032-802e-5a1a6b7ed0e2 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:02.362251 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a5991f98-2a51-4032-802e-5a1a6b7ed0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:02.373919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549ed38-37ad-4fb4-b508-657c359208d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:02.376006 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549ed38-37ad-4fb4-b508-657c359208d3 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:02.387447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1369/2742] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:08:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:08:02.434072 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5991f98-2a51-4032-802e-5a1a6b7ed0e2 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:02.439780 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2d5c7-af26-43ca-b951-344a2fe4e0fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '869feb4577be48a683997eab827b1062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:02.440431 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2d5c7-af26-43ca-b951-344a2fe4e0fe service swift] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:02.440716 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2d5c7-af26-43ca-b951-344a2fe4e0fe service swift] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:02.440993 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2d5c7-af26-43ca-b951-344a2fe4e0fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:02.448965 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2d5c7-af26-43ca-b951-344a2fe4e0fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:02.451391 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2d5c7-af26-43ca-b951-344a2fe4e0fe service swift] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:02.459489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1374/2743] 10.222.0.52 () {60 vars in 1384 bytes} [Tue Mar 8 12:08:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 08 12:08:05.373869 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549ed38-37ad-4fb4-b508-657c359208d3 service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:05.432836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549ed38-37ad-4fb4-b508-657c359208d3 service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:05.438172 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a34ba-2ff5-4971-9f1f-218281e4cac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:05.439034 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a34ba-2ff5-4971-9f1f-218281e4cac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:05.439310 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a34ba-2ff5-4971-9f1f-218281e4cac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:05.439609 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a34ba-2ff5-4971-9f1f-218281e4cac8 admin admin] PATH_INFO: `/v3/users/ec0fd008f70040bf859883cc019d0f7f` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:05.440783 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a34ba-2ff5-4971-9f1f-218281e4cac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec0fd008f70040bf859883cc019d0f7f)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:05.442688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a34ba-2ff5-4971-9f1f-218281e4cac8 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:05.648942 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b80a34ba-2ff5-4971-9f1f-218281e4cac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0fd008f70040bf859883cc019d0f7f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:05.649599 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b80a34ba-2ff5-4971-9f1f-218281e4cac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0fd008f70040bf859883cc019d0f7f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:05.733152 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b80a34ba-2ff5-4971-9f1f-218281e4cac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0fd008f70040bf859883cc019d0f7f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:05.744752 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b80a34ba-2ff5-4971-9f1f-218281e4cac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0fd008f70040bf859883cc019d0f7f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:05.752102 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b80a34ba-2ff5-4971-9f1f-218281e4cac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0fd008f70040bf859883cc019d0f7f'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:05.758364 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1370/2744] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:08:05 2022] DELETE /identity/v3/users/ec0fd008f70040bf859883cc019d0f7f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:08:05.763078 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cf9df-2cb3-41f3-bb2a-8678081cf650 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:05.763676 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cf9df-2cb3-41f3-bb2a-8678081cf650 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:05.763676 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cf9df-2cb3-41f3-bb2a-8678081cf650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:05.780674 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-288cf9df-2cb3-41f3-bb2a-8678081cf650 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:08:05.781793 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-288cf9df-2cb3-41f3-bb2a-8678081cf650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:05.838925 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1375/2745] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:08:05.848804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a34ba-2ff5-4971-9f1f-218281e4cac8 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:05.850208 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b80a34ba-2ff5-4971-9f1f-218281e4cac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:05.906402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a34ba-2ff5-4971-9f1f-218281e4cac8 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:05.909943 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7a014-44e2-48d0-9a33-ffca0b66eb1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:05.910581 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7a014-44e2-48d0-9a33-ffca0b66eb1c service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:05.910862 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7a014-44e2-48d0-9a33-ffca0b66eb1c service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:05.911134 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7a014-44e2-48d0-9a33-ffca0b66eb1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:05.920741 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7a014-44e2-48d0-9a33-ffca0b66eb1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:05.922199 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7a014-44e2-48d0-9a33-ffca0b66eb1c service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:05.931569 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1371/2746] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:08:06.337467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cf9df-2cb3-41f3-bb2a-8678081cf650 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:06.338910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-288cf9df-2cb3-41f3-bb2a-8678081cf650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:06.351593 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cf9df-2cb3-41f3-bb2a-8678081cf650 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:06.357597 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13262a-b7b5-481b-b55d-5733c044d353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:06.360307 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13262a-b7b5-481b-b55d-5733c044d353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:06.360597 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13262a-b7b5-481b-b55d-5733c044d353 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:06.360882 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13262a-b7b5-481b-b55d-5733c044d353 admin admin] PATH_INFO: `/v3/projects/cc911b4eb14f4724848e4cb46e71165a` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:06.362181 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13262a-b7b5-481b-b55d-5733c044d353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc911b4eb14f4724848e4cb46e71165a)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:06.364276 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13262a-b7b5-481b-b55d-5733c044d353 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:06.478228 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0e13262a-b7b5-481b-b55d-5733c044d353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc911b4eb14f4724848e4cb46e71165a', 'request_id': 'req-0e13262a-b7b5-481b-b55d-5733c044d353'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:06.487247 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0e13262a-b7b5-481b-b55d-5733c044d353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc911b4eb14f4724848e4cb46e71165a', 'request_id': 'req-0e13262a-b7b5-481b-b55d-5733c044d353'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:06.558256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0e13262a-b7b5-481b-b55d-5733c044d353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc911b4eb14f4724848e4cb46e71165a', 'request_id': 'req-0e13262a-b7b5-481b-b55d-5733c044d353'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:06.569853 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0e13262a-b7b5-481b-b55d-5733c044d353 admin admin] The token cache is being invalidate because project cc911b4eb14f4724848e4cb46e71165a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:08:06.570153 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0e13262a-b7b5-481b-b55d-5733c044d353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:06.570775 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0e13262a-b7b5-481b-b55d-5733c044d353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:06.572379 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1376/2747] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:08:06 2022] DELETE /identity/v3/projects/cc911b4eb14f4724848e4cb46e71165a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:08:06.576495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7a014-44e2-48d0-9a33-ffca0b66eb1c service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:06.586145 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7a014-44e2-48d0-9a33-ffca0b66eb1c service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:06.641201 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520c458-fc13-47b3-ab63-5dbebb5d8fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:06.642071 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520c458-fc13-47b3-ab63-5dbebb5d8fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:06.642351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520c458-fc13-47b3-ab63-5dbebb5d8fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:06.642625 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520c458-fc13-47b3-ab63-5dbebb5d8fc1 admin admin] PATH_INFO: `/v3/users/7af5febaf46b434a950a5fd22815e558` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:06.643848 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520c458-fc13-47b3-ab63-5dbebb5d8fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af5febaf46b434a950a5fd22815e558)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:06.645778 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520c458-fc13-47b3-ab63-5dbebb5d8fc1 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:06.847596 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-4520c458-fc13-47b3-ab63-5dbebb5d8fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af5febaf46b434a950a5fd22815e558'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:06.848249 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-4520c458-fc13-47b3-ab63-5dbebb5d8fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af5febaf46b434a950a5fd22815e558'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:06.930047 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-4520c458-fc13-47b3-ab63-5dbebb5d8fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af5febaf46b434a950a5fd22815e558'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:06.943060 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-4520c458-fc13-47b3-ab63-5dbebb5d8fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af5febaf46b434a950a5fd22815e558'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:06.949709 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-4520c458-fc13-47b3-ab63-5dbebb5d8fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af5febaf46b434a950a5fd22815e558'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:06.956287 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1372/2748] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:08:06 2022] DELETE /identity/v3/users/7af5febaf46b434a950a5fd22815e558 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:08:07.391953 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13262a-b7b5-481b-b55d-5733c044d353 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:07.396354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-0e13262a-b7b5-481b-b55d-5733c044d353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:07.412119 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13262a-b7b5-481b-b55d-5733c044d353 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:07.473155 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:07.474014 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:07.474301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:07.474576 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b admin admin] PATH_INFO: `/v3/projects/66c18a652fa3467983cd31d1adf158fc` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:07.475804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c18a652fa3467983cd31d1adf158fc)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:07.477723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:07.577079 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c18a652fa3467983cd31d1adf158fc', 'request_id': 'req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:07.583213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c18a652fa3467983cd31d1adf158fc', 'request_id': 'req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:07.655862 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c18a652fa3467983cd31d1adf158fc', 'request_id': 'req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:07.667082 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b admin admin] The token cache is being invalidate because project 66c18a652fa3467983cd31d1adf158fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:08:07.667372 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:07.668068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:07.669783 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1377/2749] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:08:07 2022] DELETE /identity/v3/projects/66c18a652fa3467983cd31d1adf158fc => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:08:32.868699 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520c458-fc13-47b3-ab63-5dbebb5d8fc1 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:32.870109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-4520c458-fc13-47b3-ab63-5dbebb5d8fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:32.936945 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520c458-fc13-47b3-ab63-5dbebb5d8fc1 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:32.990464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed33e8-d4c2-4f89-8599-31f4cfb35f31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:32.991144 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed33e8-d4c2-4f89-8599-31f4cfb35f31 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:32.991492 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed33e8-d4c2-4f89-8599-31f4cfb35f31 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:32.991793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed33e8-d4c2-4f89-8599-31f4cfb35f31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:32.993584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-95ed33e8-d4c2-4f89-8599-31f4cfb35f31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:33.049492 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed33e8-d4c2-4f89-8599-31f4cfb35f31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:33.050915 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed33e8-d4c2-4f89-8599-31f4cfb35f31 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:33.059783 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1373/2750] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:08:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:08:41.426495 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:41.428312 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:41.508274 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352ba6d-ea2a-4d58-adeb-ae68ac59e99b admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:41.513528 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bed27c-06c5-49c3-bb50-365681b931fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8855284b10c64b8ca367e3c30b5f66fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:41.514185 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed27c-06c5-49c3-bb50-365681b931fa service placement] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:41.514472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed27c-06c5-49c3-bb50-365681b931fa service placement] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:41.514754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed27c-06c5-49c3-bb50-365681b931fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:41.516592 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d1bed27c-06c5-49c3-bb50-365681b931fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:41.534094 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bed27c-06c5-49c3-bb50-365681b931fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:41.536271 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bed27c-06c5-49c3-bb50-365681b931fa service placement] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:41.547299 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1378/2751] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:08:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:08:41.657351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78254e-2198-4cf9-b4dc-ab7aae6a7e46 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:41.657351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78254e-2198-4cf9-b4dc-ab7aae6a7e46 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:41.657351 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78254e-2198-4cf9-b4dc-ab7aae6a7e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:41.680295 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-be78254e-2198-4cf9-b4dc-ab7aae6a7e46 None None] MFA Rules not processed for user `a918aee2dc2d4024ad3d9d0f9646a1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:08:41.681519 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-be78254e-2198-4cf9-b4dc-ab7aae6a7e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:41.691744 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1374/2752] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:08:46.763508 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bed27c-06c5-49c3-bb50-365681b931fa service placement] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:46.765195 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-d1bed27c-06c5-49c3-bb50-365681b931fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:46.824395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bed27c-06c5-49c3-bb50-365681b931fa service placement] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:46.828122 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ccf34-1c8c-4ee6-938e-046d3a764bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:46.828797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ccf34-1c8c-4ee6-938e-046d3a764bdc service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:46.829078 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ccf34-1c8c-4ee6-938e-046d3a764bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:46.829486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ccf34-1c8c-4ee6-938e-046d3a764bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:46.831906 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-df3ccf34-1c8c-4ee6-938e-046d3a764bdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:46.898223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ccf34-1c8c-4ee6-938e-046d3a764bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:46.900739 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ccf34-1c8c-4ee6-938e-046d3a764bdc service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:46.917238 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1379/2753] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:08:51.572164 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78254e-2198-4cf9-b4dc-ab7aae6a7e46 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:51.573829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-be78254e-2198-4cf9-b4dc-ab7aae6a7e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:51.593228 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78254e-2198-4cf9-b4dc-ab7aae6a7e46 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:51.598171 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad00e0-36d7-4398-8742-1805cc820e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:51.599067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad00e0-36d7-4398-8742-1805cc820e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:51.599342 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad00e0-36d7-4398-8742-1805cc820e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:51.599649 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad00e0-36d7-4398-8742-1805cc820e04 admin admin] PATH_INFO: `/v3/users/420d44749c064fc883bc3aadd9d2e8cc` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:51.600853 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad00e0-36d7-4398-8742-1805cc820e04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=420d44749c064fc883bc3aadd9d2e8cc)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:51.602755 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad00e0-36d7-4398-8742-1805cc820e04 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:51.753047 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-95ad00e0-36d7-4398-8742-1805cc820e04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '420d44749c064fc883bc3aadd9d2e8cc'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:51.753815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-95ad00e0-36d7-4398-8742-1805cc820e04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '420d44749c064fc883bc3aadd9d2e8cc'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:51.832820 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-95ad00e0-36d7-4398-8742-1805cc820e04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '420d44749c064fc883bc3aadd9d2e8cc'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:51.844545 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-95ad00e0-36d7-4398-8742-1805cc820e04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '420d44749c064fc883bc3aadd9d2e8cc'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:51.851349 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-95ad00e0-36d7-4398-8742-1805cc820e04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '420d44749c064fc883bc3aadd9d2e8cc'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:51.857095 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1375/2754] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:08:51 2022] DELETE /identity/v3/users/420d44749c064fc883bc3aadd9d2e8cc => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:08:52.135577 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ccf34-1c8c-4ee6-938e-046d3a764bdc service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:52.146357 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ccf34-1c8c-4ee6-938e-046d3a764bdc service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:52.202304 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28439a8d-ae29-4461-af96-1f1b319cd95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:52.203205 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28439a8d-ae29-4461-af96-1f1b319cd95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:52.203542 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28439a8d-ae29-4461-af96-1f1b319cd95f admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:52.203789 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28439a8d-ae29-4461-af96-1f1b319cd95f admin admin] PATH_INFO: `/v3/projects/c6b865e007434b11a5830b1279954322` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:52.204980 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28439a8d-ae29-4461-af96-1f1b319cd95f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b865e007434b11a5830b1279954322)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:52.214256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28439a8d-ae29-4461-af96-1f1b319cd95f admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:52.317981 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-28439a8d-ae29-4461-af96-1f1b319cd95f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b865e007434b11a5830b1279954322', 'request_id': 'req-28439a8d-ae29-4461-af96-1f1b319cd95f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:52.323843 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-28439a8d-ae29-4461-af96-1f1b319cd95f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b865e007434b11a5830b1279954322', 'request_id': 'req-28439a8d-ae29-4461-af96-1f1b319cd95f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:52.467409 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-28439a8d-ae29-4461-af96-1f1b319cd95f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b865e007434b11a5830b1279954322', 'request_id': 'req-28439a8d-ae29-4461-af96-1f1b319cd95f'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:52.478076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-28439a8d-ae29-4461-af96-1f1b319cd95f admin admin] The token cache is being invalidate because project c6b865e007434b11a5830b1279954322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:08:52.478366 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-28439a8d-ae29-4461-af96-1f1b319cd95f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:52.479002 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-28439a8d-ae29-4461-af96-1f1b319cd95f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:08:52.480838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1380/2755] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:08:52 2022] DELETE /identity/v3/projects/c6b865e007434b11a5830b1279954322 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:08:52.485805 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582e681-c378-4235-be9a-8f7477011225 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:52.486104 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582e681-c378-4235-be9a-8f7477011225 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:52.486385 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582e681-c378-4235-be9a-8f7477011225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:52.504867 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-3582e681-c378-4235-be9a-8f7477011225 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:08:52.506073 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-3582e681-c378-4235-be9a-8f7477011225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:52.566897 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1376/2756] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:08:52.575136 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34254b85-c1d7-454b-a813-c0ddae5047db None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:52.575422 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34254b85-c1d7-454b-a813-c0ddae5047db None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:52.575736 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34254b85-c1d7-454b-a813-c0ddae5047db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:52.594920 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-34254b85-c1d7-454b-a813-c0ddae5047db None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:08:52.596464 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-34254b85-c1d7-454b-a813-c0ddae5047db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:52.604426 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1381/2757] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:08:52.608543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582e681-c378-4235-be9a-8f7477011225 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:52.618197 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582e681-c378-4235-be9a-8f7477011225 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:52.622682 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17291a59-12eb-48f4-b703-2f5d15fec466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:52.623326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17291a59-12eb-48f4-b703-2f5d15fec466 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:52.623641 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17291a59-12eb-48f4-b703-2f5d15fec466 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:52.623915 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17291a59-12eb-48f4-b703-2f5d15fec466 admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:52.624623 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17291a59-12eb-48f4-b703-2f5d15fec466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:08:52.624926 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17291a59-12eb-48f4-b703-2f5d15fec466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:52.626496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17291a59-12eb-48f4-b703-2f5d15fec466 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:52.638374 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1377/2758] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:08:52.642543 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34254b85-c1d7-454b-a813-c0ddae5047db None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:52.652296 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34254b85-c1d7-454b-a813-c0ddae5047db None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:52.656886 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309060b-8665-42c8-b00a-a41ac5d8da48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:52.657530 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309060b-8665-42c8-b00a-a41ac5d8da48 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:52.657810 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309060b-8665-42c8-b00a-a41ac5d8da48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:52.658083 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309060b-8665-42c8-b00a-a41ac5d8da48 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:52.658815 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309060b-8665-42c8-b00a-a41ac5d8da48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:52.660743 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309060b-8665-42c8-b00a-a41ac5d8da48 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:52.769551 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1382/2759] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:08:52 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:08:52.773902 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17291a59-12eb-48f4-b703-2f5d15fec466 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:52.784120 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17291a59-12eb-48f4-b703-2f5d15fec466 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:52.838834 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5207b-91c6-40e8-aec0-f9b9b8705359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:52.839499 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5207b-91c6-40e8-aec0-f9b9b8705359 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:52.839812 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5207b-91c6-40e8-aec0-f9b9b8705359 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:52.840089 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5207b-91c6-40e8-aec0-f9b9b8705359 admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:52.840768 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5207b-91c6-40e8-aec0-f9b9b8705359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:52.842666 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5207b-91c6-40e8-aec0-f9b9b8705359 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:52.955980 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1378/2760] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:08:52 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:08:52.960016 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309060b-8665-42c8-b00a-a41ac5d8da48 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:52.970441 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309060b-8665-42c8-b00a-a41ac5d8da48 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:52.975210 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bbf7b-d60e-4d12-9981-07fd0a05cdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:52.979683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bbf7b-d60e-4d12-9981-07fd0a05cdff admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:52.979683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bbf7b-d60e-4d12-9981-07fd0a05cdff admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:52.979683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bbf7b-d60e-4d12-9981-07fd0a05cdff admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:52.979683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bbf7b-d60e-4d12-9981-07fd0a05cdff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:52.979683 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bbf7b-d60e-4d12-9981-07fd0a05cdff admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:52.990132 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1383/2761] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:08:52.994245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5207b-91c6-40e8-aec0-f9b9b8705359 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:53.005218 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5207b-91c6-40e8-aec0-f9b9b8705359 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:53.009870 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5d417-9336-4305-9555-9ddf05d0d876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:53.010529 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d417-9336-4305-9555-9ddf05d0d876 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:53.010817 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d417-9336-4305-9555-9ddf05d0d876 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:53.011117 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d417-9336-4305-9555-9ddf05d0d876 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:53.011872 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5d417-9336-4305-9555-9ddf05d0d876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:53.013495 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5d417-9336-4305-9555-9ddf05d0d876 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:53.023355 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1379/2762] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:08:53.027337 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bbf7b-d60e-4d12-9981-07fd0a05cdff admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:53.038349 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bbf7b-d60e-4d12-9981-07fd0a05cdff admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:53.043168 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c72c9-7b78-47eb-87c8-8f7fce0ccac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:53.044297 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c72c9-7b78-47eb-87c8-8f7fce0ccac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:53.044592 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c72c9-7b78-47eb-87c8-8f7fce0ccac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:53.044955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c72c9-7b78-47eb-87c8-8f7fce0ccac0 admin admin] PATH_INFO: `/v3/projects/5d84ff0250204447866262af592477c6/users/794ba27ea12942e6b224b3b1fe345b57/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:53.061593 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c72c9-7b78-47eb-87c8-8f7fce0ccac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d84ff0250204447866262af592477c6, user_id=794ba27ea12942e6b224b3b1fe345b57, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:53.064356 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c72c9-7b78-47eb-87c8-8f7fce0ccac0 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:53.176728 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1384/2763] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:08:53 2022] PUT /identity/v3/projects/5d84ff0250204447866262af592477c6/users/794ba27ea12942e6b224b3b1fe345b57/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:08:53.181747 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93c01d-ced2-48b5-ac09-f5b16d3b2c3a None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:53.182038 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93c01d-ced2-48b5-ac09-f5b16d3b2c3a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:53.182318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93c01d-ced2-48b5-ac09-f5b16d3b2c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:53.200413 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-1f93c01d-ced2-48b5-ac09-f5b16d3b2c3a None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:08:53.201611 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1f93c01d-ced2-48b5-ac09-f5b16d3b2c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:53.260268 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1380/2764] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:08:53.269814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c72c9-7b78-47eb-87c8-8f7fce0ccac0 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:53.271486 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-df6c72c9-7b78-47eb-87c8-8f7fce0ccac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:53.326937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c72c9-7b78-47eb-87c8-8f7fce0ccac0 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:53.330541 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76063de5-cfed-4e6e-9943-8b869365e628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:53.331178 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76063de5-cfed-4e6e-9943-8b869365e628 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:53.331458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76063de5-cfed-4e6e-9943-8b869365e628 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:53.331765 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76063de5-cfed-4e6e-9943-8b869365e628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:53.340620 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76063de5-cfed-4e6e-9943-8b869365e628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:53.341979 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76063de5-cfed-4e6e-9943-8b869365e628 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:53.352072 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1385/2765] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:08:58.815137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07046c4b-f205-4525-9413-b5781529fef7 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:58.815691 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07046c4b-f205-4525-9413-b5781529fef7 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:58.816281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07046c4b-f205-4525-9413-b5781529fef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:58.842719 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-07046c4b-f205-4525-9413-b5781529fef7 None None] MFA Rules not processed for user `794ba27ea12942e6b224b3b1fe345b57`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:08:58.844050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-07046c4b-f205-4525-9413-b5781529fef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:58.913998 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1381/2766] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:08:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:08:58.926308 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76063de5-cfed-4e6e-9943-8b869365e628 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:08:58.928061 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-76063de5-cfed-4e6e-9943-8b869365e628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:08:59.009198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76063de5-cfed-4e6e-9943-8b869365e628 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:08:59.015280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c586e6-a94c-4d82-85dd-ab7e7d1fb559 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:08:59.015971 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c586e6-a94c-4d82-85dd-ab7e7d1fb559 service nova] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:08:59.016327 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c586e6-a94c-4d82-85dd-ab7e7d1fb559 service nova] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:08:59.016517 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c586e6-a94c-4d82-85dd-ab7e7d1fb559 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:08:59.025432 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c586e6-a94c-4d82-85dd-ab7e7d1fb559 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:08:59.027437 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c586e6-a94c-4d82-85dd-ab7e7d1fb559 service nova] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:08:59.044090 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1386/2767] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:08:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:09:01.856329 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa1f64-ad34-4728-91f5-2b281bb8074f None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:09:01.856329 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa1f64-ad34-4728-91f5-2b281bb8074f None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:09:01.856329 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa1f64-ad34-4728-91f5-2b281bb8074f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:09:01.893866 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-01aa1f64-ad34-4728-91f5-2b281bb8074f None None] MFA Rules not processed for user `794ba27ea12942e6b224b3b1fe345b57`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:09:01.895145 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-01aa1f64-ad34-4728-91f5-2b281bb8074f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:09:01.908556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1382/2768] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:09:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:09:23.531256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c586e6-a94c-4d82-85dd-ab7e7d1fb559 service nova] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:09:23.541547 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c586e6-a94c-4d82-85dd-ab7e7d1fb559 service nova] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:09:23.545216 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97debba5-32fa-4fa3-b9ac-28a89c199226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:09:23.545884 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97debba5-32fa-4fa3-b9ac-28a89c199226 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:09:23.546204 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97debba5-32fa-4fa3-b9ac-28a89c199226 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:09:23.546567 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97debba5-32fa-4fa3-b9ac-28a89c199226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:09:23.548624 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-97debba5-32fa-4fa3-b9ac-28a89c199226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:09:23.561668 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97debba5-32fa-4fa3-b9ac-28a89c199226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:09:23.563137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97debba5-32fa-4fa3-b9ac-28a89c199226 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:09:23.573067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1387/2769] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:09:31.142173 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa1f64-ad34-4728-91f5-2b281bb8074f None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:09:31.143667 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-01aa1f64-ad34-4728-91f5-2b281bb8074f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:09:31.158855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa1f64-ad34-4728-91f5-2b281bb8074f None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:09:31.164570 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7934bb2-f3d8-4acc-bfce-2fe4321d0bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:09:31.165507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7934bb2-f3d8-4acc-bfce-2fe4321d0bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:09:31.165788 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7934bb2-f3d8-4acc-bfce-2fe4321d0bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:09:31.166091 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7934bb2-f3d8-4acc-bfce-2fe4321d0bd1 admin admin] PATH_INFO: `/v3/users/e6deb8ac1c8344a6b3d737e51dbb4c2d` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:09:31.167296 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7934bb2-f3d8-4acc-bfce-2fe4321d0bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6deb8ac1c8344a6b3d737e51dbb4c2d)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:09:31.169270 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7934bb2-f3d8-4acc-bfce-2fe4321d0bd1 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:09:31.342457 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d7934bb2-f3d8-4acc-bfce-2fe4321d0bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6deb8ac1c8344a6b3d737e51dbb4c2d'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:31.343067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d7934bb2-f3d8-4acc-bfce-2fe4321d0bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6deb8ac1c8344a6b3d737e51dbb4c2d'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:31.419070 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d7934bb2-f3d8-4acc-bfce-2fe4321d0bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6deb8ac1c8344a6b3d737e51dbb4c2d'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:31.437057 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d7934bb2-f3d8-4acc-bfce-2fe4321d0bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6deb8ac1c8344a6b3d737e51dbb4c2d'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:31.443761 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d7934bb2-f3d8-4acc-bfce-2fe4321d0bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6deb8ac1c8344a6b3d737e51dbb4c2d'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:31.449842 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1383/2770] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:09:31 2022] DELETE /identity/v3/users/e6deb8ac1c8344a6b3d737e51dbb4c2d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:09:31.678612 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97debba5-32fa-4fa3-b9ac-28a89c199226 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:09:31.689039 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97debba5-32fa-4fa3-b9ac-28a89c199226 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:09:31.753944 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a8e74-a040-4452-906a-6eaab1f30c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:09:31.755059 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a8e74-a040-4452-906a-6eaab1f30c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:09:31.755336 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a8e74-a040-4452-906a-6eaab1f30c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:09:31.755643 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a8e74-a040-4452-906a-6eaab1f30c0e admin admin] PATH_INFO: `/v3/projects/cfc28aa7473b41d7b1e2482c5f0695eb` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:09:31.757255 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a8e74-a040-4452-906a-6eaab1f30c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc28aa7473b41d7b1e2482c5f0695eb)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:09:31.759358 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a8e74-a040-4452-906a-6eaab1f30c0e admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:09:31.900667 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cf7a8e74-a040-4452-906a-6eaab1f30c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc28aa7473b41d7b1e2482c5f0695eb', 'request_id': 'req-cf7a8e74-a040-4452-906a-6eaab1f30c0e'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:31.907204 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cf7a8e74-a040-4452-906a-6eaab1f30c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc28aa7473b41d7b1e2482c5f0695eb', 'request_id': 'req-cf7a8e74-a040-4452-906a-6eaab1f30c0e'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:31.995975 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cf7a8e74-a040-4452-906a-6eaab1f30c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc28aa7473b41d7b1e2482c5f0695eb', 'request_id': 'req-cf7a8e74-a040-4452-906a-6eaab1f30c0e'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:32.008206 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cf7a8e74-a040-4452-906a-6eaab1f30c0e admin admin] The token cache is being invalidate because project cfc28aa7473b41d7b1e2482c5f0695eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:09:32.008494 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cf7a8e74-a040-4452-906a-6eaab1f30c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:32.009166 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-cf7a8e74-a040-4452-906a-6eaab1f30c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:32.010691 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1388/2771] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:09:31 2022] DELETE /identity/v3/projects/cfc28aa7473b41d7b1e2482c5f0695eb => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:09:32.014695 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7934bb2-f3d8-4acc-bfce-2fe4321d0bd1 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:09:32.016145 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d7934bb2-f3d8-4acc-bfce-2fe4321d0bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:09:32.031383 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7934bb2-f3d8-4acc-bfce-2fe4321d0bd1 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:09:32.090044 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041280a-69a1-4d85-8dae-b2dd102d613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:09:32.090915 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041280a-69a1-4d85-8dae-b2dd102d613d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:09:32.091198 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041280a-69a1-4d85-8dae-b2dd102d613d admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:09:32.091466 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041280a-69a1-4d85-8dae-b2dd102d613d admin admin] PATH_INFO: `/v3/users/57e0914759314ed68e36afd3ec1cd649` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:09:32.092747 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041280a-69a1-4d85-8dae-b2dd102d613d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e0914759314ed68e36afd3ec1cd649)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:09:32.094650 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041280a-69a1-4d85-8dae-b2dd102d613d admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:09:32.262424 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f041280a-69a1-4d85-8dae-b2dd102d613d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e0914759314ed68e36afd3ec1cd649'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:32.263138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f041280a-69a1-4d85-8dae-b2dd102d613d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e0914759314ed68e36afd3ec1cd649'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:32.327820 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f041280a-69a1-4d85-8dae-b2dd102d613d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e0914759314ed68e36afd3ec1cd649'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:32.340612 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f041280a-69a1-4d85-8dae-b2dd102d613d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e0914759314ed68e36afd3ec1cd649'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:32.347240 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-f041280a-69a1-4d85-8dae-b2dd102d613d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e0914759314ed68e36afd3ec1cd649'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:32.354032 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1384/2772] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:09:32 2022] DELETE /identity/v3/users/57e0914759314ed68e36afd3ec1cd649 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:09:32.578493 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a8e74-a040-4452-906a-6eaab1f30c0e admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:09:32.580039 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-cf7a8e74-a040-4452-906a-6eaab1f30c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:09:32.593821 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a8e74-a040-4452-906a-6eaab1f30c0e admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:09:32.656238 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531859b9-b511-43c9-a0dd-fb1c5b7eae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:09:32.659648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531859b9-b511-43c9-a0dd-fb1c5b7eae36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:09:32.659648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531859b9-b511-43c9-a0dd-fb1c5b7eae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:09:32.659648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531859b9-b511-43c9-a0dd-fb1c5b7eae36 admin admin] PATH_INFO: `/v3/projects/3dc0e3bffb9d49e788fc11efd21eee1c` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:09:32.659648 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531859b9-b511-43c9-a0dd-fb1c5b7eae36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc0e3bffb9d49e788fc11efd21eee1c)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:09:32.662120 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531859b9-b511-43c9-a0dd-fb1c5b7eae36 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:09:32.776882 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-531859b9-b511-43c9-a0dd-fb1c5b7eae36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc0e3bffb9d49e788fc11efd21eee1c', 'request_id': 'req-531859b9-b511-43c9-a0dd-fb1c5b7eae36'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:32.782839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-531859b9-b511-43c9-a0dd-fb1c5b7eae36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc0e3bffb9d49e788fc11efd21eee1c', 'request_id': 'req-531859b9-b511-43c9-a0dd-fb1c5b7eae36'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:32.907363 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-531859b9-b511-43c9-a0dd-fb1c5b7eae36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc0e3bffb9d49e788fc11efd21eee1c', 'request_id': 'req-531859b9-b511-43c9-a0dd-fb1c5b7eae36'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:32.918782 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-531859b9-b511-43c9-a0dd-fb1c5b7eae36 admin admin] The token cache is being invalidate because project 3dc0e3bffb9d49e788fc11efd21eee1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:09:32.919074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-531859b9-b511-43c9-a0dd-fb1c5b7eae36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:32.919745 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-531859b9-b511-43c9-a0dd-fb1c5b7eae36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:09:32.921332 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1389/2773] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:09:32 2022] DELETE /identity/v3/projects/3dc0e3bffb9d49e788fc11efd21eee1c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:10:11.289765 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041280a-69a1-4d85-8dae-b2dd102d613d admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:10:11.291239 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f041280a-69a1-4d85-8dae-b2dd102d613d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:10:11.348923 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041280a-69a1-4d85-8dae-b2dd102d613d admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:10:11.395958 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb3d78-faa6-4882-92d9-085600c9e0ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:10:11.398804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb3d78-faa6-4882-92d9-085600c9e0ba service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:10:11.398804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb3d78-faa6-4882-92d9-085600c9e0ba service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:10:11.398804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb3d78-faa6-4882-92d9-085600c9e0ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:10:11.399116 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-6ccb3d78-faa6-4882-92d9-085600c9e0ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:10:11.466109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb3d78-faa6-4882-92d9-085600c9e0ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:10:11.467453 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb3d78-faa6-4882-92d9-085600c9e0ba service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:10:11.478025 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1385/2774] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:10:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:10:12.648475 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531859b9-b511-43c9-a0dd-fb1c5b7eae36 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:10:12.649864 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-531859b9-b511-43c9-a0dd-fb1c5b7eae36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:10:12.663057 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531859b9-b511-43c9-a0dd-fb1c5b7eae36 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:10:12.666640 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1273-f4bb-4548-986e-09ff825f7113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:10:12.667410 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1273-f4bb-4548-986e-09ff825f7113 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:10:12.667739 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1273-f4bb-4548-986e-09ff825f7113 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:10:12.668018 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1273-f4bb-4548-986e-09ff825f7113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:10:12.670586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-133d1273-f4bb-4548-986e-09ff825f7113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:10:12.684111 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d1273-f4bb-4548-986e-09ff825f7113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:10:12.685713 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d1273-f4bb-4548-986e-09ff825f7113 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:10:12.696601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1390/2775] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:10:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:10:43.591599 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb3d78-faa6-4882-92d9-085600c9e0ba service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:10:43.593627 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-6ccb3d78-faa6-4882-92d9-085600c9e0ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:10:43.607989 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb3d78-faa6-4882-92d9-085600c9e0ba service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:10:43.613985 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d60ca9-e4df-4e23-a566-7dd043c15c34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:10:43.614737 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d60ca9-e4df-4e23-a566-7dd043c15c34 service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:10:43.614938 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d60ca9-e4df-4e23-a566-7dd043c15c34 service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:10:43.615245 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d60ca9-e4df-4e23-a566-7dd043c15c34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:10:43.617225 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-63d60ca9-e4df-4e23-a566-7dd043c15c34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:10:43.631303 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d60ca9-e4df-4e23-a566-7dd043c15c34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:10:43.632925 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d60ca9-e4df-4e23-a566-7dd043c15c34 service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:10:43.644243 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1386/2776] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:10:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:10:43.730143 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1273-f4bb-4548-986e-09ff825f7113 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:10:43.731765 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-133d1273-f4bb-4548-986e-09ff825f7113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:10:43.742959 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1273-f4bb-4548-986e-09ff825f7113 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:10:43.747224 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bb204-367a-4e3d-bc6c-110fd4344c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:10:43.747908 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb204-367a-4e3d-bc6c-110fd4344c03 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:10:43.748195 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb204-367a-4e3d-bc6c-110fd4344c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:10:43.748474 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb204-367a-4e3d-bc6c-110fd4344c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:10:43.750252 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-560bb204-367a-4e3d-bc6c-110fd4344c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:10:43.761863 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bb204-367a-4e3d-bc6c-110fd4344c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:10:43.763345 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bb204-367a-4e3d-bc6c-110fd4344c03 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:10:43.772773 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1391/2777] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:10:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:10:59.409811 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d60ca9-e4df-4e23-a566-7dd043c15c34 service nova] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:10:59.419950 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d60ca9-e4df-4e23-a566-7dd043c15c34 service nova] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:10:59.423548 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0646-2302-456f-9fa5-90de0efbd3e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:10:59.424194 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0646-2302-456f-9fa5-90de0efbd3e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:10:59.424472 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0646-2302-456f-9fa5-90de0efbd3e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:10:59.424743 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0646-2302-456f-9fa5-90de0efbd3e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:10:59.426476 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-3d7e0646-2302-456f-9fa5-90de0efbd3e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:10:59.487290 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e0646-2302-456f-9fa5-90de0efbd3e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:10:59.488957 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e0646-2302-456f-9fa5-90de0efbd3e2 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:10:59.499721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1387/2778] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:11:07.461369 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bb204-367a-4e3d-bc6c-110fd4344c03 service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:11:07.465952 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-560bb204-367a-4e3d-bc6c-110fd4344c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:11:07.479097 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bb204-367a-4e3d-bc6c-110fd4344c03 service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:11:07.484236 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08280782-3b54-4fb5-9d59-f757f3dfb68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:11:07.488840 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08280782-3b54-4fb5-9d59-f757f3dfb68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:11:07.488840 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08280782-3b54-4fb5-9d59-f757f3dfb68d admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:11:07.488840 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08280782-3b54-4fb5-9d59-f757f3dfb68d admin admin] PATH_INFO: `/v3/users/a918aee2dc2d4024ad3d9d0f9646a1fc` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:11:07.488840 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08280782-3b54-4fb5-9d59-f757f3dfb68d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a918aee2dc2d4024ad3d9d0f9646a1fc)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:11:07.489301 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08280782-3b54-4fb5-9d59-f757f3dfb68d admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:11:07.635438 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-08280782-3b54-4fb5-9d59-f757f3dfb68d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a918aee2dc2d4024ad3d9d0f9646a1fc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:07.636852 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-08280782-3b54-4fb5-9d59-f757f3dfb68d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a918aee2dc2d4024ad3d9d0f9646a1fc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:07.647172 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-08280782-3b54-4fb5-9d59-f757f3dfb68d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a918aee2dc2d4024ad3d9d0f9646a1fc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:07.738133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-08280782-3b54-4fb5-9d59-f757f3dfb68d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a918aee2dc2d4024ad3d9d0f9646a1fc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:07.751169 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-08280782-3b54-4fb5-9d59-f757f3dfb68d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a918aee2dc2d4024ad3d9d0f9646a1fc'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:07.759261 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1392/2779] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:11:07 2022] DELETE /identity/v3/users/a918aee2dc2d4024ad3d9d0f9646a1fc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:11:08.012345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0646-2302-456f-9fa5-90de0efbd3e2 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:11:08.022121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0646-2302-456f-9fa5-90de0efbd3e2 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:11:08.087060 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8110953-1d74-420f-9a83-c4283c9bb104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:11:08.087953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8110953-1d74-420f-9a83-c4283c9bb104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:11:08.088233 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8110953-1d74-420f-9a83-c4283c9bb104 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:11:08.088506 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8110953-1d74-420f-9a83-c4283c9bb104 admin admin] PATH_INFO: `/v3/projects/5699872c8cb440dd860801aa699d0699` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:11:08.089923 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8110953-1d74-420f-9a83-c4283c9bb104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5699872c8cb440dd860801aa699d0699)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:11:08.091911 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8110953-1d74-420f-9a83-c4283c9bb104 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:11:08.218373 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b8110953-1d74-420f-9a83-c4283c9bb104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5699872c8cb440dd860801aa699d0699', 'request_id': 'req-b8110953-1d74-420f-9a83-c4283c9bb104'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:08.294500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b8110953-1d74-420f-9a83-c4283c9bb104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5699872c8cb440dd860801aa699d0699', 'request_id': 'req-b8110953-1d74-420f-9a83-c4283c9bb104'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:08.301375 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b8110953-1d74-420f-9a83-c4283c9bb104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5699872c8cb440dd860801aa699d0699', 'request_id': 'req-b8110953-1d74-420f-9a83-c4283c9bb104'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:08.312506 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b8110953-1d74-420f-9a83-c4283c9bb104 admin admin] The token cache is being invalidate because project 5699872c8cb440dd860801aa699d0699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:11:08.312795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b8110953-1d74-420f-9a83-c4283c9bb104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:08.313450 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b8110953-1d74-420f-9a83-c4283c9bb104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:08.314970 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1388/2780] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:11:08 2022] DELETE /identity/v3/projects/5699872c8cb440dd860801aa699d0699 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:11:08.319452 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08280782-3b54-4fb5-9d59-f757f3dfb68d admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:11:08.321015 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-08280782-3b54-4fb5-9d59-f757f3dfb68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:11:08.334406 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08280782-3b54-4fb5-9d59-f757f3dfb68d admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:11:08.393832 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598cfe7-5a3e-4f60-9c9c-faef4633c710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:11:08.394993 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598cfe7-5a3e-4f60-9c9c-faef4633c710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:11:08.395423 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598cfe7-5a3e-4f60-9c9c-faef4633c710 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:11:08.395867 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598cfe7-5a3e-4f60-9c9c-faef4633c710 admin admin] PATH_INFO: `/v3/users/5c57c3b0b4c7457bb818f9f5c19aed66` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:11:08.397595 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598cfe7-5a3e-4f60-9c9c-faef4633c710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c57c3b0b4c7457bb818f9f5c19aed66)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:11:08.399574 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598cfe7-5a3e-4f60-9c9c-faef4633c710 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:11:08.565215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3598cfe7-5a3e-4f60-9c9c-faef4633c710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c57c3b0b4c7457bb818f9f5c19aed66'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:08.566056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3598cfe7-5a3e-4f60-9c9c-faef4633c710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c57c3b0b4c7457bb818f9f5c19aed66'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:08.573029 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3598cfe7-5a3e-4f60-9c9c-faef4633c710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c57c3b0b4c7457bb818f9f5c19aed66'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:08.669845 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3598cfe7-5a3e-4f60-9c9c-faef4633c710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c57c3b0b4c7457bb818f9f5c19aed66'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:08.682271 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-3598cfe7-5a3e-4f60-9c9c-faef4633c710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c57c3b0b4c7457bb818f9f5c19aed66'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:08.688564 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1393/2781] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:11:08 2022] DELETE /identity/v3/users/5c57c3b0b4c7457bb818f9f5c19aed66 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:11:08.952642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8110953-1d74-420f-9a83-c4283c9bb104 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:11:08.954254 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b8110953-1d74-420f-9a83-c4283c9bb104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:11:08.968514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8110953-1d74-420f-9a83-c4283c9bb104 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:11:09.033941 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d8b09-1720-400c-b955-6267b15300a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:11:09.034850 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d8b09-1720-400c-b955-6267b15300a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:11:09.035136 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d8b09-1720-400c-b955-6267b15300a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:11:09.035409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d8b09-1720-400c-b955-6267b15300a7 admin admin] PATH_INFO: `/v3/projects/ae3a46736932438bb0983a426a703469` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:11:09.036648 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d8b09-1720-400c-b955-6267b15300a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae3a46736932438bb0983a426a703469)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:11:09.038556 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d8b09-1720-400c-b955-6267b15300a7 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:11:09.138406 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d20d8b09-1720-400c-b955-6267b15300a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae3a46736932438bb0983a426a703469', 'request_id': 'req-d20d8b09-1720-400c-b955-6267b15300a7'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:09.217799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d20d8b09-1720-400c-b955-6267b15300a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae3a46736932438bb0983a426a703469', 'request_id': 'req-d20d8b09-1720-400c-b955-6267b15300a7'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:09.224789 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d20d8b09-1720-400c-b955-6267b15300a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae3a46736932438bb0983a426a703469', 'request_id': 'req-d20d8b09-1720-400c-b955-6267b15300a7'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:09.235987 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d20d8b09-1720-400c-b955-6267b15300a7 admin admin] The token cache is being invalidate because project ae3a46736932438bb0983a426a703469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:11:09.236272 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d20d8b09-1720-400c-b955-6267b15300a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:09.236935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-d20d8b09-1720-400c-b955-6267b15300a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:11:09.238724 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1389/2782] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:11:08 2022] DELETE /identity/v3/projects/ae3a46736932438bb0983a426a703469 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:11:53.059346 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81005d-10f0-4f34-b72b-61b9cc997c37 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:11:53.065597 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81005d-10f0-4f34-b72b-61b9cc997c37 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:11:53.065597 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81005d-10f0-4f34-b72b-61b9cc997c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:11:53.077630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-3d81005d-10f0-4f34-b72b-61b9cc997c37 None None] MFA Rules not processed for user `794ba27ea12942e6b224b3b1fe345b57`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:11:53.078858 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3d81005d-10f0-4f34-b72b-61b9cc997c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:11:53.133188 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1394/2783] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:11:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:11:53.438711 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d8b09-1720-400c-b955-6267b15300a7 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:11:53.440236 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-d20d8b09-1720-400c-b955-6267b15300a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:11:53.496878 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d8b09-1720-400c-b955-6267b15300a7 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:11:53.500572 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cb5fd-b802-49cf-972d-550e891ac540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:11:53.501219 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cb5fd-b802-49cf-972d-550e891ac540 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:11:53.501503 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cb5fd-b802-49cf-972d-550e891ac540 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:11:53.501778 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cb5fd-b802-49cf-972d-550e891ac540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:11:53.503822 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1e1cb5fd-b802-49cf-972d-550e891ac540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:11:53.513426 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cb5fd-b802-49cf-972d-550e891ac540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:11:53.514845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cb5fd-b802-49cf-972d-550e891ac540 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:11:53.522638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1390/2784] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:11:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:11:56.005678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81005d-10f0-4f34-b72b-61b9cc997c37 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:11:56.007068 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-3d81005d-10f0-4f34-b72b-61b9cc997c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:11:56.074700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81005d-10f0-4f34-b72b-61b9cc997c37 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:11:56.080346 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416f308-f43f-4a70-981e-97b906eb3f32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8855284b10c64b8ca367e3c30b5f66fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:11:56.080992 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416f308-f43f-4a70-981e-97b906eb3f32 service placement] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:11:56.081277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416f308-f43f-4a70-981e-97b906eb3f32 service placement] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:11:56.081550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416f308-f43f-4a70-981e-97b906eb3f32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:11:56.083334 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-6416f308-f43f-4a70-981e-97b906eb3f32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:11:56.095344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416f308-f43f-4a70-981e-97b906eb3f32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:11:56.096978 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416f308-f43f-4a70-981e-97b906eb3f32 service placement] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:11:56.107422 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1395/2785] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:11:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:12:09.821944 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cb5fd-b802-49cf-972d-550e891ac540 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:12:09.823421 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-1e1cb5fd-b802-49cf-972d-550e891ac540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:12:09.912088 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cb5fd-b802-49cf-972d-550e891ac540 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:12:09.918332 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d6bf4-313f-493b-b7a4-8322474113ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534fd902f96043068e99ca0537cf57c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:12:09.919060 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d6bf4-313f-493b-b7a4-8322474113ea service nova] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:12:09.919413 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d6bf4-313f-493b-b7a4-8322474113ea service nova] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:12:09.919806 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d6bf4-313f-493b-b7a4-8322474113ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:12:09.921721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-822d6bf4-313f-493b-b7a4-8322474113ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:12:09.935731 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d6bf4-313f-493b-b7a4-8322474113ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:12:09.937774 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d6bf4-313f-493b-b7a4-8322474113ea service nova] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:12:09.949813 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1391/2786] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:12:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:13:26.728550 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416f308-f43f-4a70-981e-97b906eb3f32 service placement] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:26.736190 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-6416f308-f43f-4a70-981e-97b906eb3f32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:26.860244 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416f308-f43f-4a70-981e-97b906eb3f32 service placement] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:26.865010 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797dc13-b1d2-4736-8d0a-64daa2aaa4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:26.865876 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797dc13-b1d2-4736-8d0a-64daa2aaa4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:26.866162 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797dc13-b1d2-4736-8d0a-64daa2aaa4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:26.866442 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797dc13-b1d2-4736-8d0a-64daa2aaa4a2 admin admin] PATH_INFO: `/v3/users/794ba27ea12942e6b224b3b1fe345b57` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:26.867687 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797dc13-b1d2-4736-8d0a-64daa2aaa4a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=794ba27ea12942e6b224b3b1fe345b57)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:26.869601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797dc13-b1d2-4736-8d0a-64daa2aaa4a2 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:27.069915 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0797dc13-b1d2-4736-8d0a-64daa2aaa4a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794ba27ea12942e6b224b3b1fe345b57'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:27.070561 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0797dc13-b1d2-4736-8d0a-64daa2aaa4a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794ba27ea12942e6b224b3b1fe345b57'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:27.077127 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0797dc13-b1d2-4736-8d0a-64daa2aaa4a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794ba27ea12942e6b224b3b1fe345b57'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:27.152771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0797dc13-b1d2-4736-8d0a-64daa2aaa4a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794ba27ea12942e6b224b3b1fe345b57'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:27.164559 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0797dc13-b1d2-4736-8d0a-64daa2aaa4a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794ba27ea12942e6b224b3b1fe345b57'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:27.171081 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1396/2787] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:13:26 2022] DELETE /identity/v3/users/794ba27ea12942e6b224b3b1fe345b57 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:13:27.435505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d6bf4-313f-493b-b7a4-8322474113ea service nova] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:27.474130 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d6bf4-313f-493b-b7a4-8322474113ea service nova] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:27.530025 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be6f46-d38b-4719-a329-14a3ff626f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:27.530922 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be6f46-d38b-4719-a329-14a3ff626f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:27.531206 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be6f46-d38b-4719-a329-14a3ff626f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:27.531475 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be6f46-d38b-4719-a329-14a3ff626f67 admin admin] PATH_INFO: `/v3/projects/5d84ff0250204447866262af592477c6` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:27.532688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be6f46-d38b-4719-a329-14a3ff626f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d84ff0250204447866262af592477c6)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:27.534594 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be6f46-d38b-4719-a329-14a3ff626f67 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:27.653039 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-41be6f46-d38b-4719-a329-14a3ff626f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d84ff0250204447866262af592477c6', 'request_id': 'req-41be6f46-d38b-4719-a329-14a3ff626f67'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:27.756930 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-41be6f46-d38b-4719-a329-14a3ff626f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d84ff0250204447866262af592477c6', 'request_id': 'req-41be6f46-d38b-4719-a329-14a3ff626f67'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:27.764938 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-41be6f46-d38b-4719-a329-14a3ff626f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d84ff0250204447866262af592477c6', 'request_id': 'req-41be6f46-d38b-4719-a329-14a3ff626f67'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:27.776610 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-41be6f46-d38b-4719-a329-14a3ff626f67 admin admin] The token cache is being invalidate because project 5d84ff0250204447866262af592477c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:13:27.777049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-41be6f46-d38b-4719-a329-14a3ff626f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:27.777706 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-41be6f46-d38b-4719-a329-14a3ff626f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:27.779281 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1392/2788] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:13:27 2022] DELETE /identity/v3/projects/5d84ff0250204447866262af592477c6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:13:27.784285 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1202b2-50ba-4393-b048-695e048a9cb4 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:27.784755 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1202b2-50ba-4393-b048-695e048a9cb4 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:27.784850 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1202b2-50ba-4393-b048-695e048a9cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:27.838144 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-aa1202b2-50ba-4393-b048-695e048a9cb4 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:13:27.839498 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-aa1202b2-50ba-4393-b048-695e048a9cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:27.910796 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1397/2789] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:13:27.919284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eb901-e725-46f1-90d1-274307fa5567 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:27.919688 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eb901-e725-46f1-90d1-274307fa5567 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:27.920040 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eb901-e725-46f1-90d1-274307fa5567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:27.938650 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-8a6eb901-e725-46f1-90d1-274307fa5567 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:13:27.939894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-8a6eb901-e725-46f1-90d1-274307fa5567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:27.947726 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1393/2790] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:13:27.952146 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1202b2-50ba-4393-b048-695e048a9cb4 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:27.961649 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1202b2-50ba-4393-b048-695e048a9cb4 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:27.966761 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e13e1-f77f-4e03-9e89-54cf99e5c2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:27.967407 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e13e1-f77f-4e03-9e89-54cf99e5c2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:27.967723 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e13e1-f77f-4e03-9e89-54cf99e5c2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:27.968000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e13e1-f77f-4e03-9e89-54cf99e5c2c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:27.968715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e13e1-f77f-4e03-9e89-54cf99e5c2c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:13:27.969025 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e13e1-f77f-4e03-9e89-54cf99e5c2c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:27.970659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e13e1-f77f-4e03-9e89-54cf99e5c2c9 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:27.982467 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1398/2791] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:13:27.986627 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eb901-e725-46f1-90d1-274307fa5567 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:27.996008 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eb901-e725-46f1-90d1-274307fa5567 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:28.000898 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e76753-6c0c-426a-9932-35579f0d51b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:28.001543 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e76753-6c0c-426a-9932-35579f0d51b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:28.001822 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e76753-6c0c-426a-9932-35579f0d51b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:28.002092 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e76753-6c0c-426a-9932-35579f0d51b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:28.002775 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e76753-6c0c-426a-9932-35579f0d51b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:28.004705 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e76753-6c0c-426a-9932-35579f0d51b4 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:28.098518 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1394/2792] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:13:27 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:13:28.102754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e13e1-f77f-4e03-9e89-54cf99e5c2c9 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:28.113872 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e13e1-f77f-4e03-9e89-54cf99e5c2c9 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:28.168719 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a120c-926b-4d33-8840-88d29fe67066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:28.169387 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a120c-926b-4d33-8840-88d29fe67066 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:28.169669 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a120c-926b-4d33-8840-88d29fe67066 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:28.169946 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a120c-926b-4d33-8840-88d29fe67066 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:28.170629 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a120c-926b-4d33-8840-88d29fe67066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:28.172646 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a120c-926b-4d33-8840-88d29fe67066 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:28.283477 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1399/2793] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:13:28 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:13:28.287665 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e76753-6c0c-426a-9932-35579f0d51b4 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:28.298499 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e76753-6c0c-426a-9932-35579f0d51b4 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:28.303492 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36d9bd-b486-4fe0-9ea0-40933df56ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:28.304184 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36d9bd-b486-4fe0-9ea0-40933df56ebf admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:28.304467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36d9bd-b486-4fe0-9ea0-40933df56ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:28.304744 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36d9bd-b486-4fe0-9ea0-40933df56ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:28.305470 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36d9bd-b486-4fe0-9ea0-40933df56ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:28.307135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36d9bd-b486-4fe0-9ea0-40933df56ebf admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:28.318562 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1395/2794] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:13:28.322838 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a120c-926b-4d33-8840-88d29fe67066 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:28.333955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a120c-926b-4d33-8840-88d29fe67066 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:28.338579 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8b555-bd45-40be-b79d-334b1b96df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:28.339985 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8b555-bd45-40be-b79d-334b1b96df98 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:28.340401 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8b555-bd45-40be-b79d-334b1b96df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:28.340680 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8b555-bd45-40be-b79d-334b1b96df98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:28.341405 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8b555-bd45-40be-b79d-334b1b96df98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:28.343006 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8b555-bd45-40be-b79d-334b1b96df98 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:28.353482 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1400/2795] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:13:28.357919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36d9bd-b486-4fe0-9ea0-40933df56ebf admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:28.367910 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36d9bd-b486-4fe0-9ea0-40933df56ebf admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:28.372651 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb7d37-8370-4af7-aaa7-fd14efd9ba40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:28.373532 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb7d37-8370-4af7-aaa7-fd14efd9ba40 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:28.373811 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb7d37-8370-4af7-aaa7-fd14efd9ba40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:28.374085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb7d37-8370-4af7-aaa7-fd14efd9ba40 admin admin] PATH_INFO: `/v3/projects/8817f2975e274e9892b4fd067c646957/users/0c70c4426ccf40519ca2598c74a9cb4b/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:28.389802 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb7d37-8370-4af7-aaa7-fd14efd9ba40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8817f2975e274e9892b4fd067c646957, user_id=0c70c4426ccf40519ca2598c74a9cb4b, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:28.393004 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb7d37-8370-4af7-aaa7-fd14efd9ba40 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:28.512007 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1396/2796] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:13:28 2022] PUT /identity/v3/projects/8817f2975e274e9892b4fd067c646957/users/0c70c4426ccf40519ca2598c74a9cb4b/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:13:28.522162 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdbf5f-ad89-4337-95dd-25be280a9693 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:28.522451 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdbf5f-ad89-4337-95dd-25be280a9693 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:28.522740 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdbf5f-ad89-4337-95dd-25be280a9693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:28.549527 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-e9fdbf5f-ad89-4337-95dd-25be280a9693 None None] MFA Rules not processed for user `0c70c4426ccf40519ca2598c74a9cb4b`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:13:28.550615 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-e9fdbf5f-ad89-4337-95dd-25be280a9693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:28.613459 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1401/2797] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:13:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:13:28.624113 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb7d37-8370-4af7-aaa7-fd14efd9ba40 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:28.626023 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-3ebb7d37-8370-4af7-aaa7-fd14efd9ba40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:28.716799 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb7d37-8370-4af7-aaa7-fd14efd9ba40 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:28.720576 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cc531-6064-4238-847f-aa30c7d09897 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:28.721220 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cc531-6064-4238-847f-aa30c7d09897 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:28.721504 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cc531-6064-4238-847f-aa30c7d09897 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:28.721782 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cc531-6064-4238-847f-aa30c7d09897 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:28.730078 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cc531-6064-4238-847f-aa30c7d09897 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:28.731638 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cc531-6064-4238-847f-aa30c7d09897 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:28.740363 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1397/2798] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:13:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:13:38.371937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdbf5f-ad89-4337-95dd-25be280a9693 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:38.437460 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdbf5f-ad89-4337-95dd-25be280a9693 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:38.442143 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc2f95-2ac9-4400-9137-196115067dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:38.443003 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc2f95-2ac9-4400-9137-196115067dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:38.443280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc2f95-2ac9-4400-9137-196115067dea admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:38.443577 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc2f95-2ac9-4400-9137-196115067dea admin admin] PATH_INFO: `/v3/users/0c70c4426ccf40519ca2598c74a9cb4b` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:38.444754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc2f95-2ac9-4400-9137-196115067dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c70c4426ccf40519ca2598c74a9cb4b)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:38.446792 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc2f95-2ac9-4400-9137-196115067dea admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:38.654977 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-56cc2f95-2ac9-4400-9137-196115067dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c70c4426ccf40519ca2598c74a9cb4b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:38.655700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-56cc2f95-2ac9-4400-9137-196115067dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c70c4426ccf40519ca2598c74a9cb4b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:38.662946 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-56cc2f95-2ac9-4400-9137-196115067dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c70c4426ccf40519ca2598c74a9cb4b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:38.722069 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-56cc2f95-2ac9-4400-9137-196115067dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c70c4426ccf40519ca2598c74a9cb4b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:38.734031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-56cc2f95-2ac9-4400-9137-196115067dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c70c4426ccf40519ca2598c74a9cb4b'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:38.740033 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1402/2799] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:13:38 2022] DELETE /identity/v3/users/0c70c4426ccf40519ca2598c74a9cb4b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:13:38.744500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38190daa-c864-4252-aae4-4ff37b55b13a None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:38.744994 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38190daa-c864-4252-aae4-4ff37b55b13a None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:38.745135 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38190daa-c864-4252-aae4-4ff37b55b13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:38.762376 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-38190daa-c864-4252-aae4-4ff37b55b13a None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:13:38.763701 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-38190daa-c864-4252-aae4-4ff37b55b13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:38.821845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1398/2800] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:13:38.832388 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc2f95-2ac9-4400-9137-196115067dea admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:38.834028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-56cc2f95-2ac9-4400-9137-196115067dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:38.914877 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc2f95-2ac9-4400-9137-196115067dea admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:38.918544 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f965c-bf26-49fc-ad28-a2dfe1cca6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:38.919189 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f965c-bf26-49fc-ad28-a2dfe1cca6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:38.919470 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f965c-bf26-49fc-ad28-a2dfe1cca6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:38.919775 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f965c-bf26-49fc-ad28-a2dfe1cca6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:38.928729 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f965c-bf26-49fc-ad28-a2dfe1cca6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:38.930157 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f965c-bf26-49fc-ad28-a2dfe1cca6d9 service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:38.939417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1403/2801] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:13:39.375234 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38190daa-c864-4252-aae4-4ff37b55b13a None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:39.378930 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-38190daa-c864-4252-aae4-4ff37b55b13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:39.393905 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38190daa-c864-4252-aae4-4ff37b55b13a None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:39.402654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a971db-cf53-4989-97f4-39584446617e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:39.402654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a971db-cf53-4989-97f4-39584446617e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:39.402654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a971db-cf53-4989-97f4-39584446617e admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:39.402654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a971db-cf53-4989-97f4-39584446617e admin admin] PATH_INFO: `/v3/projects/8817f2975e274e9892b4fd067c646957` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:39.404099 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a971db-cf53-4989-97f4-39584446617e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8817f2975e274e9892b4fd067c646957)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:39.405678 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a971db-cf53-4989-97f4-39584446617e admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:39.524003 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-07a971db-cf53-4989-97f4-39584446617e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8817f2975e274e9892b4fd067c646957', 'request_id': 'req-07a971db-cf53-4989-97f4-39584446617e'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:39.587011 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-07a971db-cf53-4989-97f4-39584446617e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8817f2975e274e9892b4fd067c646957', 'request_id': 'req-07a971db-cf53-4989-97f4-39584446617e'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:39.593793 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-07a971db-cf53-4989-97f4-39584446617e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8817f2975e274e9892b4fd067c646957', 'request_id': 'req-07a971db-cf53-4989-97f4-39584446617e'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:39.604254 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-07a971db-cf53-4989-97f4-39584446617e admin admin] The token cache is being invalidate because project 8817f2975e274e9892b4fd067c646957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:13:39.604545 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-07a971db-cf53-4989-97f4-39584446617e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:39.605188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-07a971db-cf53-4989-97f4-39584446617e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:39.606730 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1399/2802] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:13:39 2022] DELETE /identity/v3/projects/8817f2975e274e9892b4fd067c646957 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:13:39.612540 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af3d72-8a73-45e7-9dce-ae1ddf5d8153 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:39.613107 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af3d72-8a73-45e7-9dce-ae1ddf5d8153 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:39.613208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af3d72-8a73-45e7-9dce-ae1ddf5d8153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:39.634992 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-17af3d72-8a73-45e7-9dce-ae1ddf5d8153 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:13:39.636248 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-17af3d72-8a73-45e7-9dce-ae1ddf5d8153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:39.695933 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1404/2803] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:13:39.705962 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28760832-7b4a-4f63-b6dd-60c584555cca None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:39.706244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28760832-7b4a-4f63-b6dd-60c584555cca None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:39.706523 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28760832-7b4a-4f63-b6dd-60c584555cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:39.726407 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-28760832-7b4a-4f63-b6dd-60c584555cca None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:13:39.727932 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-28760832-7b4a-4f63-b6dd-60c584555cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:39.737537 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1400/2804] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:13:39.744642 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af3d72-8a73-45e7-9dce-ae1ddf5d8153 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:39.755978 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af3d72-8a73-45e7-9dce-ae1ddf5d8153 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:39.760700 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804565e4-0e4a-4648-8d19-5ee1714a9bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:39.761350 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804565e4-0e4a-4648-8d19-5ee1714a9bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:39.761637 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804565e4-0e4a-4648-8d19-5ee1714a9bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:39.761920 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804565e4-0e4a-4648-8d19-5ee1714a9bc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:39.762641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804565e4-0e4a-4648-8d19-5ee1714a9bc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:13:39.762951 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804565e4-0e4a-4648-8d19-5ee1714a9bc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:39.764591 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804565e4-0e4a-4648-8d19-5ee1714a9bc2 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:39.777848 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1405/2805] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 12:13:39.782193 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28760832-7b4a-4f63-b6dd-60c584555cca None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:39.791959 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28760832-7b4a-4f63-b6dd-60c584555cca None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:39.798772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a1deb-bda4-467f-b92f-82a7a237e2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:39.798772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a1deb-bda4-467f-b92f-82a7a237e2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:39.798772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a1deb-bda4-467f-b92f-82a7a237e2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:39.798772 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a1deb-bda4-467f-b92f-82a7a237e2d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:39.799392 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a1deb-bda4-467f-b92f-82a7a237e2d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:39.801038 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a1deb-bda4-467f-b92f-82a7a237e2d8 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:39.896954 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1401/2806] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:13:39 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:13:39.901222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804565e4-0e4a-4648-8d19-5ee1714a9bc2 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:39.912389 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804565e4-0e4a-4648-8d19-5ee1714a9bc2 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:39.969825 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b2f3e-b9bd-4d36-9fec-cd60e9f760b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:39.970499 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b2f3e-b9bd-4d36-9fec-cd60e9f760b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:39.970928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b2f3e-b9bd-4d36-9fec-cd60e9f760b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:39.971415 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b2f3e-b9bd-4d36-9fec-cd60e9f760b3 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:39.972627 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b2f3e-b9bd-4d36-9fec-cd60e9f760b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:39.974568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b2f3e-b9bd-4d36-9fec-cd60e9f760b3 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:40.059048 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1406/2807] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:13:39 2022] POST /identity/v3/users => generated 303 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:13:40.063317 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a1deb-bda4-467f-b92f-82a7a237e2d8 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:40.074964 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a1deb-bda4-467f-b92f-82a7a237e2d8 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:40.080118 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72b73c-1679-493c-84eb-81426f2f9fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:40.080932 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72b73c-1679-493c-84eb-81426f2f9fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:40.081249 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72b73c-1679-493c-84eb-81426f2f9fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:40.081566 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72b73c-1679-493c-84eb-81426f2f9fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:40.082442 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72b73c-1679-493c-84eb-81426f2f9fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:40.084251 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72b73c-1679-493c-84eb-81426f2f9fd7 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:40.094507 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1402/2808] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:13:40.100168 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b2f3e-b9bd-4d36-9fec-cd60e9f760b3 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:40.109913 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b2f3e-b9bd-4d36-9fec-cd60e9f760b3 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:40.115298 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb77ab-0b73-4f03-9190-e38b76692ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:40.116101 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb77ab-0b73-4f03-9190-e38b76692ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:40.116260 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb77ab-0b73-4f03-9190-e38b76692ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:40.116535 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb77ab-0b73-4f03-9190-e38b76692ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:40.117246 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb77ab-0b73-4f03-9190-e38b76692ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:40.118897 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb77ab-0b73-4f03-9190-e38b76692ae9 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:40.129074 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1407/2809] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:13:40.133150 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72b73c-1679-493c-84eb-81426f2f9fd7 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:40.143487 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72b73c-1679-493c-84eb-81426f2f9fd7 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:40.148105 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2dd41-51e9-4d85-837d-25a68ed4b89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:40.148971 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2dd41-51e9-4d85-837d-25a68ed4b89c admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:40.149247 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2dd41-51e9-4d85-837d-25a68ed4b89c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:40.149513 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2dd41-51e9-4d85-837d-25a68ed4b89c admin admin] PATH_INFO: `/v3/projects/c8282773aafe4cc2b5fb59c24a7fd0a3/users/c00647edf9c9455c9ed5480ebaabb157/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:40.164142 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2dd41-51e9-4d85-837d-25a68ed4b89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8282773aafe4cc2b5fb59c24a7fd0a3, user_id=c00647edf9c9455c9ed5480ebaabb157, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:40.166751 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2dd41-51e9-4d85-837d-25a68ed4b89c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:40.233051 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1403/2810] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:13:40 2022] PUT /identity/v3/projects/c8282773aafe4cc2b5fb59c24a7fd0a3/users/c00647edf9c9455c9ed5480ebaabb157/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:13:40.238193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd17d3e-0a2e-448e-9c0e-9bdaf9324319 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:40.238490 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd17d3e-0a2e-448e-9c0e-9bdaf9324319 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:40.238786 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd17d3e-0a2e-448e-9c0e-9bdaf9324319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:40.256737 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-2dd17d3e-0a2e-448e-9c0e-9bdaf9324319 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:13:40.258000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-2dd17d3e-0a2e-448e-9c0e-9bdaf9324319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:40.314380 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1408/2811] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:13:40.324097 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2dd41-51e9-4d85-837d-25a68ed4b89c admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:40.325877 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-62e2dd41-51e9-4d85-837d-25a68ed4b89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:40.384833 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2dd41-51e9-4d85-837d-25a68ed4b89c admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:40.388830 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23434f35-1c17-48a5-a0a0-7d03784d43f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:40.389584 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23434f35-1c17-48a5-a0a0-7d03784d43f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:40.389981 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23434f35-1c17-48a5-a0a0-7d03784d43f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:40.390358 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23434f35-1c17-48a5-a0a0-7d03784d43f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:40.400690 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23434f35-1c17-48a5-a0a0-7d03784d43f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:40.402108 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23434f35-1c17-48a5-a0a0-7d03784d43f8 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:40.412358 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1404/2812] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:13:41.612839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c7273-b84e-4ed3-b7d5-f0edb17514e2 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:41.613425 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c7273-b84e-4ed3-b7d5-f0edb17514e2 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:41.613861 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c7273-b84e-4ed3-b7d5-f0edb17514e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:41.644376 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-462c7273-b84e-4ed3-b7d5-f0edb17514e2 None None] MFA Rules not processed for user `c00647edf9c9455c9ed5480ebaabb157`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:13:41.645630 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-462c7273-b84e-4ed3-b7d5-f0edb17514e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:41.710502 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1409/2813] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:13:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:13:41.714909 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23434f35-1c17-48a5-a0a0-7d03784d43f8 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:41.725137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23434f35-1c17-48a5-a0a0-7d03784d43f8 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:41.729945 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25a342-de61-406f-81cd-7fb620230c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:41.730601 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25a342-de61-406f-81cd-7fb620230c91 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:41.730887 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25a342-de61-406f-81cd-7fb620230c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:41.731167 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25a342-de61-406f-81cd-7fb620230c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:41.731911 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25a342-de61-406f-81cd-7fb620230c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:41.733836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25a342-de61-406f-81cd-7fb620230c91 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:41.827921 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1405/2814] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:13:41 2022] POST /identity/v3/projects => generated 403 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:13:41.832537 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c7273-b84e-4ed3-b7d5-f0edb17514e2 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:41.843385 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c7273-b84e-4ed3-b7d5-f0edb17514e2 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:41.897656 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcbea5-4b90-4544-bb08-7afb1135ece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:41.898331 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcbea5-4b90-4544-bb08-7afb1135ece3 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:41.898619 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcbea5-4b90-4544-bb08-7afb1135ece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:41.899017 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcbea5-4b90-4544-bb08-7afb1135ece3 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:41.899772 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcbea5-4b90-4544-bb08-7afb1135ece3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:41.901744 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcbea5-4b90-4544-bb08-7afb1135ece3 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:42.005562 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1410/2815] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:13:41 2022] POST /identity/v3/users => generated 308 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:13:42.009480 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25a342-de61-406f-81cd-7fb620230c91 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:42.020886 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25a342-de61-406f-81cd-7fb620230c91 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:42.025875 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594ba38-694b-44b0-b5c4-4c0f4bd974fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:42.026542 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594ba38-694b-44b0-b5c4-4c0f4bd974fb admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:42.026830 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594ba38-694b-44b0-b5c4-4c0f4bd974fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:42.027109 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594ba38-694b-44b0-b5c4-4c0f4bd974fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:42.027868 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594ba38-694b-44b0-b5c4-4c0f4bd974fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:42.029472 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594ba38-694b-44b0-b5c4-4c0f4bd974fb admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:42.041217 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1406/2816] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:13:42.045366 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcbea5-4b90-4544-bb08-7afb1135ece3 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:42.055474 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcbea5-4b90-4544-bb08-7afb1135ece3 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:42.060106 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a31d9-d44e-4682-ba9b-b15d2edf0e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:42.060982 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a31d9-d44e-4682-ba9b-b15d2edf0e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:42.061264 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a31d9-d44e-4682-ba9b-b15d2edf0e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:42.061540 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a31d9-d44e-4682-ba9b-b15d2edf0e82 admin admin] PATH_INFO: `/v3/projects/3bef3438f0694be386930dea37533b2a/users/ebfad9db7b04405d99d8447b0fb26249/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:42.076615 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a31d9-d44e-4682-ba9b-b15d2edf0e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bef3438f0694be386930dea37533b2a, user_id=ebfad9db7b04405d99d8447b0fb26249, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:42.079282 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a31d9-d44e-4682-ba9b-b15d2edf0e82 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:42.150311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1411/2817] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:13:42 2022] PUT /identity/v3/projects/3bef3438f0694be386930dea37533b2a/users/ebfad9db7b04405d99d8447b0fb26249/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:13:42.154294 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594ba38-694b-44b0-b5c4-4c0f4bd974fb admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:42.164500 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594ba38-694b-44b0-b5c4-4c0f4bd974fb admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:42.220045 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61a59d-b938-4fe7-9b0d-20bffb7b88b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:42.220804 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61a59d-b938-4fe7-9b0d-20bffb7b88b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:42.221166 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61a59d-b938-4fe7-9b0d-20bffb7b88b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:42.221443 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61a59d-b938-4fe7-9b0d-20bffb7b88b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:42.222297 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61a59d-b938-4fe7-9b0d-20bffb7b88b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:42.224326 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61a59d-b938-4fe7-9b0d-20bffb7b88b6 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:42.239035 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1407/2818] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:13:42.243666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a31d9-d44e-4682-ba9b-b15d2edf0e82 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:42.254953 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a31d9-d44e-4682-ba9b-b15d2edf0e82 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:42.260351 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c74b2-2a45-4c63-9d50-00b15c29d09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:42.261302 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c74b2-2a45-4c63-9d50-00b15c29d09a admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:42.261585 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c74b2-2a45-4c63-9d50-00b15c29d09a admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:42.261892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c74b2-2a45-4c63-9d50-00b15c29d09a admin admin] PATH_INFO: `/v3/projects/3bef3438f0694be386930dea37533b2a/users/ebfad9db7b04405d99d8447b0fb26249/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:42.263883 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c74b2-2a45-4c63-9d50-00b15c29d09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bef3438f0694be386930dea37533b2a, user_id=ebfad9db7b04405d99d8447b0fb26249, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:42.266492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c74b2-2a45-4c63-9d50-00b15c29d09a admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:42.277607 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1412/2819] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:13:42 2022] PUT /identity/v3/projects/3bef3438f0694be386930dea37533b2a/users/ebfad9db7b04405d99d8447b0fb26249/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:13:43.765231 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35322a-2300-4af5-9a72-8b0b7cc30dd1 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:43.765779 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35322a-2300-4af5-9a72-8b0b7cc30dd1 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:43.765779 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35322a-2300-4af5-9a72-8b0b7cc30dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:43.796212 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-2c35322a-2300-4af5-9a72-8b0b7cc30dd1 None None] MFA Rules not processed for user `ebfad9db7b04405d99d8447b0fb26249`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:13:43.797440 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-2c35322a-2300-4af5-9a72-8b0b7cc30dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:43.876891 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1408/2820] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:13:43 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:13:45.151031 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c74b2-2a45-4c63-9d50-00b15c29d09a admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:45.213477 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c74b2-2a45-4c63-9d50-00b15c29d09a admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:45.218080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af48843-1398-4d52-a110-63142d3af3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:45.218945 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af48843-1398-4d52-a110-63142d3af3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:45.219222 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af48843-1398-4d52-a110-63142d3af3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:45.219492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af48843-1398-4d52-a110-63142d3af3f4 admin admin] PATH_INFO: `/v3/users/c00647edf9c9455c9ed5480ebaabb157` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:45.220698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af48843-1398-4d52-a110-63142d3af3f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00647edf9c9455c9ed5480ebaabb157)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:45.222692 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af48843-1398-4d52-a110-63142d3af3f4 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:45.406126 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0af48843-1398-4d52-a110-63142d3af3f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00647edf9c9455c9ed5480ebaabb157'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:45.406754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0af48843-1398-4d52-a110-63142d3af3f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00647edf9c9455c9ed5480ebaabb157'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:45.414165 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0af48843-1398-4d52-a110-63142d3af3f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00647edf9c9455c9ed5480ebaabb157'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:45.489218 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0af48843-1398-4d52-a110-63142d3af3f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00647edf9c9455c9ed5480ebaabb157'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:45.501386 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-0af48843-1398-4d52-a110-63142d3af3f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00647edf9c9455c9ed5480ebaabb157'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:45.507860 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1413/2821] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:13:45 2022] DELETE /identity/v3/users/c00647edf9c9455c9ed5480ebaabb157 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:13:45.754845 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35322a-2300-4af5-9a72-8b0b7cc30dd1 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:45.765402 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35322a-2300-4af5-9a72-8b0b7cc30dd1 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:45.826180 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:45.827285 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:45.827604 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:45.827881 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb admin admin] PATH_INFO: `/v3/projects/c8282773aafe4cc2b5fb59c24a7fd0a3` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:45.829074 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8282773aafe4cc2b5fb59c24a7fd0a3)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:45.830976 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:45.942108 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8282773aafe4cc2b5fb59c24a7fd0a3', 'request_id': 'req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:46.009937 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8282773aafe4cc2b5fb59c24a7fd0a3', 'request_id': 'req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:46.017067 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8282773aafe4cc2b5fb59c24a7fd0a3', 'request_id': 'req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:46.027499 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb admin admin] The token cache is being invalidate because project c8282773aafe4cc2b5fb59c24a7fd0a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:13:46.027815 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:46.028464 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:46.030005 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1409/2822] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:13:45 2022] DELETE /identity/v3/projects/c8282773aafe4cc2b5fb59c24a7fd0a3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:13:46.034497 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af48843-1398-4d52-a110-63142d3af3f4 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:46.035947 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-0af48843-1398-4d52-a110-63142d3af3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:46.048715 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af48843-1398-4d52-a110-63142d3af3f4 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:46.102381 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6c352-c774-458d-979e-55ad2f5a275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:46.103237 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6c352-c774-458d-979e-55ad2f5a275c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:46.103543 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6c352-c774-458d-979e-55ad2f5a275c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:46.103824 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6c352-c774-458d-979e-55ad2f5a275c admin admin] PATH_INFO: `/v3/users/ebfad9db7b04405d99d8447b0fb26249` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:46.105007 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6c352-c774-458d-979e-55ad2f5a275c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebfad9db7b04405d99d8447b0fb26249)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:46.106928 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6c352-c774-458d-979e-55ad2f5a275c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:46.320490 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-79a6c352-c774-458d-979e-55ad2f5a275c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebfad9db7b04405d99d8447b0fb26249'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:46.321155 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-79a6c352-c774-458d-979e-55ad2f5a275c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebfad9db7b04405d99d8447b0fb26249'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:46.329914 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-79a6c352-c774-458d-979e-55ad2f5a275c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebfad9db7b04405d99d8447b0fb26249'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:46.395881 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-79a6c352-c774-458d-979e-55ad2f5a275c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebfad9db7b04405d99d8447b0fb26249'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:46.407963 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-79a6c352-c774-458d-979e-55ad2f5a275c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebfad9db7b04405d99d8447b0fb26249'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:46.414447 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1414/2823] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:13:46 2022] DELETE /identity/v3/users/ebfad9db7b04405d99d8447b0fb26249 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:13:46.655660 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:46.657090 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:46.670970 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999034f-d6ad-4000-a9a4-b4ef1a215fbb admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:46.726769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582225f-8e76-4c78-beb3-251b3f5aeced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:46.727667 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582225f-8e76-4c78-beb3-251b3f5aeced admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:46.727953 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582225f-8e76-4c78-beb3-251b3f5aeced admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:46.728255 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582225f-8e76-4c78-beb3-251b3f5aeced admin admin] PATH_INFO: `/v3/projects/3bef3438f0694be386930dea37533b2a` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:46.729408 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582225f-8e76-4c78-beb3-251b3f5aeced admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bef3438f0694be386930dea37533b2a)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:46.731300 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582225f-8e76-4c78-beb3-251b3f5aeced admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:46.841964 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2582225f-8e76-4c78-beb3-251b3f5aeced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bef3438f0694be386930dea37533b2a', 'request_id': 'req-2582225f-8e76-4c78-beb3-251b3f5aeced'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:46.924467 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2582225f-8e76-4c78-beb3-251b3f5aeced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bef3438f0694be386930dea37533b2a', 'request_id': 'req-2582225f-8e76-4c78-beb3-251b3f5aeced'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:46.931819 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2582225f-8e76-4c78-beb3-251b3f5aeced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bef3438f0694be386930dea37533b2a', 'request_id': 'req-2582225f-8e76-4c78-beb3-251b3f5aeced'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:46.944114 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2582225f-8e76-4c78-beb3-251b3f5aeced admin admin] The token cache is being invalidate because project 3bef3438f0694be386930dea37533b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:13:46.944409 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2582225f-8e76-4c78-beb3-251b3f5aeced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:46.945097 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2582225f-8e76-4c78-beb3-251b3f5aeced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:46.946823 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1410/2824] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:13:46 2022] DELETE /identity/v3/projects/3bef3438f0694be386930dea37533b2a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:13:46.952174 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc082f1c-6fce-487d-ae60-e196330472fe None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:46.952492 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc082f1c-6fce-487d-ae60-e196330472fe None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:46.952768 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc082f1c-6fce-487d-ae60-e196330472fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:46.976667 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-dc082f1c-6fce-487d-ae60-e196330472fe None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:13:46.978237 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-dc082f1c-6fce-487d-ae60-e196330472fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:47.051000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1415/2825] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:13:47.060065 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c813d0-f094-4ec6-a70a-624c1aa9d49e None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:47.060353 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c813d0-f094-4ec6-a70a-624c1aa9d49e None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:47.060630 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c813d0-f094-4ec6-a70a-624c1aa9d49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:47.079786 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-e2c813d0-f094-4ec6-a70a-624c1aa9d49e None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:13:47.081783 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-e2c813d0-f094-4ec6-a70a-624c1aa9d49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:47.089783 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1411/2826] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:13:47.094164 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc082f1c-6fce-487d-ae60-e196330472fe None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:47.104426 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc082f1c-6fce-487d-ae60-e196330472fe None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:47.109133 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b675502-3f2a-4460-8027-117f5935024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:47.109785 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b675502-3f2a-4460-8027-117f5935024b admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:47.110061 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b675502-3f2a-4460-8027-117f5935024b admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:47.110332 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b675502-3f2a-4460-8027-117f5935024b admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:47.111055 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b675502-3f2a-4460-8027-117f5935024b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:13:47.111386 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b675502-3f2a-4460-8027-117f5935024b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:47.113149 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b675502-3f2a-4460-8027-117f5935024b admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:47.125171 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1416/2827] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:13:47.130325 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c813d0-f094-4ec6-a70a-624c1aa9d49e None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:47.139609 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c813d0-f094-4ec6-a70a-624c1aa9d49e None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:47.146033 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29cbb4-d456-4cee-887b-36bd770699f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:47.146721 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29cbb4-d456-4cee-887b-36bd770699f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:47.146997 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29cbb4-d456-4cee-887b-36bd770699f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:47.147268 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29cbb4-d456-4cee-887b-36bd770699f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:47.147992 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29cbb4-d456-4cee-887b-36bd770699f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:47.149910 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29cbb4-d456-4cee-887b-36bd770699f3 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:47.268796 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1412/2828] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:13:47 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:13:47.273045 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b675502-3f2a-4460-8027-117f5935024b admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:47.283100 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b675502-3f2a-4460-8027-117f5935024b admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:47.341599 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbccb4a-3f58-4321-bc23-5baeeecece70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:47.342394 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbccb4a-3f58-4321-bc23-5baeeecece70 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:47.342530 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbccb4a-3f58-4321-bc23-5baeeecece70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:47.342781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbccb4a-3f58-4321-bc23-5baeeecece70 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:47.343468 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbccb4a-3f58-4321-bc23-5baeeecece70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:47.345408 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbccb4a-3f58-4321-bc23-5baeeecece70 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:47.421150 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1417/2829] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:13:47 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:13:47.426514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29cbb4-d456-4cee-887b-36bd770699f3 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:47.436960 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29cbb4-d456-4cee-887b-36bd770699f3 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:47.442468 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5efdca-65bc-4d53-a6c6-f917ccc90995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:47.443159 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5efdca-65bc-4d53-a6c6-f917ccc90995 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:47.443447 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5efdca-65bc-4d53-a6c6-f917ccc90995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:47.443754 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5efdca-65bc-4d53-a6c6-f917ccc90995 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:47.444482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5efdca-65bc-4d53-a6c6-f917ccc90995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:47.446257 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5efdca-65bc-4d53-a6c6-f917ccc90995 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:47.456892 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1413/2830] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:13:47.461193 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbccb4a-3f58-4321-bc23-5baeeecece70 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:47.472506 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbccb4a-3f58-4321-bc23-5baeeecece70 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:47.477291 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cd2b3-c2fd-419e-ab30-f2e84d44c823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:47.477951 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cd2b3-c2fd-419e-ab30-f2e84d44c823 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:47.478239 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cd2b3-c2fd-419e-ab30-f2e84d44c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:47.478519 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cd2b3-c2fd-419e-ab30-f2e84d44c823 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:47.479240 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409cd2b3-c2fd-419e-ab30-f2e84d44c823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:47.480881 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409cd2b3-c2fd-419e-ab30-f2e84d44c823 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:47.492218 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1418/2831] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:13:47.496384 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5efdca-65bc-4d53-a6c6-f917ccc90995 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:47.507118 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5efdca-65bc-4d53-a6c6-f917ccc90995 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:47.511687 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca02edb-b3fe-40af-93aa-994832f50f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:47.512555 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca02edb-b3fe-40af-93aa-994832f50f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:47.512830 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca02edb-b3fe-40af-93aa-994832f50f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:47.513100 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca02edb-b3fe-40af-93aa-994832f50f29 admin admin] PATH_INFO: `/v3/projects/9239e9f6f3d9452085b909d3f712fd62/users/b1f665c5d77441b1a24bfbcd44651eb2/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:47.527220 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca02edb-b3fe-40af-93aa-994832f50f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9239e9f6f3d9452085b909d3f712fd62, user_id=b1f665c5d77441b1a24bfbcd44651eb2, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:47.529880 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca02edb-b3fe-40af-93aa-994832f50f29 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:47.609219 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1414/2832] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:13:47 2022] PUT /identity/v3/projects/9239e9f6f3d9452085b909d3f712fd62/users/b1f665c5d77441b1a24bfbcd44651eb2/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:13:47.620191 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37429a-afd2-4c73-8c89-2eba3c1d0c0e None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:47.620596 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37429a-afd2-4c73-8c89-2eba3c1d0c0e None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:47.620910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37429a-afd2-4c73-8c89-2eba3c1d0c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:47.647820 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-1a37429a-afd2-4c73-8c89-2eba3c1d0c0e None None] MFA Rules not processed for user `b1f665c5d77441b1a24bfbcd44651eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:13:47.649067 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-1a37429a-afd2-4c73-8c89-2eba3c1d0c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:47.710079 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1419/2833] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:13:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:13:47.714317 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca02edb-b3fe-40af-93aa-994832f50f29 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:47.773667 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca02edb-b3fe-40af-93aa-994832f50f29 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:47.778284 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e68ba-5aeb-447d-bd3f-674e85895bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:47.778933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e68ba-5aeb-447d-bd3f-674e85895bff admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:47.779211 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e68ba-5aeb-447d-bd3f-674e85895bff admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:47.779484 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e68ba-5aeb-447d-bd3f-674e85895bff admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:47.780193 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e68ba-5aeb-447d-bd3f-674e85895bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:47.782124 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e68ba-5aeb-447d-bd3f-674e85895bff admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:47.902288 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1415/2834] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:13:47 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:13:47.906511 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37429a-afd2-4c73-8c89-2eba3c1d0c0e None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:47.917925 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37429a-afd2-4c73-8c89-2eba3c1d0c0e None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:47.971208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0487915-e4fe-47b5-a5c2-f60776996a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:47.971922 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487915-e4fe-47b5-a5c2-f60776996a06 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:47.972208 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487915-e4fe-47b5-a5c2-f60776996a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:47.972484 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487915-e4fe-47b5-a5c2-f60776996a06 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:47.973160 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0487915-e4fe-47b5-a5c2-f60776996a06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:47.975076 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0487915-e4fe-47b5-a5c2-f60776996a06 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:48.060973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1420/2835] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:13:47 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:13:48.065070 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e68ba-5aeb-447d-bd3f-674e85895bff admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:48.075138 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e68ba-5aeb-447d-bd3f-674e85895bff admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:48.079745 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c81d2b-f77b-41d8-b7eb-333eaaf6e9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:48.080961 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c81d2b-f77b-41d8-b7eb-333eaaf6e9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:48.081392 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c81d2b-f77b-41d8-b7eb-333eaaf6e9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:48.081672 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c81d2b-f77b-41d8-b7eb-333eaaf6e9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:48.082386 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c81d2b-f77b-41d8-b7eb-333eaaf6e9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:48.084129 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c81d2b-f77b-41d8-b7eb-333eaaf6e9e9 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:48.095377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1416/2836] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:13:48.099935 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0487915-e4fe-47b5-a5c2-f60776996a06 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:48.109588 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0487915-e4fe-47b5-a5c2-f60776996a06 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:48.114054 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834cbe9-d102-4ea8-8979-f45afde06b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:48.114698 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834cbe9-d102-4ea8-8979-f45afde06b17 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:48.115175 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834cbe9-d102-4ea8-8979-f45afde06b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:48.115471 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834cbe9-d102-4ea8-8979-f45afde06b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:48.116215 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834cbe9-d102-4ea8-8979-f45afde06b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:48.117800 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834cbe9-d102-4ea8-8979-f45afde06b17 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:48.127972 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1421/2837] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:13:48.131880 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c81d2b-f77b-41d8-b7eb-333eaaf6e9e9 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:48.141546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c81d2b-f77b-41d8-b7eb-333eaaf6e9e9 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:48.146828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63003469-c6b4-4d5a-b76a-7f214655d17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:48.147741 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63003469-c6b4-4d5a-b76a-7f214655d17c admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:48.148020 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63003469-c6b4-4d5a-b76a-7f214655d17c admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:48.148295 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63003469-c6b4-4d5a-b76a-7f214655d17c admin admin] PATH_INFO: `/v3/projects/8ecfd34775f6404ca6191f8448cafe23/users/caafc59bfbd145c19f5ef0a557abdd22/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:48.162971 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63003469-c6b4-4d5a-b76a-7f214655d17c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ecfd34775f6404ca6191f8448cafe23, user_id=caafc59bfbd145c19f5ef0a557abdd22, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:48.165654 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63003469-c6b4-4d5a-b76a-7f214655d17c admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:48.264606 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1417/2838] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:13:48 2022] PUT /identity/v3/projects/8ecfd34775f6404ca6191f8448cafe23/users/caafc59bfbd145c19f5ef0a557abdd22/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:13:48.275597 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc1443-753b-45b3-aca1-f076017a13fe None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:48.275945 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc1443-753b-45b3-aca1-f076017a13fe None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:48.276223 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc1443-753b-45b3-aca1-f076017a13fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:48.301854 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-1fbc1443-753b-45b3-aca1-f076017a13fe None None] MFA Rules not processed for user `caafc59bfbd145c19f5ef0a557abdd22`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:13:48.303046 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-1fbc1443-753b-45b3-aca1-f076017a13fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:48.363457 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1422/2839] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:13:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:13:48.367904 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63003469-c6b4-4d5a-b76a-7f214655d17c admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:48.427051 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63003469-c6b4-4d5a-b76a-7f214655d17c admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:48.431725 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a27c5-5130-4488-a137-b88f92391f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:48.432377 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a27c5-5130-4488-a137-b88f92391f63 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:48.432658 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a27c5-5130-4488-a137-b88f92391f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:48.432935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a27c5-5130-4488-a137-b88f92391f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:48.433614 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a27c5-5130-4488-a137-b88f92391f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:48.435546 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a27c5-5130-4488-a137-b88f92391f63 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:48.510246 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1418/2840] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:13:48 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:13:48.514515 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc1443-753b-45b3-aca1-f076017a13fe None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:48.525934 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc1443-753b-45b3-aca1-f076017a13fe None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:48.578726 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ab7e9-69d5-4a30-8dc9-c18fa0336b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:48.579378 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ab7e9-69d5-4a30-8dc9-c18fa0336b2e admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:48.579693 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ab7e9-69d5-4a30-8dc9-c18fa0336b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:48.579967 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ab7e9-69d5-4a30-8dc9-c18fa0336b2e admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:48.581351 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ab7e9-69d5-4a30-8dc9-c18fa0336b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:48.583258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ab7e9-69d5-4a30-8dc9-c18fa0336b2e admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:48.654985 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1423/2841] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:13:48 2022] POST /identity/v3/users => generated 300 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:13:48.659272 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a27c5-5130-4488-a137-b88f92391f63 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:48.669881 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a27c5-5130-4488-a137-b88f92391f63 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:48.674824 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67734124-ec37-46d3-bf87-e7c615b46888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:48.675482 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67734124-ec37-46d3-bf87-e7c615b46888 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:48.675792 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67734124-ec37-46d3-bf87-e7c615b46888 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:48.676072 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67734124-ec37-46d3-bf87-e7c615b46888 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:48.676829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67734124-ec37-46d3-bf87-e7c615b46888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:48.678413 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67734124-ec37-46d3-bf87-e7c615b46888 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:48.689275 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1419/2842] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:13:48.694063 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ab7e9-69d5-4a30-8dc9-c18fa0336b2e admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:48.703989 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ab7e9-69d5-4a30-8dc9-c18fa0336b2e admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:48.709472 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e478b6-5416-4c0b-96cf-882ef6a13907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:48.710347 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e478b6-5416-4c0b-96cf-882ef6a13907 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:48.710631 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e478b6-5416-4c0b-96cf-882ef6a13907 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:48.710908 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e478b6-5416-4c0b-96cf-882ef6a13907 admin admin] PATH_INFO: `/v3/projects/ca1a3664ad7c46b8a977cf44113264fd/users/ec1f936f2ce64e97a939c1aab57cf89c/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:48.725310 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e478b6-5416-4c0b-96cf-882ef6a13907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1a3664ad7c46b8a977cf44113264fd, user_id=ec1f936f2ce64e97a939c1aab57cf89c, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:48.728042 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e478b6-5416-4c0b-96cf-882ef6a13907 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:48.793303 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1424/2843] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:13:48 2022] PUT /identity/v3/projects/ca1a3664ad7c46b8a977cf44113264fd/users/ec1f936f2ce64e97a939c1aab57cf89c/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:13:48.797418 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67734124-ec37-46d3-bf87-e7c615b46888 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:48.808137 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67734124-ec37-46d3-bf87-e7c615b46888 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:48.863687 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6275d-4cc3-4821-9e29-b84d02f3cfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:48.864355 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6275d-4cc3-4821-9e29-b84d02f3cfac admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:48.864635 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6275d-4cc3-4821-9e29-b84d02f3cfac admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:48.864936 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6275d-4cc3-4821-9e29-b84d02f3cfac admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:48.865643 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6275d-4cc3-4821-9e29-b84d02f3cfac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:48.867235 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6275d-4cc3-4821-9e29-b84d02f3cfac admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:48.876898 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1420/2844] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:13:48.881619 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e478b6-5416-4c0b-96cf-882ef6a13907 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:48.891678 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e478b6-5416-4c0b-96cf-882ef6a13907 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:48.896489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d5241-a0fd-4721-a4ba-c283cb3359b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:48.897357 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d5241-a0fd-4721-a4ba-c283cb3359b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:48.897635 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d5241-a0fd-4721-a4ba-c283cb3359b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:48.897931 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d5241-a0fd-4721-a4ba-c283cb3359b4 admin admin] PATH_INFO: `/v3/projects/ca1a3664ad7c46b8a977cf44113264fd/users/ec1f936f2ce64e97a939c1aab57cf89c/roles/c2642d38bc964424a5edc330e0d4471d` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:48.899920 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d5241-a0fd-4721-a4ba-c283cb3359b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1a3664ad7c46b8a977cf44113264fd, user_id=ec1f936f2ce64e97a939c1aab57cf89c, role_id=c2642d38bc964424a5edc330e0d4471d)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:48.902568 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d5241-a0fd-4721-a4ba-c283cb3359b4 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:48.912500 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1425/2845] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:13:48 2022] PUT /identity/v3/projects/ca1a3664ad7c46b8a977cf44113264fd/users/ec1f936f2ce64e97a939c1aab57cf89c/roles/c2642d38bc964424a5edc330e0d4471d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:13:48.923275 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1654a5-3f8f-4354-b010-4dd78b869a3b None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:48.923795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1654a5-3f8f-4354-b010-4dd78b869a3b None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:48.923979 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1654a5-3f8f-4354-b010-4dd78b869a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:48.950188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-5c1654a5-3f8f-4354-b010-4dd78b869a3b None None] MFA Rules not processed for user `ec1f936f2ce64e97a939c1aab57cf89c`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:13:48.951379 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5c1654a5-3f8f-4354-b010-4dd78b869a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:49.028000 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1421/2846] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:13:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:13:49.039713 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d5241-a0fd-4721-a4ba-c283cb3359b4 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:49.041427 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-838d5241-a0fd-4721-a4ba-c283cb3359b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:49.095417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d5241-a0fd-4721-a4ba-c283cb3359b4 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:49.099620 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdae931-8d34-4a90-9f41-a18be5d851e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:49.100256 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdae931-8d34-4a90-9f41-a18be5d851e9 service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:49.100537 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdae931-8d34-4a90-9f41-a18be5d851e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:49.100813 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdae931-8d34-4a90-9f41-a18be5d851e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:49.109458 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdae931-8d34-4a90-9f41-a18be5d851e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:49.110894 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdae931-8d34-4a90-9f41-a18be5d851e9 service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:49.120118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1426/2847] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:13:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:13:50.086823 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1654a5-3f8f-4354-b010-4dd78b869a3b None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:50.088226 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-5c1654a5-3f8f-4354-b010-4dd78b869a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:50.099935 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1654a5-3f8f-4354-b010-4dd78b869a3b None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:50.103470 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ab0b8-4e98-40de-85ff-b9bf3f136aa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:50.104140 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab0b8-4e98-40de-85ff-b9bf3f136aa0 service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:50.104423 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab0b8-4e98-40de-85ff-b9bf3f136aa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:50.104699 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab0b8-4e98-40de-85ff-b9bf3f136aa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:50.160081 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ab0b8-4e98-40de-85ff-b9bf3f136aa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:50.161530 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ab0b8-4e98-40de-85ff-b9bf3f136aa0 service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:50.170273 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1422/2848] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:13:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:13:54.970627 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdae931-8d34-4a90-9f41-a18be5d851e9 service cinder] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:54.982882 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdae931-8d34-4a90-9f41-a18be5d851e9 service cinder] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:54.986814 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fefe44-bd76-4f11-819f-dd5b66e681ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:54.987489 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fefe44-bd76-4f11-819f-dd5b66e681ed service cinder] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:54.987915 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fefe44-bd76-4f11-819f-dd5b66e681ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:54.988380 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fefe44-bd76-4f11-819f-dd5b66e681ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:55.057753 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fefe44-bd76-4f11-819f-dd5b66e681ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:55.059910 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fefe44-bd76-4f11-819f-dd5b66e681ed service cinder] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:55.068890 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1427/2849] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:13:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:13:58.819990 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ab0b8-4e98-40de-85ff-b9bf3f136aa0 service cinder] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:58.880493 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ab0b8-4e98-40de-85ff-b9bf3f136aa0 service cinder] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:58.885046 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d6f33-26ac-4b12-b814-5d2ae6fdea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:58.885919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d6f33-26ac-4b12-b814-5d2ae6fdea4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:58.886199 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d6f33-26ac-4b12-b814-5d2ae6fdea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:58.886474 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d6f33-26ac-4b12-b814-5d2ae6fdea4b admin admin] PATH_INFO: `/v3/users/b1f665c5d77441b1a24bfbcd44651eb2` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:58.887692 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d6f33-26ac-4b12-b814-5d2ae6fdea4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f665c5d77441b1a24bfbcd44651eb2)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:58.889605 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d6f33-26ac-4b12-b814-5d2ae6fdea4b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:59.034550 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b29d6f33-26ac-4b12-b814-5d2ae6fdea4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f665c5d77441b1a24bfbcd44651eb2'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:59.035170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b29d6f33-26ac-4b12-b814-5d2ae6fdea4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f665c5d77441b1a24bfbcd44651eb2'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:59.106924 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b29d6f33-26ac-4b12-b814-5d2ae6fdea4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f665c5d77441b1a24bfbcd44651eb2'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:59.119442 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b29d6f33-26ac-4b12-b814-5d2ae6fdea4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f665c5d77441b1a24bfbcd44651eb2'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:59.126319 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b29d6f33-26ac-4b12-b814-5d2ae6fdea4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f665c5d77441b1a24bfbcd44651eb2'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:59.132723 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1423/2850] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:13:58 2022] DELETE /identity/v3/users/b1f665c5d77441b1a24bfbcd44651eb2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:13:59.137268 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6319faf-4440-41c3-b45a-da0c75cba5c8 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:59.137791 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6319faf-4440-41c3-b45a-da0c75cba5c8 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:59.137897 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6319faf-4440-41c3-b45a-da0c75cba5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:59.155980 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-f6319faf-4440-41c3-b45a-da0c75cba5c8 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:13:59.157183 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f6319faf-4440-41c3-b45a-da0c75cba5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:59.216937 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1428/2851] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:13:59.226598 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d6f33-26ac-4b12-b814-5d2ae6fdea4b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:59.228229 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-b29d6f33-26ac-4b12-b814-5d2ae6fdea4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:59.287254 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d6f33-26ac-4b12-b814-5d2ae6fdea4b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:59.290898 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1aefa-76cc-4161-b5c5-ee87e7b9b508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:59.291564 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1aefa-76cc-4161-b5c5-ee87e7b9b508 service neutron] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:59.291847 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1aefa-76cc-4161-b5c5-ee87e7b9b508 service neutron] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:59.292121 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1aefa-76cc-4161-b5c5-ee87e7b9b508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:59.302036 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1aefa-76cc-4161-b5c5-ee87e7b9b508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:59.303547 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1aefa-76cc-4161-b5c5-ee87e7b9b508 service neutron] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:59.313228 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1424/2852] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:13:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:13:59.719761 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6319faf-4440-41c3-b45a-da0c75cba5c8 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:59.721249 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-f6319faf-4440-41c3-b45a-da0c75cba5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:13:59.735202 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6319faf-4440-41c3-b45a-da0c75cba5c8 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:13:59.740727 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:13:59.741620 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:13:59.741898 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:13:59.742176 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70 admin admin] PATH_INFO: `/v3/projects/9239e9f6f3d9452085b909d3f712fd62` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:13:59.743363 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9239e9f6f3d9452085b909d3f712fd62)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:13:59.745330 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:13:59.867313 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9239e9f6f3d9452085b909d3f712fd62', 'request_id': 'req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:59.873372 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9239e9f6f3d9452085b909d3f712fd62', 'request_id': 'req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:59.957823 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9239e9f6f3d9452085b909d3f712fd62', 'request_id': 'req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:59.968295 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70 admin admin] The token cache is being invalidate because project 9239e9f6f3d9452085b909d3f712fd62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:13:59.968583 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:59.969275 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:13:59.970809 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1429/2853] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:13:59 2022] DELETE /identity/v3/projects/9239e9f6f3d9452085b909d3f712fd62 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:13:59.975334 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1aefa-76cc-4161-b5c5-ee87e7b9b508 service neutron] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:13:59.985026 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1aefa-76cc-4161-b5c5-ee87e7b9b508 service neutron] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:00.041496 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2076b-9714-4d8d-886d-b551019d9d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:00.042369 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2076b-9714-4d8d-886d-b551019d9d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:00.042655 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2076b-9714-4d8d-886d-b551019d9d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:00.042933 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2076b-9714-4d8d-886d-b551019d9d1b admin admin] PATH_INFO: `/v3/users/caafc59bfbd145c19f5ef0a557abdd22` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:00.044147 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2076b-9714-4d8d-886d-b551019d9d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=caafc59bfbd145c19f5ef0a557abdd22)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:00.046103 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2076b-9714-4d8d-886d-b551019d9d1b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:00.218525 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2ce2076b-9714-4d8d-886d-b551019d9d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caafc59bfbd145c19f5ef0a557abdd22'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:00.219174 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2ce2076b-9714-4d8d-886d-b551019d9d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caafc59bfbd145c19f5ef0a557abdd22'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:00.312056 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2ce2076b-9714-4d8d-886d-b551019d9d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caafc59bfbd145c19f5ef0a557abdd22'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:00.325170 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2ce2076b-9714-4d8d-886d-b551019d9d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caafc59bfbd145c19f5ef0a557abdd22'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:00.331889 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-2ce2076b-9714-4d8d-886d-b551019d9d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caafc59bfbd145c19f5ef0a557abdd22'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:00.338049 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1425/2854] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:13:59 2022] DELETE /identity/v3/users/caafc59bfbd145c19f5ef0a557abdd22 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:14:00.723593 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:00.725181 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:00.740289 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9cc48-b849-4658-8c1a-21b3e2fb6d70 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:00.797804 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad9008-9846-4fbd-a20c-d8651b44df1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:00.798650 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad9008-9846-4fbd-a20c-d8651b44df1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:00.798935 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad9008-9846-4fbd-a20c-d8651b44df1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:00.799213 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad9008-9846-4fbd-a20c-d8651b44df1a admin admin] PATH_INFO: `/v3/projects/8ecfd34775f6404ca6191f8448cafe23` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:00.800444 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad9008-9846-4fbd-a20c-d8651b44df1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ecfd34775f6404ca6191f8448cafe23)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:00.802400 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad9008-9846-4fbd-a20c-d8651b44df1a admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:00.927229 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5cad9008-9846-4fbd-a20c-d8651b44df1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ecfd34775f6404ca6191f8448cafe23', 'request_id': 'req-5cad9008-9846-4fbd-a20c-d8651b44df1a'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:00.933428 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5cad9008-9846-4fbd-a20c-d8651b44df1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ecfd34775f6404ca6191f8448cafe23', 'request_id': 'req-5cad9008-9846-4fbd-a20c-d8651b44df1a'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:01.015095 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5cad9008-9846-4fbd-a20c-d8651b44df1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ecfd34775f6404ca6191f8448cafe23', 'request_id': 'req-5cad9008-9846-4fbd-a20c-d8651b44df1a'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:01.026625 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5cad9008-9846-4fbd-a20c-d8651b44df1a admin admin] The token cache is being invalidate because project 8ecfd34775f6404ca6191f8448cafe23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:14:01.036432 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5cad9008-9846-4fbd-a20c-d8651b44df1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:01.036432 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-5cad9008-9846-4fbd-a20c-d8651b44df1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:01.036432 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1430/2855] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:14:00 2022] DELETE /identity/v3/projects/8ecfd34775f6404ca6191f8448cafe23 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 12:14:01.036882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2076b-9714-4d8d-886d-b551019d9d1b admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:01.036882 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-2ce2076b-9714-4d8d-886d-b551019d9d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:01.047642 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2076b-9714-4d8d-886d-b551019d9d1b admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:01.102641 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d210ab-d0e3-40a5-b9f2-a813293afda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:01.103567 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d210ab-d0e3-40a5-b9f2-a813293afda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:01.103854 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d210ab-d0e3-40a5-b9f2-a813293afda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:01.104130 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d210ab-d0e3-40a5-b9f2-a813293afda8 admin admin] PATH_INFO: `/v3/users/ec1f936f2ce64e97a939c1aab57cf89c` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:01.105324 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d210ab-d0e3-40a5-b9f2-a813293afda8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1f936f2ce64e97a939c1aab57cf89c)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:01.107244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d210ab-d0e3-40a5-b9f2-a813293afda8 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:01.308174 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b0d210ab-d0e3-40a5-b9f2-a813293afda8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1f936f2ce64e97a939c1aab57cf89c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:01.308761 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b0d210ab-d0e3-40a5-b9f2-a813293afda8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1f936f2ce64e97a939c1aab57cf89c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:01.384196 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b0d210ab-d0e3-40a5-b9f2-a813293afda8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1f936f2ce64e97a939c1aab57cf89c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:01.396916 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b0d210ab-d0e3-40a5-b9f2-a813293afda8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1f936f2ce64e97a939c1aab57cf89c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:01.403716 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-b0d210ab-d0e3-40a5-b9f2-a813293afda8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1f936f2ce64e97a939c1aab57cf89c'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:01.409713 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1426/2856] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:14:01 2022] DELETE /identity/v3/users/ec1f936f2ce64e97a939c1aab57cf89c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:14:01.777000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad9008-9846-4fbd-a20c-d8651b44df1a admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:01.780883 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-5cad9008-9846-4fbd-a20c-d8651b44df1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:01.792583 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad9008-9846-4fbd-a20c-d8651b44df1a admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:01.865417 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea0ed9-33a6-4266-83f5-d42abdf9d707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:01.866196 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea0ed9-33a6-4266-83f5-d42abdf9d707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:01.866480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea0ed9-33a6-4266-83f5-d42abdf9d707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:01.866760 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea0ed9-33a6-4266-83f5-d42abdf9d707 admin admin] PATH_INFO: `/v3/projects/ca1a3664ad7c46b8a977cf44113264fd` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:01.868028 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea0ed9-33a6-4266-83f5-d42abdf9d707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1a3664ad7c46b8a977cf44113264fd)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:01.869940 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea0ed9-33a6-4266-83f5-d42abdf9d707 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:01.986775 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-80ea0ed9-33a6-4266-83f5-d42abdf9d707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1a3664ad7c46b8a977cf44113264fd', 'request_id': 'req-80ea0ed9-33a6-4266-83f5-d42abdf9d707'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:01.993475 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-80ea0ed9-33a6-4266-83f5-d42abdf9d707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1a3664ad7c46b8a977cf44113264fd', 'request_id': 'req-80ea0ed9-33a6-4266-83f5-d42abdf9d707'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:02.075372 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-80ea0ed9-33a6-4266-83f5-d42abdf9d707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1a3664ad7c46b8a977cf44113264fd', 'request_id': 'req-80ea0ed9-33a6-4266-83f5-d42abdf9d707'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:02.086419 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-80ea0ed9-33a6-4266-83f5-d42abdf9d707 admin admin] The token cache is being invalidate because project ca1a3664ad7c46b8a977cf44113264fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:14:02.086704 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-80ea0ed9-33a6-4266-83f5-d42abdf9d707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:02.087327 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-80ea0ed9-33a6-4266-83f5-d42abdf9d707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:02.088897 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1431/2857] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:14:01 2022] DELETE /identity/v3/projects/ca1a3664ad7c46b8a977cf44113264fd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:14:02.095080 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668789fc-3eda-4dc0-b2df-55b2b2fadb14 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:02.099237 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668789fc-3eda-4dc0-b2df-55b2b2fadb14 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:02.099237 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668789fc-3eda-4dc0-b2df-55b2b2fadb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:02.114766 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-668789fc-3eda-4dc0-b2df-55b2b2fadb14 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:14:02.116081 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-668789fc-3eda-4dc0-b2df-55b2b2fadb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:02.186228 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1427/2858] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 12:14:02.195065 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a06d5-371c-48fd-af80-631f8ff206a7 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:02.195351 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a06d5-371c-48fd-af80-631f8ff206a7 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:02.195659 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a06d5-371c-48fd-af80-631f8ff206a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:02.214666 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-ba9a06d5-371c-48fd-af80-631f8ff206a7 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:14:02.215932 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-ba9a06d5-371c-48fd-af80-631f8ff206a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:02.224593 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1432/2859] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:14:02.234142 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668789fc-3eda-4dc0-b2df-55b2b2fadb14 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:02.244595 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668789fc-3eda-4dc0-b2df-55b2b2fadb14 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:02.249317 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a465e76-4bb7-477b-bed3-e59485d43585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:02.250244 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a465e76-4bb7-477b-bed3-e59485d43585 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:02.250533 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a465e76-4bb7-477b-bed3-e59485d43585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:02.250806 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a465e76-4bb7-477b-bed3-e59485d43585 admin admin] PATH_INFO: `/v3/domains` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:02.251565 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a465e76-4bb7-477b-bed3-e59485d43585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:14:02.251877 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a465e76-4bb7-477b-bed3-e59485d43585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:02.253533 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a465e76-4bb7-477b-bed3-e59485d43585 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:02.265904 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1428/2860] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:14:02.271000 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a06d5-371c-48fd-af80-631f8ff206a7 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:02.280717 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a06d5-371c-48fd-af80-631f8ff206a7 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:02.286056 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860419-c906-422c-a75e-4a256792b761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:02.286802 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860419-c906-422c-a75e-4a256792b761 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:02.287092 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860419-c906-422c-a75e-4a256792b761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:02.287372 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860419-c906-422c-a75e-4a256792b761 admin admin] PATH_INFO: `/v3/projects` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:02.288201 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31860419-c906-422c-a75e-4a256792b761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:02.290118 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31860419-c906-422c-a75e-4a256792b761 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:02.376354 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1433/2861] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:14:02 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:14:02.380333 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a465e76-4bb7-477b-bed3-e59485d43585 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:02.390273 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a465e76-4bb7-477b-bed3-e59485d43585 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:02.444741 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d3b42-7a2a-4b5d-96bf-1acf78f1a54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:02.445400 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d3b42-7a2a-4b5d-96bf-1acf78f1a54f admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:02.445679 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d3b42-7a2a-4b5d-96bf-1acf78f1a54f admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:02.445972 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d3b42-7a2a-4b5d-96bf-1acf78f1a54f admin admin] PATH_INFO: `/v3/users` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:02.446649 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d3b42-7a2a-4b5d-96bf-1acf78f1a54f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:02.448616 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d3b42-7a2a-4b5d-96bf-1acf78f1a54f admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:02.537017 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1429/2862] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:14:02 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:14:02.541541 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860419-c906-422c-a75e-4a256792b761 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:02.553892 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860419-c906-422c-a75e-4a256792b761 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:02.560375 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf68a40-8754-4632-8080-15d1c6377f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:02.561035 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf68a40-8754-4632-8080-15d1c6377f1c admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:02.561311 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf68a40-8754-4632-8080-15d1c6377f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:02.561583 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf68a40-8754-4632-8080-15d1c6377f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:02.562356 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf68a40-8754-4632-8080-15d1c6377f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:02.564030 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf68a40-8754-4632-8080-15d1c6377f1c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:02.574634 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1434/2863] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:14:02.578710 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d3b42-7a2a-4b5d-96bf-1acf78f1a54f admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:02.589331 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d3b42-7a2a-4b5d-96bf-1acf78f1a54f admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:02.593968 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a960a8-bb5a-4fcc-bc52-a8fa8e5a79a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:02.594630 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a960a8-bb5a-4fcc-bc52-a8fa8e5a79a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:02.594914 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a960a8-bb5a-4fcc-bc52-a8fa8e5a79a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:02.595192 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a960a8-bb5a-4fcc-bc52-a8fa8e5a79a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:02.595952 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a960a8-bb5a-4fcc-bc52-a8fa8e5a79a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:02.597591 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a960a8-bb5a-4fcc-bc52-a8fa8e5a79a9 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:02.608396 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1430/2864] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:14:02.612596 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf68a40-8754-4632-8080-15d1c6377f1c admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:02.622584 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf68a40-8754-4632-8080-15d1c6377f1c admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:02.627402 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482a1c6-ed58-44d5-9ea6-17b7e99d669b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:02.628243 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a1c6-ed58-44d5-9ea6-17b7e99d669b admin admin] REQUEST_METHOD: `PUT` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:02.628522 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a1c6-ed58-44d5-9ea6-17b7e99d669b admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:02.628797 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a1c6-ed58-44d5-9ea6-17b7e99d669b admin admin] PATH_INFO: `/v3/projects/9061faeae35f4ac087cd82380643594b/users/a9302e1cfbae4207801eeaa33b1182a1/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:02.643754 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482a1c6-ed58-44d5-9ea6-17b7e99d669b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9061faeae35f4ac087cd82380643594b, user_id=a9302e1cfbae4207801eeaa33b1182a1, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:02.646957 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482a1c6-ed58-44d5-9ea6-17b7e99d669b admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:02.713270 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1435/2865] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:14:02 2022] PUT /identity/v3/projects/9061faeae35f4ac087cd82380643594b/users/a9302e1cfbae4207801eeaa33b1182a1/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:14:02.777028 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07209c-b610-44d0-82e3-cd74641d67fa None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:02.777318 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07209c-b610-44d0-82e3-cd74641d67fa None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:02.777601 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07209c-b610-44d0-82e3-cd74641d67fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:02.804155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-ce07209c-b610-44d0-82e3-cd74641d67fa None None] MFA Rules not processed for user `a9302e1cfbae4207801eeaa33b1182a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:14:02.805405 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ce07209c-b610-44d0-82e3-cd74641d67fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:02.868773 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1431/2866] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:14:02.881945 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482a1c6-ed58-44d5-9ea6-17b7e99d669b admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:02.883604 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-5482a1c6-ed58-44d5-9ea6-17b7e99d669b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:02.937277 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482a1c6-ed58-44d5-9ea6-17b7e99d669b admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:02.941096 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885ec5f-bfc9-4cd5-a1b1-b16df21a0336 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65583446d2e40a69dff534b73e8fa7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:02.942833 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885ec5f-bfc9-4cd5-a1b1-b16df21a0336 service glance] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:02.943126 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885ec5f-bfc9-4cd5-a1b1-b16df21a0336 service glance] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:02.943411 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885ec5f-bfc9-4cd5-a1b1-b16df21a0336 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:02.951806 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885ec5f-bfc9-4cd5-a1b1-b16df21a0336 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:02.953243 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885ec5f-bfc9-4cd5-a1b1-b16df21a0336 service glance] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:02.964255 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1436/2867] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:14:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:14:19.725223 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07209c-b610-44d0-82e3-cd74641d67fa None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:19.726702 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ce07209c-b610-44d0-82e3-cd74641d67fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:19.815188 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07209c-b610-44d0-82e3-cd74641d67fa None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:19.820592 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e84056-a40d-4dad-bab8-fdbd7d9cde6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8855284b10c64b8ca367e3c30b5f66fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:19.821268 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e84056-a40d-4dad-bab8-fdbd7d9cde6e service placement] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:19.821554 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e84056-a40d-4dad-bab8-fdbd7d9cde6e service placement] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:19.821836 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e84056-a40d-4dad-bab8-fdbd7d9cde6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:19.823751 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-f7e84056-a40d-4dad-bab8-fdbd7d9cde6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:19.837040 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e84056-a40d-4dad-bab8-fdbd7d9cde6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:19.849315 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e84056-a40d-4dad-bab8-fdbd7d9cde6e service placement] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:19.850700 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1432/2868] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:14:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:14:20.001605 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885ec5f-bfc9-4cd5-a1b1-b16df21a0336 service glance] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:20.068771 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885ec5f-bfc9-4cd5-a1b1-b16df21a0336 service glance] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:20.073385 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13067c2a-33fd-4dda-b8c2-cdcaa3200074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:20.074260 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13067c2a-33fd-4dda-b8c2-cdcaa3200074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:20.074540 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13067c2a-33fd-4dda-b8c2-cdcaa3200074 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:20.074816 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13067c2a-33fd-4dda-b8c2-cdcaa3200074 admin admin] PATH_INFO: `/v3/users/a9302e1cfbae4207801eeaa33b1182a1` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:20.076043 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13067c2a-33fd-4dda-b8c2-cdcaa3200074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9302e1cfbae4207801eeaa33b1182a1)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:20.077955 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13067c2a-33fd-4dda-b8c2-cdcaa3200074 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:20.245137 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-13067c2a-33fd-4dda-b8c2-cdcaa3200074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9302e1cfbae4207801eeaa33b1182a1'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:20.245721 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-13067c2a-33fd-4dda-b8c2-cdcaa3200074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9302e1cfbae4207801eeaa33b1182a1'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:20.252742 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-13067c2a-33fd-4dda-b8c2-cdcaa3200074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9302e1cfbae4207801eeaa33b1182a1'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:20.322987 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-13067c2a-33fd-4dda-b8c2-cdcaa3200074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9302e1cfbae4207801eeaa33b1182a1'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:20.335702 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-13067c2a-33fd-4dda-b8c2-cdcaa3200074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9302e1cfbae4207801eeaa33b1182a1'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:20.341652 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1437/2869] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:14:20 2022] DELETE /identity/v3/users/a9302e1cfbae4207801eeaa33b1182a1 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:14:20.346203 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bd26f-44d2-428e-ae4f-0877700aa174 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:20.346492 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bd26f-44d2-428e-ae4f-0877700aa174 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:20.346769 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bd26f-44d2-428e-ae4f-0877700aa174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:20.365958 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-501bd26f-44d2-428e-ae4f-0877700aa174 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:14:20.372958 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-501bd26f-44d2-428e-ae4f-0877700aa174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:20.425055 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1433/2870] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:14:20.435242 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13067c2a-33fd-4dda-b8c2-cdcaa3200074 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:20.441602 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-13067c2a-33fd-4dda-b8c2-cdcaa3200074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:20.492991 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13067c2a-33fd-4dda-b8c2-cdcaa3200074 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:20.496726 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fede5-ca16-4845-aa90-2aff75e4754f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:20.497316 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fede5-ca16-4845-aa90-2aff75e4754f service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:20.497601 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fede5-ca16-4845-aa90-2aff75e4754f service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:20.497882 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fede5-ca16-4845-aa90-2aff75e4754f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:20.507842 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fede5-ca16-4845-aa90-2aff75e4754f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:20.509287 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fede5-ca16-4845-aa90-2aff75e4754f service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:20.518614 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1438/2871] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:14:20.928666 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bd26f-44d2-428e-ae4f-0877700aa174 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:20.930265 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-501bd26f-44d2-428e-ae4f-0877700aa174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:20.942077 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bd26f-44d2-428e-ae4f-0877700aa174 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:20.947442 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90233bc5-e6b0-4cf9-9071-d74c9bf149d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:20.948356 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90233bc5-e6b0-4cf9-9071-d74c9bf149d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:20.948634 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90233bc5-e6b0-4cf9-9071-d74c9bf149d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:20.948906 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90233bc5-e6b0-4cf9-9071-d74c9bf149d1 admin admin] PATH_INFO: `/v3/projects/9061faeae35f4ac087cd82380643594b` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:20.950195 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90233bc5-e6b0-4cf9-9071-d74c9bf149d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9061faeae35f4ac087cd82380643594b)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:20.952514 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90233bc5-e6b0-4cf9-9071-d74c9bf149d1 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:21.057126 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-90233bc5-e6b0-4cf9-9071-d74c9bf149d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9061faeae35f4ac087cd82380643594b', 'request_id': 'req-90233bc5-e6b0-4cf9-9071-d74c9bf149d1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:21.120475 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-90233bc5-e6b0-4cf9-9071-d74c9bf149d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9061faeae35f4ac087cd82380643594b', 'request_id': 'req-90233bc5-e6b0-4cf9-9071-d74c9bf149d1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:21.127436 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-90233bc5-e6b0-4cf9-9071-d74c9bf149d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9061faeae35f4ac087cd82380643594b', 'request_id': 'req-90233bc5-e6b0-4cf9-9071-d74c9bf149d1'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:21.137949 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-90233bc5-e6b0-4cf9-9071-d74c9bf149d1 admin admin] The token cache is being invalidate because project 9061faeae35f4ac087cd82380643594b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:14:21.138236 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-90233bc5-e6b0-4cf9-9071-d74c9bf149d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:21.138862 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-90233bc5-e6b0-4cf9-9071-d74c9bf149d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:21.140431 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1434/2872] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:14:20 2022] DELETE /identity/v3/projects/9061faeae35f4ac087cd82380643594b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:14:21.146242 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284f8ad-88e3-4bc7-af14-b877c8117e4b None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:21.146745 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284f8ad-88e3-4bc7-af14-b877c8117e4b None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:21.146855 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284f8ad-88e3-4bc7-af14-b877c8117e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:21.165219 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-9284f8ad-88e3-4bc7-af14-b877c8117e4b None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:14:21.166422 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-9284f8ad-88e3-4bc7-af14-b877c8117e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:21.225422 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1439/2873] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:14:21.233112 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c1f8f-2167-4565-b99f-7fc1f5121489 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:21.233471 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c1f8f-2167-4565-b99f-7fc1f5121489 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:21.233755 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c1f8f-2167-4565-b99f-7fc1f5121489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:21.252429 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-ed3c1f8f-2167-4565-b99f-7fc1f5121489 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:14:21.268826 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-ed3c1f8f-2167-4565-b99f-7fc1f5121489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:21.268826 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1435/2874] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:14:21.272280 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284f8ad-88e3-4bc7-af14-b877c8117e4b None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:21.282337 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284f8ad-88e3-4bc7-af14-b877c8117e4b None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:21.287657 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea938b89-4d3e-4976-bbf0-bba03e07083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:21.288314 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea938b89-4d3e-4976-bbf0-bba03e07083c admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:21.288596 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea938b89-4d3e-4976-bbf0-bba03e07083c admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:21.288872 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea938b89-4d3e-4976-bbf0-bba03e07083c admin admin] PATH_INFO: `/v3/domains` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:21.289586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea938b89-4d3e-4976-bbf0-bba03e07083c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 12:14:21.289895 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea938b89-4d3e-4976-bbf0-bba03e07083c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:21.291561 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea938b89-4d3e-4976-bbf0-bba03e07083c admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:21.303383 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1440/2875] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Mar 8 12:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 12:14:21.307810 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c1f8f-2167-4565-b99f-7fc1f5121489 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:21.316897 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c1f8f-2167-4565-b99f-7fc1f5121489 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:21.322355 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89e886-c32e-4f89-9851-e530ad581752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:21.323025 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89e886-c32e-4f89-9851-e530ad581752 admin admin] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:21.323312 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89e886-c32e-4f89-9851-e530ad581752 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:21.323626 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89e886-c32e-4f89-9851-e530ad581752 admin admin] PATH_INFO: `/v3/projects` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:21.324335 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89e886-c32e-4f89-9851-e530ad581752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:21.326231 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89e886-c32e-4f89-9851-e530ad581752 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:21.407273 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1436/2876] 10.222.0.52 () {60 vars in 1152 bytes} [Tue Mar 8 12:14:21 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 12:14:21.412080 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea938b89-4d3e-4976-bbf0-bba03e07083c admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:21.422218 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea938b89-4d3e-4976-bbf0-bba03e07083c admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:21.477559 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029695d8-8b2e-460e-8ace-ef5d27c0bdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:21.478227 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029695d8-8b2e-460e-8ace-ef5d27c0bdb6 admin admin] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:21.478507 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029695d8-8b2e-460e-8ace-ef5d27c0bdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:21.478781 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029695d8-8b2e-460e-8ace-ef5d27c0bdb6 admin admin] PATH_INFO: `/v3/users` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:21.479501 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029695d8-8b2e-460e-8ace-ef5d27c0bdb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:21.481480 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029695d8-8b2e-460e-8ace-ef5d27c0bdb6 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:21.581382 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1441/2877] 10.222.0.52 () {60 vars in 1143 bytes} [Tue Mar 8 12:14:21 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 12:14:21.585825 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89e886-c32e-4f89-9851-e530ad581752 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:21.596258 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89e886-c32e-4f89-9851-e530ad581752 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:21.601211 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0577b7-1eb9-4bce-8d56-75b2dd6c7068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:21.601873 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0577b7-1eb9-4bce-8d56-75b2dd6c7068 admin admin] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:21.602155 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0577b7-1eb9-4bce-8d56-75b2dd6c7068 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:21.602458 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0577b7-1eb9-4bce-8d56-75b2dd6c7068 admin admin] PATH_INFO: `/v3/roles` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:21.603177 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0577b7-1eb9-4bce-8d56-75b2dd6c7068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:21.604798 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0577b7-1eb9-4bce-8d56-75b2dd6c7068 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:21.617107 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1437/2878] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 12:14:21.620993 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029695d8-8b2e-460e-8ace-ef5d27c0bdb6 admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:21.631885 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029695d8-8b2e-460e-8ace-ef5d27c0bdb6 admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:21.636464 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9090a98-1269-41c4-ab08-30fad44ab3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:21.637120 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9090a98-1269-41c4-ab08-30fad44ab3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:21.637404 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9090a98-1269-41c4-ab08-30fad44ab3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:21.637711 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9090a98-1269-41c4-ab08-30fad44ab3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:21.638427 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9090a98-1269-41c4-ab08-30fad44ab3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:21.640061 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9090a98-1269-41c4-ab08-30fad44ab3d1 admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:21.650374 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1442/2879] 10.222.0.52 () {58 vars in 1121 bytes} [Tue Mar 8 12:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 12:14:21.654450 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0577b7-1eb9-4bce-8d56-75b2dd6c7068 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:21.664368 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0577b7-1eb9-4bce-8d56-75b2dd6c7068 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:21.668919 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab733cc-bee5-42ab-95fd-8fbdeb531850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:21.669800 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab733cc-bee5-42ab-95fd-8fbdeb531850 admin admin] REQUEST_METHOD: `PUT` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:21.670077 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab733cc-bee5-42ab-95fd-8fbdeb531850 admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:21.670347 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab733cc-bee5-42ab-95fd-8fbdeb531850 admin admin] PATH_INFO: `/v3/projects/d2292d68772c479f8aa41c1bbcb96adc/users/f17e1d22d0ed40118ab03aaa47c8fb7a/roles/54b3d96f6c9d4d3cbf19a6f0663ba935` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:21.684149 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab733cc-bee5-42ab-95fd-8fbdeb531850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2292d68772c479f8aa41c1bbcb96adc, user_id=f17e1d22d0ed40118ab03aaa47c8fb7a, role_id=54b3d96f6c9d4d3cbf19a6f0663ba935)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:21.686778 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab733cc-bee5-42ab-95fd-8fbdeb531850 admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:21.768828 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1438/2880] 10.222.0.52 () {60 vars in 1482 bytes} [Tue Mar 8 12:14:21 2022] PUT /identity/v3/projects/d2292d68772c479f8aa41c1bbcb96adc/users/f17e1d22d0ed40118ab03aaa47c8fb7a/roles/54b3d96f6c9d4d3cbf19a6f0663ba935 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:14:21.778973 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1699b-b19d-43b7-b45e-073a1af577e6 None None] REQUEST_METHOD: `POST` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:21.779283 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1699b-b19d-43b7-b45e-073a1af577e6 None None] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:21.779586 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1699b-b19d-43b7-b45e-073a1af577e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:21.806305 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.auth.core [None req-93c1699b-b19d-43b7-b45e-073a1af577e6 None None] MFA Rules not processed for user `f17e1d22d0ed40118ab03aaa47c8fb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:14:21.807501 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-93c1699b-b19d-43b7-b45e-073a1af577e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:21.868365 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1443/2881] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:14:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:14:21.880176 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab733cc-bee5-42ab-95fd-8fbdeb531850 admin admin] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:21.882010 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-0ab733cc-bee5-42ab-95fd-8fbdeb531850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:21.936955 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab733cc-bee5-42ab-95fd-8fbdeb531850 admin admin] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:21.940827 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c72db3-b1b1-46b0-a676-fe58e7e900db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5631271ed54eacbbbbbb5c8d14d764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:21.941473 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c72db3-b1b1-46b0-a676-fe58e7e900db service cinder] REQUEST_METHOD: `GET` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:21.941755 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c72db3-b1b1-46b0-a676-fe58e7e900db service cinder] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:21.942742 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c72db3-b1b1-46b0-a676-fe58e7e900db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:21.951079 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c72db3-b1b1-46b0-a676-fe58e7e900db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:21.952536 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c72db3-b1b1-46b0-a676-fe58e7e900db service cinder] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:21.961180 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1439/2882] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:14:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 12:14:42.849409 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1699b-b19d-43b7-b45e-073a1af577e6 None None] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:42.913055 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1699b-b19d-43b7-b45e-073a1af577e6 None None] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:42.917687 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae6e0d-0cd5-4d38-8954-c0bc3cd33f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:42.918557 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae6e0d-0cd5-4d38-8954-c0bc3cd33f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:42.918837 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae6e0d-0cd5-4d38-8954-c0bc3cd33f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:42.919115 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae6e0d-0cd5-4d38-8954-c0bc3cd33f6f admin admin] PATH_INFO: `/v3/users/f17e1d22d0ed40118ab03aaa47c8fb7a` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:42.920344 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae6e0d-0cd5-4d38-8954-c0bc3cd33f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17e1d22d0ed40118ab03aaa47c8fb7a)` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:42.922282 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae6e0d-0cd5-4d38-8954-c0bc3cd33f6f admin admin] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:43.084254 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4cae6e0d-0cd5-4d38-8954-c0bc3cd33f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17e1d22d0ed40118ab03aaa47c8fb7a'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:43.084852 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4cae6e0d-0cd5-4d38-8954-c0bc3cd33f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17e1d22d0ed40118ab03aaa47c8fb7a'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:43.091490 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4cae6e0d-0cd5-4d38-8954-c0bc3cd33f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17e1d22d0ed40118ab03aaa47c8fb7a'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:43.161994 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4cae6e0d-0cd5-4d38-8954-c0bc3cd33f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17e1d22d0ed40118ab03aaa47c8fb7a'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:43.174258 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.notifications [None req-4cae6e0d-0cd5-4d38-8954-c0bc3cd33f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17e1d22d0ed40118ab03aaa47c8fb7a'} {{(pid=86145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:43.180726 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1444/2883] 10.222.0.52 () {58 vars in 1223 bytes} [Tue Mar 8 12:14:42 2022] DELETE /identity/v3/users/f17e1d22d0ed40118ab03aaa47c8fb7a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:14:43.186508 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa927f2-5e6f-4cc0-a7f5-a3e48c55f053 None None] REQUEST_METHOD: `POST` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:43.187050 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa927f2-5e6f-4cc0-a7f5-a3e48c55f053 None None] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:43.187505 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa927f2-5e6f-4cc0-a7f5-a3e48c55f053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:43.213759 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.auth.core [None req-dfa927f2-5e6f-4cc0-a7f5-a3e48c55f053 None None] MFA Rules not processed for user `06642583007748d2a52d59e585d12052`. Rule list: `[]` (Enabled: `True`). {{(pid=86144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 12:14:43.224383 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-dfa927f2-5e6f-4cc0-a7f5-a3e48c55f053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:43.274927 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1440/2884] 10.222.0.52 () {58 vars in 957 bytes} [Tue Mar 8 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 12:14:43.284776 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae6e0d-0cd5-4d38-8954-c0bc3cd33f6f admin admin] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:43.286210 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-4cae6e0d-0cd5-4d38-8954-c0bc3cd33f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:43.343500 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae6e0d-0cd5-4d38-8954-c0bc3cd33f6f admin admin] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:43.347086 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ded80-eb34-42e6-aae2-fde4ff0c5a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f8507c0ae342f7a3e97b48363ad606', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:43.347839 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ded80-eb34-42e6-aae2-fde4ff0c5a2a service neutron] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:43.348121 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ded80-eb34-42e6-aae2-fde4ff0c5a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:43.348395 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ded80-eb34-42e6-aae2-fde4ff0c5a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:43.357593 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ded80-eb34-42e6-aae2-fde4ff0c5a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:43.359035 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ded80-eb34-42e6-aae2-fde4ff0c5a2a service neutron] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:43.368580 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1445/2885] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 12:14:43.763665 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa927f2-5e6f-4cc0-a7f5-a3e48c55f053 None None] Authenticating user token {{(pid=86144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:14:43.766618 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.fernet_utils [None req-dfa927f2-5e6f-4cc0-a7f5-a3e48c55f053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:14:43.788053 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa927f2-5e6f-4cc0-a7f5-a3e48c55f053 None None] Validating token access rules against request {{(pid=86144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:14:43.794262 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcb66b-1a7a-4cbd-84e7-9a42d6734a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06642583007748d2a52d59e585d12052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '675cf84704734f5798e386951dca511b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:14:43.795345 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcb66b-1a7a-4cbd-84e7-9a42d6734a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:14:43.795859 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcb66b-1a7a-4cbd-84e7-9a42d6734a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:14:43.796389 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcb66b-1a7a-4cbd-84e7-9a42d6734a3b admin admin] PATH_INFO: `/v3/projects/d2292d68772c479f8aa41c1bbcb96adc` {{(pid=86144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:14:43.797855 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcb66b-1a7a-4cbd-84e7-9a42d6734a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2292d68772c479f8aa41c1bbcb96adc)` {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:14:43.800365 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcb66b-1a7a-4cbd-84e7-9a42d6734a3b admin admin] RBAC: Authorization granted {{(pid=86144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:14:43.936992 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8adcb66b-1a7a-4cbd-84e7-9a42d6734a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2292d68772c479f8aa41c1bbcb96adc', 'request_id': 'req-8adcb66b-1a7a-4cbd-84e7-9a42d6734a3b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:44.005894 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8adcb66b-1a7a-4cbd-84e7-9a42d6734a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2292d68772c479f8aa41c1bbcb96adc', 'request_id': 'req-8adcb66b-1a7a-4cbd-84e7-9a42d6734a3b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:44.012829 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8adcb66b-1a7a-4cbd-84e7-9a42d6734a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2292d68772c479f8aa41c1bbcb96adc', 'request_id': 'req-8adcb66b-1a7a-4cbd-84e7-9a42d6734a3b'} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:44.023795 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8adcb66b-1a7a-4cbd-84e7-9a42d6734a3b admin admin] The token cache is being invalidate because project d2292d68772c479f8aa41c1bbcb96adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 12:14:44.024085 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8adcb66b-1a7a-4cbd-84e7-9a42d6734a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:44.024732 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: DEBUG keystone.notifications [None req-8adcb66b-1a7a-4cbd-84e7-9a42d6734a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 12:14:44.026262 dv-cinder-830087-2-iscsi devstack@keystone.service[86144]: [pid: 86144|app: 0|req: 1441/2886] 10.222.0.52 () {58 vars in 1232 bytes} [Tue Mar 8 12:14:43 2022] DELETE /identity/v3/projects/d2292d68772c479f8aa41c1bbcb96adc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 12:19:25.690198 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ded80-eb34-42e6-aae2-fde4ff0c5a2a service neutron] Authenticating user token {{(pid=86145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 12:19:25.691647 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-611ded80-eb34-42e6-aae2-fde4ff0c5a2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:19:25.759708 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ded80-eb34-42e6-aae2-fde4ff0c5a2a service neutron] Validating token access rules against request {{(pid=86145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 12:19:25.817900 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d5f65-58f3-4cf6-8e65-c6b6c41175a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8855284b10c64b8ca367e3c30b5f66fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c390663688b466f98ff480c31ba21bc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 12:19:25.823478 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5f65-58f3-4cf6-8e65-c6b6c41175a7 service placement] REQUEST_METHOD: `GET` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 12:19:25.823478 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5f65-58f3-4cf6-8e65-c6b6c41175a7 service placement] SCRIPT_NAME: `/identity` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 12:19:25.823478 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5f65-58f3-4cf6-8e65-c6b6c41175a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 12:19:25.823478 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.fernet_utils [None req-399d5f65-58f3-4cf6-8e65-c6b6c41175a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 12:19:25.832546 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d5f65-58f3-4cf6-8e65-c6b6c41175a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 12:19:25.834123 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d5f65-58f3-4cf6-8e65-c6b6c41175a7 service placement] RBAC: Authorization granted {{(pid=86145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 12:19:25.844641 dv-cinder-830087-2-iscsi devstack@keystone.service[86145]: [pid: 86145|app: 0|req: 1446/2887] 10.222.0.52 () {60 vars in 1365 bytes} [Tue Mar 8 12:19:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)